New
International Conference on Information Systems (ICIS) (2022) AI Processed Human Approved
A Research Agenda to Understand Drivers of Digital Gullibility
This paper proposes a socio-technical research agenda to investigate the underlying drivers and contextual factors of digital gullibility. The authors analyze how user characteristics, information context, and system design interact to influence epistemic vigilance and online decision-making. By establishing ten core propositions across three research gaps, the study provides guidance for creating resilient information systems that mitigate gullible behaviors.
Problem
Despite the rise of online misinformation, phishing, and digital scams, information systems research traditionally focuses on output symptoms rather than human gullibility as a root cause. Current theoretical models fail to explain why non-malicious users routinely accept untrustworthy online cues and suffer costly consequences. Without understanding these drivers, researchers and designers struggle to build systems that support critical information evaluation.
Outcome
- Frames digital gullibility as a key antecedent to maladaptive online behaviors rather than focusing solely on misinformation output.
- Integrates socio-technical system principles with concepts like context collapse and network externalities to explain persistent online gullibility.
- Formulates ten research propositions across three gaps: information context, individual seeking behavior, and realized behavior.
- Provides actionable guidance for designing user-centric systems that enhance epistemic vigilance and reduce information verification costs.
- Integrates socio-technical system principles with concepts like context collapse and network externalities to explain persistent online gullibility.
- Formulates ten research propositions across three gaps: information context, individual seeking behavior, and realized behavior.
- Provides actionable guidance for designing user-centric systems that enhance epistemic vigilance and reduce information verification costs.
What it means for you
- CIO / IT Executive: On Monday morning, initiate a cross-departmental working group with representatives from Security, User Experience, and Training to review the research agenda's propositions, specifically focusing on how to integrate 'epistemic vigilance' enhancement into the next IT security awareness training module, prioritizing the 'information context' gap.
- IT Manager: On Monday morning, schedule a 30-minute review session with your team to discuss the concept of 'context collapse' as presented in the research and brainstorm one specific system design tweak (e.g., adding a 'source credibility' indicator to internal dashboards) that could reduce information verification costs for your users, to be piloted within the week.
- Business Strategist: On Monday morning, draft a one-page executive summary for your leadership team that translates the research's core finding on 'digital gullibility as an antecedent to maladaptive online behaviors' into a business risk, proposing a brief for exploring how to quantify the cost of digital gullibility within your organization's operations.
- Researcher: On Monday morning, begin a literature review focused on the 'individual seeking behavior' gap outlined in the research, specifically searching for empirical studies that measure user-reported 'epistemic vigilance' in different online environments to refine your next research question.
- Policymaker: On Monday morning, draft an inquiry to relevant government agencies or industry bodies requesting current data on the prevalence and economic impact of 'digital scams' and 'phishing' within your jurisdiction, framing the request around understanding 'digital gullibility' as a root cause.
Transcript
Host: Welcome to A.I.S. Insights — powered by Living Knowledge. I'm your host, Anna Ivy Summers. Today, we're diving into a fascinating and timely topic: digital gullibility. We're looking at a groundbreaking study titled "A Research Agenda to Understand Drivers of Digital Gullibility." Joining me to break this down is our lead analyst, Alex Ian Sutherland. Alex, welcome!
Expert: Thanks, Anna. It's great to be here. This study really shifts how we think about online risk, misinformation, and digital security.
Host: So, Alex, to kick things off, what is this study trying to address at a high level?
Expert: Well, at its core, the study proposes a socio-technical research framework to understand why people fall for false information online—what researchers call digital gullibility. Instead of just looking at the fake news or phishing emails themselves, the authors look at the human side: how user traits, information contexts, and system designs interact to influence our ability to evaluate information critically, or what's known as epistemic vigilance.
Host: That brings us right to the core problem, doesn't it? Every day we hear about online scams, phishing attacks, and viral misinformation costing businesses and individuals millions of dollars. But how has research traditionally handled this issue?
Expert: That's the key issue. Traditionally, cybersecurity and information systems research focused almost entirely on the outputs—the symptoms, if you will—like tracking phishing campaigns or algorithmically blocking fake news. The study points out that this is like treating a disease by only addressing the fever. It completely misses the root cause: why well-intentioned users accept untrustworthy cues in the first place. Existing economic models often assume people are strictly rational and will stop bad behaviors once they learn from mistakes. But in the digital world, people keep falling for these traps, and we lacked a comprehensive theory to explain why.
Host: That's a huge blind spot. How did the authors approach solving this gap?
Expert: The authors applied a socio-technical systems lens. This means looking at technology, people, data, and organizational processes as an interconnected system. They combined this perspective with two critical behavioral concepts: context collapse and network externalities.
Host: "Context collapse" sounds like a big academic term. Can you explain what that actually means in everyday life?
Expert: Absolutely. On the internet, all kinds of information get flattened into the same screen or feed. An invoice, a news article, a message from a coworker, and an ad from an unknown party all appear in similar formats. That's context collapse. Maintaining separate levels of skepticism for every single source puts a massive cognitive burden on users. So, people use cognitive shortcuts and treat everything with a uniform level of trust, which makes them vulnerable.
Host: That makes total sense. And what about network externalities in this context?
Expert: That relates to costs and accountability. In many online scenarios, when a user falls for a phishing email or spreads false data, the user doesn't personally bear the immediate financial or operational cost—the organization does. Because the individual doesn't feel direct consequences, the natural learning mechanism that would normally stop gullible behavior is broken.
Host: Wow, that really highlights why this keeps happening. What were the key outcomes or framework proposed by the study?
Expert: The study organizes the research agenda into three core gaps and ten specific propositions. First, it examines the information context—how factors like brand trust, message salience, and content value affect our critical thinking. Second, it looks at individual user characteristics, like how demographic traits and trust propensity influence whether someone takes the time to verify information. And third, it looks at realized behavior, analyzing how social costs and direct consequences impact actual decision-making.
Host: Why is this perspective so crucial for business leaders and technology designers?
Expert: For businesses, it's a game-changer. It shows that telling employees to "be more careful" isn't enough. System designers need to build platforms that actively support epistemic vigilance. That means designing user interfaces that lower the effort required to verify information, highlighting risk cues effectively, and even using AI tools to flag suspicious context before a user acts. By understanding the root drivers of digital gullibility, companies can build truly resilient digital environments rather than constantly playing catch-up with cyber threats.
Host: It really sounds like a necessary paradigm shift for enterprise security and product design. Alex, thank you so much for sharing these insights today.
Expert: My pleasure, Anna.
Host: And thank you to our listeners for tuning in to A.I.S. Insights — powered by Living Knowledge. Join us next time as we continue exploring the intersection of business, technology, and human behavior.
Expert: Thanks, Anna. It's great to be here. This study really shifts how we think about online risk, misinformation, and digital security.
Host: So, Alex, to kick things off, what is this study trying to address at a high level?
Expert: Well, at its core, the study proposes a socio-technical research framework to understand why people fall for false information online—what researchers call digital gullibility. Instead of just looking at the fake news or phishing emails themselves, the authors look at the human side: how user traits, information contexts, and system designs interact to influence our ability to evaluate information critically, or what's known as epistemic vigilance.
Host: That brings us right to the core problem, doesn't it? Every day we hear about online scams, phishing attacks, and viral misinformation costing businesses and individuals millions of dollars. But how has research traditionally handled this issue?
Expert: That's the key issue. Traditionally, cybersecurity and information systems research focused almost entirely on the outputs—the symptoms, if you will—like tracking phishing campaigns or algorithmically blocking fake news. The study points out that this is like treating a disease by only addressing the fever. It completely misses the root cause: why well-intentioned users accept untrustworthy cues in the first place. Existing economic models often assume people are strictly rational and will stop bad behaviors once they learn from mistakes. But in the digital world, people keep falling for these traps, and we lacked a comprehensive theory to explain why.
Host: That's a huge blind spot. How did the authors approach solving this gap?
Expert: The authors applied a socio-technical systems lens. This means looking at technology, people, data, and organizational processes as an interconnected system. They combined this perspective with two critical behavioral concepts: context collapse and network externalities.
Host: "Context collapse" sounds like a big academic term. Can you explain what that actually means in everyday life?
Expert: Absolutely. On the internet, all kinds of information get flattened into the same screen or feed. An invoice, a news article, a message from a coworker, and an ad from an unknown party all appear in similar formats. That's context collapse. Maintaining separate levels of skepticism for every single source puts a massive cognitive burden on users. So, people use cognitive shortcuts and treat everything with a uniform level of trust, which makes them vulnerable.
Host: That makes total sense. And what about network externalities in this context?
Expert: That relates to costs and accountability. In many online scenarios, when a user falls for a phishing email or spreads false data, the user doesn't personally bear the immediate financial or operational cost—the organization does. Because the individual doesn't feel direct consequences, the natural learning mechanism that would normally stop gullible behavior is broken.
Host: Wow, that really highlights why this keeps happening. What were the key outcomes or framework proposed by the study?
Expert: The study organizes the research agenda into three core gaps and ten specific propositions. First, it examines the information context—how factors like brand trust, message salience, and content value affect our critical thinking. Second, it looks at individual user characteristics, like how demographic traits and trust propensity influence whether someone takes the time to verify information. And third, it looks at realized behavior, analyzing how social costs and direct consequences impact actual decision-making.
Host: Why is this perspective so crucial for business leaders and technology designers?
Expert: For businesses, it's a game-changer. It shows that telling employees to "be more careful" isn't enough. System designers need to build platforms that actively support epistemic vigilance. That means designing user interfaces that lower the effort required to verify information, highlighting risk cues effectively, and even using AI tools to flag suspicious context before a user acts. By understanding the root drivers of digital gullibility, companies can build truly resilient digital environments rather than constantly playing catch-up with cyber threats.
Host: It really sounds like a necessary paradigm shift for enterprise security and product design. Alex, thank you so much for sharing these insights today.
Expert: My pleasure, Anna.
Host: And thank you to our listeners for tuning in to A.I.S. Insights — powered by Living Knowledge. Join us next time as we continue exploring the intersection of business, technology, and human behavior.