AIS SIGED International Conference on Information Systems Education and Research (SIGED) (2025) AI Processed Human Approved
STORYTELLING IS NOT JUST FOR CHILDREN:USING AN AI CHATBOT TO ENGAGE UNIVERSITY STUDENTS
This paper investigates how scenario-based learning using AI-powered storytelling chatbots can engage university students in learning social engineering concepts. Utilizing a design thinking methodology with co-creation, an interactive chatbot powered by GPT-4 Turbo was developed to simulate real-world cybersecurity scenarios. The study evaluates the chatbot's effectiveness in delivering active learning experiences and providing dynamic feedback to students.
Problem
Traditional instruction methods in Information Systems often struggle to effectively engage students or illustrate the subtle tactics used in social engineering attacks. Although AI-driven interactive storytelling holds great potential for experiential education, research into designing AI chatbots as role-playing storytellers remains in its infancy.
Outcome
- The study demonstrated that co-designing AI chatbot prompts with students created effective 'teachable moments' for understanding social engineering tactics and data governance.
- Analysis of student interactions revealed diverse engagement approaches, ranging from friendly small talk to strategic IT troubleshooting and phishing tactics.
- Key strategies were established for integrating a storytelling culture in higher education, including establishing a shared language, providing appropriate digital resources, and fostering collaborative environments.
- Essential ethical guidelines were identified, emphasizing the necessity of robust data privacy, algorithmic bias mitigation, and content boundaries in educational AI applications.
- Analysis of student interactions revealed diverse engagement approaches, ranging from friendly small talk to strategic IT troubleshooting and phishing tactics.
- Key strategies were established for integrating a storytelling culture in higher education, including establishing a shared language, providing appropriate digital resources, and fostering collaborative environments.
- Essential ethical guidelines were identified, emphasizing the necessity of robust data privacy, algorithmic bias mitigation, and content boundaries in educational AI applications.
What it means for you
- CIO / IT Executive: On Monday morning, initiate a departmental meeting to discuss the potential integration of AI-powered scenario-based learning tools, like the one described in the research, to enhance student engagement in cybersecurity concepts and explore pilot program feasibility.
- IT Manager: On Monday morning, schedule a brainstorming session with your team to identify specific social engineering concepts within your curriculum that could be effectively simulated using an interactive AI chatbot and begin researching available AI chatbot platforms or development frameworks.
- Business Strategist: On Monday morning, analyze how the described AI chatbot's engagement model, which fosters 'teachable moments' through interactive storytelling, could be adapted to train employees on emerging cybersecurity threats or compliance protocols, identifying potential ROI.
- Researcher: On Monday morning, review the ethical guidelines identified in the research (data privacy, bias mitigation, content boundaries) and begin designing a framework for evaluating the ethical implications of deploying AI-driven educational tools in your next study.
- Policymaker: On Monday morning, draft a preliminary proposal for a grant or funding initiative that supports the development and implementation of innovative, AI-enhanced educational technologies in higher education, specifically mentioning the potential for improving cybersecurity education through interactive learning.
Transcript
Host: Welcome to A.I.S. Insights — powered by Living Knowledge. I'm your host, Anna Ivy Summers.
Expert: And I'm Alex Ian Sutherland.
Host: Today we're diving into a fascinating study titled "STORYTELLING IS NOT JUST FOR CHILDREN: USING AN AI CHATBOT TO ENGAGE UNIVERSITY STUDENTS." Alex, this study investigates how interactive AI chatbots can turn complex corporate concepts, like cybersecurity, into engaging role-playing stories. What stood out to you right away?
Expert: What really stands out, Anna, is how the study leverages generative AI to transform passive learning into an active, narrative-driven experience. Instead of just reading textbook definitions, learners actually converse with AI characters in realistic business scenarios.
Host: Let's talk about the real-world problem behind this research. Why do traditional training methods fall short when it comes to subjects like cybersecurity and social engineering?
Expert: Social engineering—where attackers manipulate people into handing over confidential data—relies on subtle psychological tricks, building trust, or creating urgency. Traditional teaching methods like lectures or static slide decks usually fail to convey those nuanced tactics. Employees or students might pass a multiple-choice quiz, but they haven't actually experienced how subtle human manipulation works in real time.
Host: Right, knowing the definition of a phishing attack is totally different from recognizing one when someone is chatting with you casually on the phone. So, how did the study address this gap?
Expert: The study used a design thinking methodology—specifically the Double Diamond framework—to co-design an AI storytelling chatbot alongside students. Powered by GPT-4 Turbo through a platform called Cogniti.ai, the chatbot was customized across two distinct evaluation phases.
Host: I understand the researchers flipped the usual script in the interactive scenarios. How did that work?
Expert: It was a very clever design. In the second evaluation phase, the AI acted as an accounts manager named Peter Sherman at a fictional energy company called NextaWatt. The student was assigned the role of the "bad actor"—the cybercriminal trying to use social engineering to trick Peter into giving away sensitive passwords and IP addresses.
Host: That's a great approach! By having learners try to execute a social engineering attack themselves, they gain a much deeper understanding of how these vulnerabilities are exploited.
Expert: Exactly. And to make it a true learning tool, the AI provided feedback every few interactions. It gave a "rapport barometer" showing how much trust the user had built, along with feedback on data governance risks and whether the user's tactics were working.
Host: What were the key findings when students actually engaged with the chatbot?
Expert: The study identified three distinct conversational approaches used by learners. Some used a friendly, casual tone, engaging in small talk about sports or travel to build rapport. Others took a technical route, focusing on fake IT troubleshooting. A few even tried high-pressure, threatening tactics.
Host: And because the AI responded dynamically, it created immediate "teachable moments" tailored to whichever tactic the student chose.
Expert: Precisely. The study demonstrated that this interactive storytelling approach significantly enhanced active learning and engagement. Crucially, the research also outlined essential ethical guidelines for deploying AI in education, focusing on data privacy, preventing algorithmic bias, and setting strong parameters so the tool remains a safe, controlled environment.
Host: Alex, why does this matter so much for business leaders and corporate training professionals?
Expert: The business implications are huge. Most organizations spend millions on mandatory security awareness training, yet employee compliance and retention remain notoriously low because click-through courses are boring. By using AI-driven narrative chatbots, businesses can deploy adaptive, realistic simulations at scale.
Host: Employees could safely practice spotting fraud, responding to social engineering attempts, or navigating complex compliance scenarios in an engaging, risk-free environment.
Expert: Exactly. It shifts corporate training from a passive check-the-box exercise into active, experiential learning that actually changes behavior and builds a stronger security culture.
Host: That sounds like a major step forward for professional education and enterprise risk management. Thank you, Alex, for walking us through these insights.
Expert: My pleasure, Anna.
Host: And thank you for tuning in to A.I.S. Insights — powered by Living Knowledge. Join us next time as we continue to explore the intersection of technology, business, and learning.
Expert: And I'm Alex Ian Sutherland.
Host: Today we're diving into a fascinating study titled "STORYTELLING IS NOT JUST FOR CHILDREN: USING AN AI CHATBOT TO ENGAGE UNIVERSITY STUDENTS." Alex, this study investigates how interactive AI chatbots can turn complex corporate concepts, like cybersecurity, into engaging role-playing stories. What stood out to you right away?
Expert: What really stands out, Anna, is how the study leverages generative AI to transform passive learning into an active, narrative-driven experience. Instead of just reading textbook definitions, learners actually converse with AI characters in realistic business scenarios.
Host: Let's talk about the real-world problem behind this research. Why do traditional training methods fall short when it comes to subjects like cybersecurity and social engineering?
Expert: Social engineering—where attackers manipulate people into handing over confidential data—relies on subtle psychological tricks, building trust, or creating urgency. Traditional teaching methods like lectures or static slide decks usually fail to convey those nuanced tactics. Employees or students might pass a multiple-choice quiz, but they haven't actually experienced how subtle human manipulation works in real time.
Host: Right, knowing the definition of a phishing attack is totally different from recognizing one when someone is chatting with you casually on the phone. So, how did the study address this gap?
Expert: The study used a design thinking methodology—specifically the Double Diamond framework—to co-design an AI storytelling chatbot alongside students. Powered by GPT-4 Turbo through a platform called Cogniti.ai, the chatbot was customized across two distinct evaluation phases.
Host: I understand the researchers flipped the usual script in the interactive scenarios. How did that work?
Expert: It was a very clever design. In the second evaluation phase, the AI acted as an accounts manager named Peter Sherman at a fictional energy company called NextaWatt. The student was assigned the role of the "bad actor"—the cybercriminal trying to use social engineering to trick Peter into giving away sensitive passwords and IP addresses.
Host: That's a great approach! By having learners try to execute a social engineering attack themselves, they gain a much deeper understanding of how these vulnerabilities are exploited.
Expert: Exactly. And to make it a true learning tool, the AI provided feedback every few interactions. It gave a "rapport barometer" showing how much trust the user had built, along with feedback on data governance risks and whether the user's tactics were working.
Host: What were the key findings when students actually engaged with the chatbot?
Expert: The study identified three distinct conversational approaches used by learners. Some used a friendly, casual tone, engaging in small talk about sports or travel to build rapport. Others took a technical route, focusing on fake IT troubleshooting. A few even tried high-pressure, threatening tactics.
Host: And because the AI responded dynamically, it created immediate "teachable moments" tailored to whichever tactic the student chose.
Expert: Precisely. The study demonstrated that this interactive storytelling approach significantly enhanced active learning and engagement. Crucially, the research also outlined essential ethical guidelines for deploying AI in education, focusing on data privacy, preventing algorithmic bias, and setting strong parameters so the tool remains a safe, controlled environment.
Host: Alex, why does this matter so much for business leaders and corporate training professionals?
Expert: The business implications are huge. Most organizations spend millions on mandatory security awareness training, yet employee compliance and retention remain notoriously low because click-through courses are boring. By using AI-driven narrative chatbots, businesses can deploy adaptive, realistic simulations at scale.
Host: Employees could safely practice spotting fraud, responding to social engineering attempts, or navigating complex compliance scenarios in an engaging, risk-free environment.
Expert: Exactly. It shifts corporate training from a passive check-the-box exercise into active, experiential learning that actually changes behavior and builds a stronger security culture.
Host: That sounds like a major step forward for professional education and enterprise risk management. Thank you, Alex, for walking us through these insights.
Expert: My pleasure, Anna.
Host: And thank you for tuning in to A.I.S. Insights — powered by Living Knowledge. Join us next time as we continue to explore the intersection of technology, business, and learning.