Key question
AI-processed · Author-approved
How can artificial intelligence restore missing case identifiers in business process logs to improve analysis accuracy?
Loads Spotify's player; Spotify may set cookies. This device remembers your choice.
Key findings
- The hybrid method accurately restores missing case identifiers across diverse business process contexts without altering already correct data.
- Incorporating domain rules as an ex-ante and ex-post check significantly improves performance as a fallback mechanism, particularly in low-data and high-error scenarios.
- The Transformer-based approach outperforms established machine learning benchmarks when applied to large datasets with low-to-moderate levels of missing case identifiers.
- Expert evaluations confirm the method's high perceived usefulness and practicality for automating data preparation tasks in corporate process mining workflows.
What it means for you
CIO / IT Executive
Authorize a pilot project to integrate the HERE method into the enterprise process mining data pipeline, focusing on event logs suffering from missing case identifiers.
IT Manager
Audit your team's current event logs to identify datasets with elusive cases lacking identifiers, and schedule a workshop to define specific domain-expert rules for ex-ante and ex-post fallback checks.
Business Strategist
Evaluate the financial and operational impact of inaccurate process insights caused by current data quality issues, and align the adoption of Transformer-driven data repair with corporate process improvement goals.
Researcher
Investigate the scalability of combining Transformer-based event log enhancement with domain-expert rule fallback mechanisms in low-data and high-error industrial environments.
Policymaker
Draft guidelines for data governance frameworks in automated process mining that encourage the adoption of human-in-the-loop generative AI methodologies to ensure data integrity and auditability.
Summary
This study develops the Hybrid Elusive Case Repair Method (HERE), which merges generative artificial intelligence via the Transformer architecture with domain-expert rules in a human-in-the-loop framework. Following Design Science Research, the method refines process event logs where case identifiers are missing and evaluates performance using synthetic and real-world event logs alongside 21 expert interviews.
Problem
Process mining initiatives often suffer from poor data quality when event logs contain elusive cases lacking case identifiers needed to connect events to process instances. Traditional repair techniques either regroup all events indiscriminately, require excessive manual effort, or depend on extensive supplementary datasets, leading to inaccurate business insights.
Transcript
Expert: Thanks, Anna. It is great to be here. This study addresses a challenge that anyone working with enterprise data will recognize immediately: the classic problem of garbage-in, garbage-out.
Host: Let us start right there with the big problem. Companies invest millions in process mining to uncover bottlenecks, reduce costs, and streamline operations. But what goes wrong with the underlying data?
Expert: Well, to analyze any workflow—whether it is an order-to-cash cycle, an insurance claim, or patient billing—process mining software requires three core pieces of information: what happened, when it happened, and which specific process instance it belongs to. That third piece is known as the Case ID. The study focuses on what experts call the "elusive case" imperfection pattern. That is when certain events simply lack a Case ID. Imagine receiving thousands of invoices, shipping updates, and payments, but some of those updates have no account or order number attached.
Host: That sounds like a nightmare for analysts. What happens if you try to analyze a process with missing Case IDs?
Expert: It either breaks the analysis completely or produces wildly misleading conclusions. And fixing it until now has been very painful. Manual repair is virtually impossible given the massive volume of enterprise data. On the other hand, traditional automated algorithms often take a blunt-force approach: they wipe out all the existing groupings and attempt to regroup every single event from scratch. That means they risk corrupting the eighty or ninety percent of your data that was already completely accurate.
Host: That brings us directly to the methodology proposed in this study. The authors introduce an artifact called HERE, which stands for the Hybrid Elusive Case REpair Method. How does it work?
Expert: The researchers took an ingenious approach by framing this as a sequence-to-sequence translation problem, similar to how language models translate English into French. They adapted the Transformer architecture—the same underlying foundation behind modern generative AI—to predict the correct Case ID for missing events by analyzing the surrounding activities, timestamps, and resource data. But what makes this study special is that it is a hybrid, human-in-the-loop solution.
Host: Where do the humans come in?
Expert: Because pure generative AI can sometimes hallucinate or produce uncertain outputs, the authors built declarative rule checks around the Transformer. Before the AI makes a prediction, an ex-ante rule check applies known business constraints provided by domain experts—such as which activity strictly starts a process. Then, after the Transformer makes its predictions, an ex-post check audits the sequence to ensure it did not violate fundamental business logic. If an assignment looks wrong according to established business rules, it gets reset. Most importantly, it preserves all the Case IDs that were already correct in the original log.
Host: That provides a reliable safety net. When the authors tested this prototype on both synthetic and real-world event logs, what were the key outcomes?
Expert: The results were very compelling. They tested the method across different datasets, including a real-world hospital billing log containing over four hundred and fifty thousand events, with simulated missing data ranging from ten percent all the way up to ninety percent. First, the study showed that the Transformer model significantly outperforms established benchmarks like LSTMs and frequency baselines, especially on large datasets with low-to-moderate levels of missing data. Second, the rule-checking mechanism proved to be an invaluable fallback. In scenarios where data volume was low or the missingness was severe, the domain rules stepped in to maintain high consistency.
Host: And they also gathered qualitative feedback from industry and research experts, right?
Expert: Exactly. Across twenty-one in-depth interviews, practitioners confirmed high perceived usefulness. Experts noted that while the underlying math is sophisticated, the practical capability to fix broken logs without manual intervention is a game-changer. The study also allows users to configure a confidence threshold, giving managers control over the trade-off between strict accuracy and data completeness.
Host: Looking at the bottom line, why does this study matter so much for business leaders and enterprise technology teams?
Expert: Recent industry research shows that data preparation currently consumes sixty to eighty percent of the total time and budget in process mining initiatives. That is an enormous drain on productivity. This study demonstrates that generative AI, when guided by business rules, can automate one of the trickiest parts of that cleanup. Instead of launching expensive, multi-year IT overhauls to fix legacy systems that log data poorly, companies can deploy an intelligent repair layer to restore their historical data and unlock immediate insights.
Host: It essentially salvages valuable historical data that would otherwise sit abandoned in corporate archives.
Expert: Exactly. It turns unusable data into actionable intelligence while keeping human business logic firmly in the driver's seat.
Host: A truly practical roadmap for combining modern AI with human expertise. Alex, thank you so much for breaking down this fascinating study for us.
Expert: My pleasure, Anna.
Host: And thank you to all our listeners for tuning in to A.I.S. Insights — powered by Living Knowledge. Be sure to subscribe, and join us next time as we explore the research shaping the future of business and technology.
Process mining, Event log repair, Generative artificial intelligence, Transformers, Data quality, Business process management