How Analysts Use AI in High-Stakes Crime Linkage: An Industrial Study
Crime linkage analysis is used in many countries to identify series of offences that may have been committed by the same individual. In practice, specialist analysts manually search for behavioural and situational connections across large crime databases, an effort that is time-consuming, cognitively demanding, and can involve repeated exposure to disturbing material. To support this work, an Artificial Intelligence (AI)-enabled decision-support tool was co-developed with a UK law enforcement agency to assist analysts in identifying likely crime linkages.
This paper reports an industrial evaluation of the crime-linkage tool. We conducted a mixed-methods usability study combining direct observation, eye-tracking, mouse-tracking, and surveys to examine how analysts engage with AI predictions and with the model features presented as explanations. Our findings show that analysts used the AI predictions selectively and frequently validated them against behavioural (non-AI) evidence, reflecting partial trust and an ongoing reliance on established analytical practices. We also found that analysts attended to the presented model features and valued their availability, while identifying opportunities to improve how explanations are presented and integrated into the workflow. Overall, our results highlight the need for AI-enabled decision-support tools to better integrate explanations and traditional analytical methods, and demonstrate the importance of in-situ evaluation for engineering usable and trustworthy AI in high-stakes settings.
Thu 9 JulDisplayed time zone: Eastern Time (US & Canada) change
10:30 - 12:30 | Empirical 2Research Papers / Industry Papers / Re-routed Presentations from Past Years / Journal-First Paper at MB 3.445 Chair(s): Peter Rigby Concordia University; Meta | ||
10:30 20mTalk | Does Microservice Adoption Impact the Velocity? A Cohort Study Journal-First Paper Nyyti Saarimäki University of Luxembourg, Mikel Robredo University of Oulu, Valentina Lenarduzzi University of Southern Denmark, Sira Vegas Universidad Politecnica de Madrid, Natalia Juristo Universidad Politecnica de Madrid, Davide Taibi University of Southern Denmark and University of Oulu | ||
10:50 20mTalk | Building Software by Rolling the Dice: A Qualitative Study of Vibe Coding Research Papers Yi-Hung Chou University of California, Irvine, Boyuan Jiang University of California, Irvine, Yiwen Chen Independent, Mingyue Weng Marketing Creative Associate, Victoria Jackson University of Southampton, Thomas Zimmermann University of California, Irvine, James Jones University of California at Irvine Pre-print | ||
11:10 20mTalk | Beyond the Numbers: Evaluating DevOps Adoption in an Enterprise Software Development Organisation Industry Papers | ||
11:30 20mTalk | How Analysts Use AI in High-Stakes Crime Linkage: An Industrial Study Industry Papers Jessica Woodhams University of Birmingham, Amy Burrell University of Birmingham, Wanyin Li University of Reading, Fahim Ahmed Imperial College London, Matthew Tonkin University of Leicester, Jan Lemeire Vrije Universiteit, Arkady Konovalov University of Birmingham, Steven Frisson University of Birmingham, Mark Webb National Crime Agency, Sarah Galambos National Crime Agency, Vesna Nowack Imperial College London, Dalal Alrajeh Imperial College London | ||
11:50 20mTalk | Views on Internal and External Validity in Empirical Software Engineering: 10 Years Later and Beyond Re-routed Presentations from Past Years Alina Mailach Leipzig University, Janet Siegmund Chemnitz University of Technology, Sven Apel Saarland University, Norbert Siegmund Leipzig University | ||
12:10 20mTalk | How Low Can You Go? The Data-Light SE Challenge Research Papers Pre-print | ||