Data-Dependent Goal modeling for ML-Enabled Law Enforcement Systems
Investigating serious crimes is inherently complex and resource-constrained. Law enforcement agencies (LEAs) grapple with overwhelming volumes of offender and incident data, making effective suspect identification difficult. Although machine learning (ML)-enabled systems have been explored to support LEAs, several have failed in practice. This highlights the need to align system behavior with stakeholder goals early in development, motivating the use of Goal-Oriented Requirements Engineering (GORE).
This paper reports our experience applying the GORE framework KAOS to designing an ML-enabled system for identifying suspects in online child sexual abuse. We describe how KAOS supported early requirements elaboration, including goal refinement, object modeling, agent assignment, and operationalization. A key finding is the central role of data elicitation: data requirements constrain refinement choices and candidate agents while influencing how goals are linked, operationalized, and satisfied. Conversely, goal elaboration and agent assignment shape data quality expectations and collection needs.
Our experience highlights the iterative, bidirectional dependencies between goals, data, and ML performance. We contribute a reference model for integrating GORE with data-driven system development, and identify gaps in KAOS, particularly the need for explicit support for data elicitation and quality management. These insights inform future extensions of KAOS and, more broadly, the application of formal GORE methods to ML-enabled systems for high-stakes societal contexts.
Wed 15 AprDisplayed time zone: Brasilia, Distrito Federal, Brazil change
11:00 - 12:30 | Software Engineering for AI 1Research Track / SE in Society (SEIS) / SE In Practice (SEIP) at Oceania VII Chair(s): Sira Vegas Universidad Politecnica de Madrid | ||
11:00 15mTalk | Fairness Is Not Just Ethical: Performance Trade-Off via Data Correlation Tuning to Mitigate Bias in ML Software Research Track Ying Xiao , Shangwen Wang National University of Defense Technology, Sicen Liu Southern University of Science and Technology, Dingyuan Xue Southern University of Science and Technology, Xian Zhan Southern University of Science and Technology, Yepang Liu Southern University of Science and Technology, Jie M. Zhang King's College London | ||
11:15 15mTalk | TACO: Trust Assessment of Large Language Models in Coding Assistance Tasks Research Track Shihao Weng Nanjing University, Yang Feng Nanjing University, Jincheng Li Nanjing University, Yining Yin Nanjing University, Zhenlun Zhang Nanjing University, Lyuxi Liu University of Virginia, Jia Liu Nanjing University | ||
11:30 15mTalk | Toward Systematic Counterfactual Fairness Evaluation of Large Language Models: The CAFFE Framework Research Track Alessandra Parziale Gran Sasso Science Institute, Gianmario Voria University of Salerno, Valeria Pontillo Gran Sasso Science Institute, Gemma Catolino University of Salerno, Andrea De Lucia University of Salerno, Fabio Palomba University of Salerno | ||
11:45 15mTalk | Attention Pruning: Automated Fairness Repair of Language Models via Surrogate Simulated Annealing Research Track Vishnu Asutosh Dasu Pennsylvania State University, Md Rafi Ur Rashid Pennsylvania State University, Vipul Gupta Pennsylvania State University, Saeid Tizpaz-Niari University of Illinois Chicago, Gang (Gary) Tan Pennsylvania State University | ||
12:00 15mTalk | Building an Open AIBOM Standard in the Wild: An Experience Report on Extending the SPDX SBOM (ISO/IEC 5962:2021) for AI Supply Chains SE In Practice (SEIP) Gopi Krishnan Rajbahadur , Keheliya Gallaba Centre for Software Excellence, Huawei Canada, Elyas Rashno Queen's University, Arthit Suriyawongkul ADAPT Centre, Trinity College Dublin, Karen Bennet IEEE, Kate Stewart Linux Foundation, Ahmed E. Hassan Queen’s University Pre-print | ||
12:15 15mTalk | Data-Dependent Goal modeling for ML-Enabled Law Enforcement Systems SE in Society (SEIS) Dalal Alrajeh Imperial College London, Vesna Nowack Imperial College London, Patrick Benjamin University of Oxford, Katie Thomas University of Bath, William Hobson University of Bath, Carolina Gutierrez Munoz University of Bath, Catherine Hamilton-Giachritsis University of Bath, Juliane Kloess University of Edinburgh, Jessica Woodhams University of Birmingham, Daniel Butler Independent researcher, Mark Law ILASP, Ralph Morton Aston University, Benjamin Costello University of Birmingham, Amy Burrell University of Birmingham, Tim Grant Aston University, Prachiben Shah University of Birmingham, Frances Laureano de Leon University of Birmingham, Mark Lee University of Birmingham | ||