CAIN 2025
Sun 27 - Mon 28 April 2025 Ottawa, Ontario, Canada
co-located with ICSE 2025
Mon 28 Apr 2025 11:35 - 11:50 at 208 - Trustworthy AI systems Chair(s): Tim Menzies

Machine learning (ML) is about to revolutionize information systems, with AI-enabled technologies emerging across different sectors. Yet, companies often struggle to bring ML models beyond the experimental stage. Many challenges remain in developing ML components for large scale IT-systems and integrating them into production systems.

This article presents a case study and its findings at a large Danish bank, where a previously unused ML model was successfully integrated into a mission critical IT system. A key factor in this success was the use of explainable AI, which increased the confidence of human experts in the ML models and enabled them to validate and retrain ML models in production, even though they were not software developers.

Our findings are backed by a structured evaluation and interviews with expert users.

Mon 28 Apr

Displayed time zone: Eastern Time (US & Canada) change

11:00 - 12:30
Trustworthy AI systemsResearch and Experience Papers / Industry Talks at 208
Chair(s): Tim Menzies North Carolina State University
11:00
15m
Talk
ImageBiTe: A Framework for Evaluating Representational Harms in Text-to-Image Models
Research and Experience Papers
Sergio Morales Universitat Oberta de Catalunya, Robert Clarisó Universitat Oberta de Catalunya, Jordi Cabot Luxembourg Institute of Science and Technology
11:15
10m
Talk
Approach Towards Semi-Automated Certification for Low Criticality ML-Enabled Airborne Applications
Research and Experience Papers
Chandrasekar S IIIT Hyderabad, Vyakhya Gupta IIIT Hyderabad, Prakhar Jain IIIT Hyderabad, Karthik Vaidhyanathan IIIT Hyderabad
11:25
10m
Talk
From Hazard Identification to Control Design: Proactive and AI-Supported Safety Engineering for ML-powered Systems
Research and Experience Papers
Yining Hong Carnegie Mellon University, Christopher Timperley , Christian Kästner Carnegie Mellon University
11:35
15m
Talk
Bringing Machine Learning Models Beyond the Experimental Stage with Explainable AI
Research and Experience Papers
Niels With Mikkelsen Jyske Bank, Lasse Pedersen Jyske Bank, Mansoor Hussain Jyske Bank, Victor Foged Deloitte, Ekkart Kindler Technical University of Denmark
11:50
12m
Talk
Is Generated Images Suitable for Weakness Detection?
Industry Talks
Haruki Yokoyama Fujitsu Limited, Fuyuki Ishikawa National Institute of Informatics
12:02
12m
Talk
Challenges in AI Projects for Machinery and Plant Engineering
Industry Talks
Richard Nordsiek XITASO GmbH IT & Software Solutions, Jan-Philipp Steghöfer XITASO GmbH IT & Software Solutions, Manish Bhandari XITASO GmbH IT and Software Solutions
12:14
16m
Other
Discussion
Research and Experience Papers

:
:
:
: