CAIN 2024
Sun 14 - Mon 15 April 2024 Lisbon, Portugal
co-located with ICSE 2024
Mon 15 Apr 2024 16:20 - 16:35 at Pequeno Auditório - System Qualities Chair(s): Andrei Paleyes

In the ever-expanding landscape of Artificial Intelligence (AI), where innovation thrives and new products and services are continuously being delivered, ensuring that AI systems are designed and developed responsibly throughout their entire lifecycle is crucial. To this end, several AI ethics principles and guidelines have been issued to which AI systems should conform. Nevertheless, relying solely on high-level AI ethics principles is far from sufficient to ensure the responsible engineering of AI systems. In this field, AI professionals often navigate by sight. Indeed, while recommendations promoting Trustworthy AI (TAI) exist, these are often high-level statements that are difficult to translate into concrete implementation strategies. Currently, there is a significant gap between high-level AI ethics principles and low-level concrete practices for AI professionals. To address this challenge, our work presents an experience report where we develop a novel holistic framework for Trustworthy AI - designed to bridge the gap between theory and practice - and report insights from its application in an industrial study case. The framework is built on the result of a systematic review of the state of the practice and a survey and think-aloud interviews with 34 AI practitioners. The framework, unlike most of those already in the literature, is designed to provide actionable guidelines and tools to support different types of stakeholders throughout the entire Software Development Life Cycle (SDLC). Our goal is to empower AI professionals to confidently navigate the ethical dimensions of TAI through practical insights, ensuring that the vast potential of AI is exploited responsibly for the benefit of society as a whole.

Mon 15 Apr

Displayed time zone: Lisbon change

16:00 - 18:00
System QualitiesResearch and Experience Papers / Industry Talks at Pequeno Auditório
Chair(s): Andrei Paleyes Department of Computer Science and Technology, Univesity of Cambridge
16:00
10m
Talk
Modeling Resilience of Collaborative AI Systems
Research and Experience Papers
Diaeddin Rimawi Free University of Bozen-Bolzano, Antonio Liotta Free University of Bozen-Bolzano, Marco Todescato Fraunhofer Italia, Barbara Russo
16:10
10m
Talk
Seven Failure Points When Engineering a Retrieval Augmented Generation System
Research and Experience Papers
Scott Barnett Applied Artificial Intelligence Institute, Deakin University, Stefanus Kurniawan Deakin University, Srikanth Thudumu Deakin University, Zach Brannelly Deakin University, Mohamed Abdelrazek Deakin University, Australia
16:20
15m
Talk
POLARIS: A framework to guide the development of Trustworthy AI systems
Research and Experience Papers
Maria Teresa Baldassarre Department of Computer Science, University of Bari , Domenico Gigante SER&Practices and University of Bari, Marcos Kalinowski Pontifical Catholic University of Rio de Janeiro (PUC-Rio), Azzurra Ragone University of Bari
16:35
15m
Talk
Worst-Case Convergence Time of ML Algorithms via Extreme Value Theory
Research and Experience Papers
A: Saeid Tizpaz-Niari University of Texas at El Paso, A: Sriram Sankaranarayanan University of Colorado, Boulder
16:50
15m
Talk
Is Your Anomaly Detector Ready for Change? Adapting AIOps Solutions to the Real World
Research and Experience Papers
Lorena Poenaru-Olaru TU Delft, Natalia Karpova TU Delft, Luís Cruz Delft University of Technology, Jan S. Rellermeyer Leibniz University Hannover, Arie van Deursen Delft University of Technology
17:05
15m
Talk
Novel Contract-based Runtime Explainability Framework for End-to-End Ensemble Machine Learning Serving
Research and Experience Papers
Minh-Tri Nguyen Aalto University, Hong-Linh Truong Aalto University, Tram Truong-Huu Singapore Institute of Technology
17:20
10m
Industry talk
Trustworthy AI: Industry-Guided Tooling of the Methods
Industry Talks
Zakaria Chihani CEA, LIST, France
17:30
15m
Live Q&A
System Qualities: Q&A Session
Research and Experience Papers

17:45
15m
Day closing
Closing
Research and Experience Papers
Jan Bosch Chalmers University of Technology