CAIN 2023
Mon 15 - Sat 20 May 2023 Melbourne, Australia
co-located with ICSE 2023
Tue 16 May 2023 18:50 - 19:10 at Virtual - Zoom for CAIN - Trust Chair(s): Zhenchang Xing

For an AI solution to evolve from a trained machine learning model into a production-ready AI system, many more things need to be considered than just the performance of the machine learning model. A production-ready AI system needs to be trustworthy, i.e. of high quality. But how to determine this in practice? For traditional software, ISO25000 and its predecessors have since long time been used to define and measure quality characteristics. Recently, quality models for AI systems, based on ISO25000, have been introduced. This paper applies one such quality model to a real-life case study: a deep learning platform for monitoring wildflowers. The paper presents three realistic scenarios sketching what it means to respectively use, extend and incrementally improve the deep learning platform for wildflower identification and counting. Next, it is shown how the quality model can be used as a structured dictionary to define quality requirements for both data, model and software. Future work remains to extend the quality model with metrics, tools and best practices to aid AI engineering practitioners in implementing trustworthy AI systems.

Tue 16 May

Displayed time zone: Hobart change

18:30 - 20:00
TrustPapers at Virtual - Zoom for CAIN
Chair(s): Zhenchang Xing CSIRO’s Data61; Australian National University

Click here to Join us over zoom

Click here to watch the session recording on YouTube

18:30
20m
Long-paper
Towards Concrete and Connected AI Risk Assessment (C2AIRA): A Systematic Mapping Study
Papers
Boming Xia CSIRO's Data61 & University of New South Wales, Qinghua Lu CSIRO’s Data61, Harsha Perera CSIRO's Data61 & University of New South Wales, Liming Zhu The University of New South Wales, Zhenchang Xing , Yue Liu CSIRO's Data61 & University of New South Wales, Jon Whittle CSIRO's Data61 and Monash University
Pre-print
18:50
20m
Long-paper
Defining Quality Requirements for a Trustworthy AI Wildflower Monitoring Platform
Papers
Petra Heck Fontys University of Applied Sciences, Gerard Schouten Fontys University of Applied Sciences
Pre-print
19:10
20m
Long-paper
Trustworthy and Robust AI Deployment by Design: A framework to inject best practice support into AI deployment pipelinesDistinguished paper Award Candidate
Papers
Andras Schmelczer Leiden University, Joost Visser Leiden University
Pre-print
19:30
15m
Short-paper
Towards Code Generation from BDD Test Case Specifications: A vision
Papers
Leon Chemnitz TU Darmstadt, David Reichenbach TU Darmstadt, Germany, Hani Aldebes TU Darmstadt, Mariam Naveed TU Darmstadt, Krishna Narasimhan TU Darmstadt, Mira Mezini TU Darmstadt
Pre-print