CAIN 2023
Mon 15 - Sat 20 May 2023 Melbourne, Australia
co-located with ICSE 2023
Tue 16 May 2023 19:10 - 19:30 at Virtual - Zoom for CAIN - Trust Chair(s): Zhenchang Xing

Trustworthy and robust deployment of AI applications requires adherence to a range of AI engineering best practices. But, while professionals already have access to frameworks for deploying AI, case studies and developer surveys have found that many deployments do not follow best practices.

We hypothesize that the adoption of AI deployment best practices can be improved by finding less complex framework designs that combine easy of use with built-in support for best practices. To investigate this hypothesis, we applied a design science approach to develop a new framework and evaluate its ease of use and best practice support.

The initial design focusses on the domain of natural language processing (NLP), but with generalisation in mind. To assess applicability and generalisability, we conducted interviews with ten practitioners. We also assessed best practice coverage.

We found that our framework helps implement 33 best practices through an accessible interface. These target the transition from prototype to production phase in the AI development lifecycle. Feedback from professional data scientists and software engineers showed that ease of use and functionality are equally important in deciding to adopt deployment technologies, and the proposed framework was rated positively in both dimensions.

Tue 16 May

Displayed time zone: Hobart change

18:30 - 20:00
TrustPapers at Virtual - Zoom for CAIN
Chair(s): Zhenchang Xing CSIRO’s Data61; Australian National University

Click here to Join us over zoom

Click here to watch the session recording on YouTube

18:30
20m
Long-paper
Towards Concrete and Connected AI Risk Assessment (C2AIRA): A Systematic Mapping Study
Papers
Boming Xia CSIRO's Data61 & University of New South Wales, Qinghua Lu CSIRO’s Data61, Harsha Perera CSIRO's Data61 & University of New South Wales, Liming Zhu The University of New South Wales, Zhenchang Xing , Yue Liu CSIRO's Data61 & University of New South Wales, Jon Whittle CSIRO's Data61 and Monash University
Pre-print
18:50
20m
Long-paper
Defining Quality Requirements for a Trustworthy AI Wildflower Monitoring Platform
Papers
Petra Heck Fontys University of Applied Sciences, Gerard Schouten Fontys University of Applied Sciences
Pre-print
19:10
20m
Long-paper
Trustworthy and Robust AI Deployment by Design: A framework to inject best practice support into AI deployment pipelinesDistinguished paper Award Candidate
Papers
Andras Schmelczer Leiden University, Joost Visser Leiden University
Pre-print
19:30
15m
Short-paper
Towards Code Generation from BDD Test Case Specifications: A vision
Papers
Leon Chemnitz TU Darmstadt, David Reichenbach TU Darmstadt, Germany, Hani Aldebes TU Darmstadt, Mariam Naveed TU Darmstadt, Krishna Narasimhan TU Darmstadt, Mira Mezini TU Darmstadt
Pre-print