ICSE 2024
Fri 12 - Sun 21 April 2024 Lisbon, Portugal

2nd International Workshop on Responsible AI Engineering (RAIE’24)

Theme & Goals

The recent release of ChatGPT, Bard, and other large language model (LLM)-based chatbots has drawn huge global attention. The black box nature and the rapid advancements in AI have sparked significant concerns about responsible AI. It is crucial to ensure that the AI systems are developed and used responsibly throughout their entire lifecycle and trusted by humans who are expected to use them and rely on them.

A number of AI ethics principles have been published recently, which AI systems should conform to. Some consensus around AI ethics principles has begun to emerge. A principle-based approach allows technology-neutral, future-proof and context-specific interpretations and operationalisation. However, high-level AI ethics principles are far from ensuring trustworthy and responsible AI systems. There is a significant gap between high-level AI ethics principles and low-level concrete engineering solutions. Without further concrete methods and tools, practitioners are left with nothing much beyond truisms. For example, it is a very challenging and complex task to operationalise the human-centered value principle regarding how it can be designed for, implemented and monitored throughout the entire lifecycle of AI systems. Trustworthy and responsible AI challenges can occur at any stage of the AI system development lifecycle, crosscutting AI components, non-AI components, and data components of systems. New and improved software engineering approaches are required to ensure that the AI systems developed are trustworthy throughout the entire lifecycle and trusted by those who use and rely on them. To ensure the enforcement of responsible AI requirements, the requirements need to be measurable, verifiable, and monitorable. Also, we need assessment mechanisms and engineering tools to systematically support the implementation of responsible AI requirements across all phases of AI application development, maintenance, and operations.

Achieving responsible AI engineering (i.e., building adequate software engineering tools to support responsible engineering of AI systems) requires a good understanding of human expectations and the utilisation context of AI systems. Hence, the aim of this workshop is to bring together researchers and practitioners not only in software engineering and AI, but also social scientists and regulatory bodies to build up a community that will target the AI engineering challenges that practitioners are facing in developing AI systems responsibly. In this workshop, we are looking for cutting-edge software/AI engineering methods, techniques, tools and real-world case studies that can help operationalise responsible AI.

Plenary
You're viewing the program in a time zone which is different from your device's time zone change time zone

Tue 16 Apr

Displayed time zone: Lisbon change

09:00 - 10:30
Session 1RAIE at Glicínia Quartin
Chair(s): Maximilian Poretschkin Fraunhofer IAIS & University of Bonn
09:00
10m
Day opening
Opening
RAIE
Qinghua Lu Data61, CSIRO
09:10
30m
Keynote
Machine Learning Software Engineering Patterns and Their Engineering Approaches
RAIE
Hironori Washizaki Waseda University
09:40
10m
Long-paper
Towards Trustworthy AI Engineering - A Case Study on integrating an AI audit catalog into MLOps processes
RAIE
09:50
10m
Long-paper
Responsible AI Engineering: The Case of an Inclusive Image Annotation Team in a Global Technology Company
RAIE
Bernhard Schenkenfelder Software Competence Center Hagenberg GmbH, Ulrich Brandstätter , Lukas Fischer Software Competence Center Hagenberg GmbH, Rudolf Ramler Software Competence Center Hagenberg (SCCH), Dominik Laister , Martin Hartl , Markus Wurm
10:00
10m
Short-paper
Towards Explainability as a Functional Requirement: A Vision to Integrate the Legal, End-User, and ML Engineer Perspectives
RAIE
Umm e Habiba University of Stuttgart, Germany, Justus Bogner Vrije Universiteit Amsterdam, Stefan Wagner Technical University of Munich
10:10
10m
Long-paper
PARMA: a Platform Architecture to enable Automated, Reproducible, and Multi-party Assessments of AI Trustworthiness
RAIE
10:20
10m
Long-paper
Code Ownership in Open-Source AI Software Security
RAIE
Jiawen wen , Dong Yuan , Lei Ma The University of Tokyo & University of Alberta, Huaming Chen The University of Sydney
10:30 - 11:00
Coffee BreakCatering at Open Space
10:30
30m
Coffee break
Break
Catering

11:00 - 12:30
Session 2RAIE at Glicínia Quartin
Chair(s): Foutse Khomh École Polytechnique de Montréal
11:00
30m
Keynote
Is Generative AI Fit for Your Use Case?
RAIE
Ipek Ozkaya Carnegie Mellon University
11:30
20m
Other
Book Lounge - Responsible AI: Best Practices for Creating Trustworthy AI Systems
RAIE

Link to publication
11:50
10m
Long-paper
A Vision for Operationalising Diversity and Inclusion in AI
RAIE
Muneera Bano CSIRO's Data61, Didar Zowghi CSIRO's Data61 - University of Technology Sydney - University of New South Wales, Vincenzo Gervasi University of Pisa
12:00
10m
Long-paper
Software Systems Compliance with the AI Act
RAIE
12:10
10m
Short-paper
Do Generative AI Tools Ensure Green Code? An Investigative Study
RAIE
Samarth Sikand Accenture Labs, Rohit Mehra Accenture Labs, Vibhu Saujanya Sharma Accenture Labs, Vikrant Kaulgud Accenture Labs, India, Sanjay Podder Accenture, Adam P. Burden Accenture
12:20
10m
Day closing
Closing
RAIE
Qinghua Lu Data61, CSIRO
12:30 - 14:00
12:30
90m
Lunch
Lunch
Catering

Call for Papers

Topics of Interest

Topics of interests include, but are not limited to:

  • Requirement engineering for responsible AI
  • Software architecture and design of responsible AI systems
  • Verification and validation for responsible AI systems
  • DevOps, MLOps, MLSecOps, LLMOps for responsible AI systems
  • Development processes for responsible AI systems
  • Responsible AI governance, assessment tools/techniques
  • Reproducibility and traceability of AI systems
  • Trust and trustworthiness of AI systems
  • Human aspect of responsible AI engineering
  • Responsible AI engineering for next-generation foundation model based AI systems (e.g., LLM-based)
  • Regulatory and policy implications
  • Education and training in responsible AI

The workshop will be highly interactive, including invited keynotes/talks, paper presentations for different topics in the area of responsible AI engineering.

Two types of contributions will be considered:

  • A research or experience full paper with 8 pages max, including references. Papers describing the challenges, starting results, vision papers, or the experience papers from or in cooperation with the practitioners are encouraged.
  • A short research or experience paper with 4 pages max, including references. The same topics as for long papers.

Submission Guidelines

All authors should use the official “ACM Primary Article Template”, as can be obtained from the ACM Proceedings Template page. LaTeX users should use the sigconf option and the review (to produce line numbers for easy reference by the reviewers) option. To that end, the following LaTeX code can be placed at the start of the LaTeX document:

\documentclass[sigconf,review]{acmart}

\acmConference[ICSE 2024]{46th International Conference on Software Engineering}{April 2024}{Lisbon, Portugal}

  • All submissions must be in English and in PDF format. Papers must not exceed the specified page limits. It is NOT possible to pay for extra pages.
  • All submitted papers will be reviewed on the basis of technical quality, relevance, significance, and clarity by the program committee. Please note, RAIE24 will employ a single-anonymous review process, i.e., in the submission the authors should be specified.
  • Other more detailed submission policies and guidelines for RAIE’24 are in line with the ICSE Research track Submission Process. Please note all papers must follow the ACM formatting instructions.

The official publication date of the workshop proceedings is the date the proceedings are made available in the ACM Library. This date may be up to two weeks prior to the first day of ICSE 2024. The official publication date affects the deadline for any patent filings related to published work.

Questions? Use the RAIE contact form.