ICSE 2025
Sat 26 April - Sun 4 May 2025 Ottawa, Ontario, Canada
Wed 30 Apr 2025 11:45 - 12:00 at 213 - Autonomy Chair(s): Lionel Briand

Simulation-based testing is widely used to assess the reliability of Autonomous Driving Systems (ADS), but its effectiveness is limited by the operational design domain (ODD) conditions available in such simulators. To address this limitation, in this work, we explore the integration of generative artificial intelligence techniques with physics-based simulators to enhance ADS system-level testing. Our study evaluates the effectiveness and computational overhead of three generative strategies based on diffusion models, namely instruction-editing, inpainting, and inpainting with refinement. Specifically, we assess these techniques’ capabilities to produce augmented simulator-generated images of driving scenarios representing new ODDs. We employ a novel automated detector for invalid inputs based on semantic segmentation to ensure semantic preservation and realism of the neural generated images. We then perform system-level testing to evaluate the ADS’s generalization ability to newly synthesized ODDs. Our findings show that diffusion models help increase the ODD coverage for system-level testing of ADS. Our automated semantic validator achieved a percentage of false positives as low as 3%, retaining the correctness and quality of the generated images for testing. Our approach successfully identified new ADS system failures before real-world testing.

Wed 30 Apr

Displayed time zone: Eastern Time (US & Canada) change

11:00 - 12:30
AutonomyResearch Track at 213
Chair(s): Lionel Briand University of Ottawa, Canada; Lero centre, University of Limerick, Ireland
11:00
15m
Talk
A Differential Testing Framework to Identify Critical AV Failures Leveraging Arbitrary InputsArtifact-FunctionalArtifact-Available
Research Track
Trey Woodlief University of Virginia, Carl Hildebrandt University of Virginia, Sebastian Elbaum University of Virginia
11:15
15m
Talk
Automating a Complete Software Test Process Using LLMs: An Automotive Case Study
Research Track
Shuai Wang , Yinan Yu Chalmers University of Technology, Robert Feldt Chalmers University of Technology, Sweden, Dhasarathy Parthasarathy Volvo Group
Pre-print
11:30
15m
Talk
LLM-Agents Driven Automated Simulation Testing and Analysis of small Uncrewed Aerial Systems
Research Track
Venkata Sai Aswath Duvvuru Saint Louis University, Bohan Zhang Saint Louis University, Missouri, Michael Vierhauser University of Innsbruck, Ankit Agrawal Saint Louis University, Missouri
Pre-print
11:45
15m
Talk
Efficient Domain Augmentation for Autonomous Driving Testing Using Diffusion ModelsArtifact-FunctionalArtifact-AvailableArtifact-Reusable
Research Track
Luciano Baresi Politecnico di Milano, Davide Yi Xian Hu Politecnico di Milano, Andrea Stocco Technical University of Munich, fortiss, Paolo Tonella USI Lugano
Pre-print
12:00
15m
Talk
GARL: Genetic Algorithm-Augmented Reinforcement Learning to Detect Violations in Marker-Based Autonomous Landing Systems
Research Track
Linfeng Liang Macquarie University, Yao Deng Macquarie University, Kye Morton Skyy Network, Valtteri Kallinen Skyy Network, Alice James Macquarie University, Avishkar Seth Macquarie University, Endrowednes Kuantama Macquarie University, Subhas Mukhopadhyay Macquarie University, Richard Han Macquarie University, Xi Zheng Macquarie University
12:15
15m
Talk
Decictor: Towards Evaluating the Robustness of Decision-Making in Autonomous Driving SystemsArtifact-FunctionalArtifact-AvailableArtifact-Reusable
Research Track
Mingfei Cheng Singapore Management University, Xiaofei Xie Singapore Management University, Yuan Zhou Zhejiang Sci-Tech University, Junjie Wang Tianjin University, Guozhu Meng Institute of Information Engineering, Chinese Academy of Sciences, Kairui Yang DAMO Academy, Alibaba Group, China
Hide past events