AI-Augmented Metamorphic Testing for Comprehensive Validation of Autonomous Vehicles
This program is tentative and subject to change.
Self-driving cars have the potential to revolutionize transportation, but ensuring their safety remains a significant challenge. These systems must navigate a variety of unexpected scenarios on the road, and their complexity poses substantial difficulties for thorough testing. Conventional testing methodologies face critical limitations, including the oracle problem—determining whether the system’s behavior is correct—and the inability to exhaustively recreate a range of situations a self-driving car may encounter. While Metamorphic Testing (MT) offers a partial solution to these challenges, its application is often limited by simplistic modifications to test scenarios. In this position paper, we propose enhancing MT by integrating AI-driven image generation tools, such as Stable Diffusion, to improve testing methodologies. These tools can generate nuanced variations of driving scenarios within the operational design domain (ODD)—for example, altering weather conditions, modifying environmental elements, or adjusting lane markings—while preserving the critical features necessary for system evaluation. This approach enables reproducible testing, efficient reuse of test criteria, and comprehensive evaluation of a self-driving system’s performance across diverse scenarios, thereby addressing key gaps in current testing practices.
This program is tentative and subject to change.
Tue 29 AprDisplayed time zone: Eastern Time (US & Canada) change
11:00 - 12:30 | |||
11:00 18mTalk | AI-Augmented Metamorphic Testing for Comprehensive Validation of Autonomous Vehicles SE4ADS Yueteng Zhang University of Ottawa, Burak Kantarci University of Ottawa, Umair Siddique reasonX Labs Inc. | ||
11:18 18mTalk | Conflict-based Scenario Generation for Autonomous Driving System Validation SE4ADS Hua Qi Kyushu University, Japan, Siyuan Chen The University of Tokyo, Fuyuan Zhang Kyushu University, Tomoyuki TSUCHIYA TIER IV, Michio HAYASHI TIER IV North America, Manabu OKADA TIER IV, Lei Ma The University of Tokyo & University of Alberta, Jianjun Zhao Kyushu University | ||
11:36 18mTalk | Deep Driving Workshop for Education and Training of Behaviour-Based End-to-End Learning Autonomous Driving Systems SE4ADS Mohamed Benchat Institut für Software and Systems Engineering, TU Clausthal, Germany, Iqra Aslam Institut für Software and Systems Engineering, TU Clausthal, Germany, Meng Zhang Institut für Software and Systems Engineering, TU Clausthal, Germany, Nour Habib Institut für Software and Systems Engineering, TU Clausthal, Germany, Abhishek Buragohain Institut für Software and Systems Engineering, TU Clausthal, Germany, Vaibhav Tiwari Institut für Software and Systems Engineering, TU Clausthal, Germany, Andreas Rausch Clausthal University of Technology | ||
11:54 18mTalk | Evaluating the Robustness of Uncertainty Quantification-Based Misbehavior Predictors for Autonomous Driving Systems: A Case Study SE4ADS Xiongfei Wu Kyushu University, Qiang Hu The University of Tokyo, Tomoyuki TSUCHIYA TIER IV, Michio HAYASHI TIER IV North America, Manabu OKADA TIER IV, Lei Ma The University of Tokyo & University of Alberta, Jianjun Zhao Kyushu University | ||
12:12 18mTalk | Moral Testing of Autonomous Driving Systems SE4ADS Wenbing Tang Nanyang Technological University, Mingfei Cheng Singapore Management University, Yuan Zhou Zhejiang Sci-Tech University, Yang Liu Nanyang Technological University |