Moral Testing of Autonomous Driving Systems
Autonomous Driving System (ADS) testing plays a crucial role in their development, with the current focus primarily on functional and safety testing. However, evaluating the non-functional morality of ADSs, particularly their decision-making capabilities in unavoidable collision scenarios, is equally important to ensure the systems’ trustworthiness and public acceptance. Unfortunately, testing ADS morality is nearly impossible due to the absence of universal moral principles. To address this challenge, this paper first extracts a set of moral meta-principles derived from existing moral experiments and well-established social science theories, aiming to capture widely recognized and common-sense moral values for ADSs. These meta-principles are then formalized as quantitative moral metamorphic relations, which act as the test oracle. Furthermore, we propose a metamorphic testing framework to systematically identify potential moral issues. Finally, we illustrate the implementation of the framework and present typical violation cases using the VIRES VTD simulator and its ADS.
Tue 29 AprDisplayed time zone: Eastern Time (US & Canada) change
11:00 - 12:30 | |||
11:00 18mTalk | AI-Augmented Metamorphic Testing for Comprehensive Validation of Autonomous Vehicles SE4ADS Yueteng Zhang University of Ottawa, Burak Kantarci University of Ottawa, Umair Siddique reasonX Labs Inc. | ||
11:18 18mTalk | Conflict-based Scenario Generation for Autonomous Driving System Validation SE4ADS Hua Qi Kyushu University, Japan, Siyuan Chen The University of Tokyo, Fuyuan Zhang Kyushu University, Tomoyuki TSUCHIYA TIER IV, Michio HAYASHI TIER IV North America, Manabu OKADA TIER IV, Lei Ma The University of Tokyo & University of Alberta, Jianjun Zhao Kyushu University | ||
11:36 18mTalk | Deep Driving Workshop for Education and Training of Behaviour-Based End-to-End Learning Autonomous Driving Systems SE4ADS Mohamed Benchat Institut für Software and Systems Engineering, TU Clausthal, Germany, Iqra Aslam Institut für Software and Systems Engineering, TU Clausthal, Germany, Meng Zhang Institut für Software and Systems Engineering, TU Clausthal, Germany, Nour Habib Institut für Software and Systems Engineering, TU Clausthal, Germany, Abhishek Buragohain Institut für Software and Systems Engineering, TU Clausthal, Germany, Vaibhav Tiwari Institut für Software and Systems Engineering, TU Clausthal, Germany, Andreas Rausch Clausthal University of Technology | ||
11:54 18mTalk | Evaluating the Robustness of Uncertainty Quantification-Based Misbehavior Predictors for Autonomous Driving Systems: A Case Study SE4ADS Xiongfei Wu Kyushu University, Qiang Hu The University of Tokyo, Tomoyuki TSUCHIYA TIER IV, Michio HAYASHI TIER IV North America, Manabu OKADA TIER IV, Lei Ma The University of Tokyo & University of Alberta, Jianjun Zhao Kyushu University | ||
12:12 18mTalk | Moral Testing of Autonomous Driving Systems SE4ADS Wenbing Tang Nanyang Technological University, Mingfei Cheng Singapore Management University, Yuan Zhou Zhejiang Sci-Tech University, Yang Liu Nanyang Technological University |