Enhancing Euro NCAP Standards with Metamorphic Testing for Verification of Advanced Driver-Assistance Systems
Advanced Driver-Assistance Systems (ADASs) have become increasingly popular. To ensure their safety, simulation testing is essential. In this research, we conducted a case study to investigate the fault-detection effectiveness of existing ADAS testing standards: We tested the Lane Keeping Assist System (LKAS), which is a prebuilt ADAS module of MATLAB and Simulink. We first tested LKAS using the European New Car Assessment Programme (Euro NCAP) that contains 40 prebuilt driving scenarios in MATLAB. Our results show that none of the 40 scenarios detected any failure. We then continued the tests by applying a simple metamorphic relation “equivalence under geometric transformation,” and a previously unknown real-life bug in LKAS was immediately revealed. We reported this finding to the MATLAB team in the US, who then confirmed the bug and corrected the LKAS code. This research provides a strong case for incorporating metamorphic testing into ADAS testing standards and protocols.
Wed 2 JunDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
10:20 - 11:00 | Session 1: Autonomous Driving and SimulationMET 2021 at MET Room Chair(s): Pak-Lok Poon School of Engineering & Technology, Central Queensland University, Australia | ||
10:20 20mShort-paper | BMT: Behavior Driven Development-based MetamorphicTesting for Autonomous Driving Models MET 2021 Yao Deng Macquarie University, Guannan Lou Macquarie University, Xi Zheng Macquarie University, Tianyi Zhang Harvard University, USA, Miryung Kim University of California at Los Angeles, USA, Huai Liu Swinburne University of Technology, Chen Wang CSIRO DATA61, Tsong Yueh Chen Swinburne University of Technology Media Attached | ||
10:40 20mShort-paper | Enhancing Euro NCAP Standards with Metamorphic Testing for Verification of Advanced Driver-Assistance Systems MET 2021 Muhammad Iqbal University of Wollongong, Jia Cheng Han University of Wollongong, Zhi Quan (George) Zhou University of Wollongong, Australia, Dave Towey University of Nottingham Ningbo China Media Attached | ||
Go directly to this room on Clowdr