Search-based Selection and Prioritization of Test Scenarios for Autonomous Driving Systems
Violating the safety of autonomous driving systems (ADSs) could lead to fatal accidents. ADSs are complex software-intensive systems, which constantly evolve, i.e., new versions are released one after another. Testing individual ADS is challenging and expensive on its own, and consequently testing multiple versions becomes much more costly. Thus, there is a need to develop test scenario selection and prioritization approaches for testing newer versions of ADSs based on historical test execution data of their previous versions. Motivated by this, we propose a multi-objective search-based approach to select and prioritize test scenarios to test a new version of ADS based on four optimization objectives. We experimented with five commonly used multi-objective search algorithms and used a repository of 60,000 test scenarios. Among all these elected algorithms, IBEA achieved the best performance for solving all the optimization problems of various complexity.
Mon 11 OctDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
12:10 - 13:30 | SSBSE Session 1Research Papers / Challenge at SSBSE ROOM Chair(s): Erik Hemberg Massachusetts Institute of Technology | ||
12:10 30mTalk | Generating Failing Test Suites for Quantum Programs with Search Research Papers Xinyi Wang Nanjing University of Aeronautics and Astronautics, Paolo Arcaini National Institute of Informatics
, Tao Yue Nanjing University of Aeronautics and Astronautics, Shaukat Ali Simula Research Laboratory, Norway Link to publication DOI | ||
12:40 20mTalk | Searching for Multi-Fault Programs in Defects4J Challenge Link to publication Pre-print Media Attached | ||
13:00 30mTalk | Search-based Selection and Prioritization of Test Scenarios for Autonomous Driving Systems Research Papers Chengjie Lu Nanjing University of Aeronautics and Astronautics, Huihui Zhang Weifang University, Tao Yue Nanjing University of Aeronautics and Astronautics, Shaukat Ali Simula Research Laboratory, Norway |