Systematic Testing of Autonomous Driving Systems Using Map Topology-Based Scenario Classification
Autonomous Driving Systems (ADSs), which replace humans to drive vehicles, are complex software systems deployed in autonomous vehicles (AVs). Since the execution of ADSs highly relies on maps, it is essential to perform global map-based testing for ADSs to guarantee their correctness and AVs’ safety in different situations. Existing methods focus more on specific scenarios rather than global testing throughout the map. Testing on a global map is challenging since the complex lane connections in a map can generate enormous scenarios. In this work, we propose ATLAS, an approach to ADSs’ collision avoidance testing using map topology-based scenario classification. The key insight of ATLAS is to generate diverse testing scenarios by classifying junction lanes according to their topology-based interaction patterns. First, ATLAS divides the junction lanes in a map into different classes such that an ADS can execute similar collision avoidance maneuvers on the lanes in the same class. Second, for each class, ATLAS selects one junction lane to construct the testing scenario and generate test cases using genetic algorithm. Finally, we implement and evaluate ATLAS on Baidu Apollo with the LGSVL simulator on the San Francisco map. Results show that ATLAS exposes nine types of real issues in Apollo 6.0 and reduces the number of junction lanes for testing by 98%.
Wed 17 NovDisplayed time zone: Hobart change
12:00 - 13:00 | Testing ApplicationsIndustry Showcase / NIER track / Research Papers at Koala Chair(s): Scott Barnett | ||
12:00 20mTalk | Automated Testing for Machine Translation via Constituency Invariance Research Papers Pin Ji Nanjing University, Yang Feng Nanjing University, Jia Liu Nanjing University, Zhihong Zhao Nanjing Tech Unniversity, Baowen Xu Nanjing University | ||
12:20 10mTalk | Systematic Testing of Autonomous Driving Systems Using Map Topology-Based Scenario Classification NIER track Yun Tang Nanyang Technological University, Yuan Zhou Nanyang Technological University, Tianwei Zhang Nanyang Technological University, Fenghua Wu Nanyang Technological University, Yang Liu Nanyang Technological University, Gang Wang Alibaba Group | ||
12:30 10mTalk | Automatic HMI Structure Exploration Via Curiosity-Based Reinforcement Learning Industry Showcase Yushi Cao Nanyang Technological University, YAN ZHENG Nanyang Technological University, Shang-Wei Lin Nanyang Technological University, Singapore, Yang Liu Nanyang Technological University, Yon Shin Teo Continental Automotive Singapore Pte. Ltd., Yuxuan Toh Continental Automotive Singapore Pte. Ltd., Vinay Vishnumurthy Adiga Continental Automotive Singapore Pte. Ltd. |