CCTest: Critical Configuration Testing for Autonomous Driving Systems
Simulation-based testing is the dominant approach for validating autonomous driving systems (ADS) through simulation. However, generating critical scenarios that effectively uncover real defects in ADS while managing the complexity of the generation remains a challenge. This paper introduces CCTest, a testing framework that generates critical test data using simple scenarios decomposed from complex ones and provides qualitative analysis of the scenarios. CCTest ensures that any safety violation observed indicates a defect in the tested autopilot by creating situations where each vehicle is controlled by the autopilot under test and has a feasible safety policy. Evaluations have shown that the test data generated by CCTest effectively reveal major defects in Apollo, Autoware, and the built-in autopilots in Carla and LGSVL simulators. CCTest also outperforms existing tools in efficiently uncovering real defects in autopilots.
Mon 23 JunDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
10:30 - 12:30 | Autonomous DrivingDemonstrations / Research Papers / Industry Papers at Cosmos 3A Chair(s): Nassim Belmecheri | ||
10:30 20mTalk | On-Demand Scenario Generation for Testing Automated Driving Systems Research Papers Songyang Yan Xi'an Jiaotong University, Xiaodong Zhang Xidian University, Kunkun Hao Synkrotron, Inc., Haojie Xin Xi'an Jiaotong University, Yonggang Luo Chongqing Changan Automobile Co. Ltd, Jucheng Yang Chongqing Changan Automobile Co. Ltd, Ming Fan Xi'an Jiaotong University, Chao Yang Xidian University, Jun Sun Singapore Management University, Zijiang Yang University of Science and Technology of China and Synkrotron, Inc. DOI Pre-print | ||
10:50 20mTalk | Multi-Modal Traffic Scenario Generation for Autonomous Driving System Testing Research Papers Zhi Tu Purdue University, Liangkun Niu Purdue University, Wei Fan Purdue University, Tianyi Zhang Purdue University DOI Pre-print | ||
11:10 10mTalk | CCTest: Critical Configuration Testing for Autonomous Driving Systems Demonstrations Changwen Li , Joseph Sifakis University Grenoble Alpes; CNRS; Grenoble INP; VERIMAG, Rongjie Yan Institute of Software at Chinese Academy of Sciences; University of Chinese Academy of Sciences, Jian Zhang Institute of Software at Chinese Academy of Sciences; University of Chinese Academy of Sciences | ||
11:20 10mTalk | HazSim: An Urban Driving Simulator for Testing Perception Systems of ADSes Against Hazards Demonstrations Xiaodong Zhang Xidian University, Jie Bao Xi'an Jiaotong University, Yulong Shen Xidian University, Qin Xia Xi'an Jiaotong University, Zijiang Yang University of Science and Technology of China and Synkrotron, Inc. | ||
11:40 20mTalk | A Comprehensive Study of Bug-Fix Patterns in Autonomous Driving Systems Research Papers Yuntianyi Chen University of California, Irvine, Yuqi Huai University of California, Irvine, Yirui He University of California, Irvine, Shilong Li University of California, Irvine, Changnam Hong University of California, Irvine, Alfred Chen University of California, Irvine, Joshua Garcia University of California, Irvine DOI Pre-print | ||
12:00 10mTalk | PCLA: A Framework for Testing Autonomous Agents in the CARLA Simulator Demonstrations Masoud Jamshidiyan Tehrani Università della Svizzera italiana, Jinhan Kim Università della Svizzera italiana (USI), Paolo Tonella USI Lugano | ||
12:10 20mTalk | AutoTracer: A Low-Overhead Tracing Framework for Autonomous Driving System Industry Papers Bo Jiang Beihang University, Fancheng Shu SKLCCSE,Beihang University, Yuyang Cui SKLCCSE,Beihang University, Xiangjie Wang SKLCCSE,Beihang University, Peng Tang SKLCCSE,Beihang University, Lei Wang SKLCCSE,Beihang University, Weiping Zhang DiDi Global, Yong Wang Beihang University, Guobin Wu DiDi Global |
Cosmos 3A is the first room in the Cosmos 3 wing.
When facing the main Cosmos Hall, access to the Cosmos 3 wing is on the left, close to the stairs. The area is accessed through a large door with the number “3”, which will stay open during the event.