ADPerf: Investigating and Testing Performance in Autonomous Driving Systems
This program is tentative and subject to change.
Perception is crucial to the operation of autonomous driving systems (ADSs), which rely on multiple sensors, such as cameras and LiDARs, combined with code logic and deep learning models to detect obstacles for time-sensitive decisions. Consequently, the latency of the perception module is critical to the safety and effectiveness of ADSs. However, the latency of the perception module and its resilience to various changes in the LiDAR point cloud are not yet fully understood. In this work, we present the first comprehensive investigation measuring and modeling the availability of an industry-grade ADS multi-sensor fusion (MSF) perception module i.e., Apollo. Learning from this investigation, we introduce ADPerf, a tool modifying the point cloud data (PCD) to generate simple and realistic testing scenarios for LiDAR detection which can increase the detection latency. Increasing latency decreases the availability of the detected obstacles, decreasing the accuracy of the obstacle-dependent decisions in ADSs. We conduct a study to assess the effects of ADPerf-generated PCD on the availability of widely-used LiDAR-based 3D obstacle detections, and in turn, trajectory predictors. Our evaluation highlights the need to assess the availability of perception components, especially LiDAR-based detectors, and their robustness to various noises and modifications as they can be a major bottleneck to the performance of the ADS system. Such an adverse outcome will also further propagate to other modules, reducing the overall reliability of ADSs.
This program is tentative and subject to change.
Mon 17 NovDisplayed time zone: Seoul change
11:00 - 12:30 | |||
11:00 10mTalk | ADPerf: Investigating and Testing Performance in Autonomous Driving Systems Research Papers Tri Minh-Triet Pham Concordia University, Diego Elias Costa Concordia University, Canada, Weiyi Shang University of Waterloo, Jinqiu Yang Concordia University | ||
11:10 10mTalk | VRTestSniffer: Test Smell Detector for Virtual Reality (VR) Software Projects Research Papers Faraz Gurramkonda University of Michigan-Dearborn, Avishak Chakroborty University of Michigan-Dearborn, Bruce Maxim University of Michigan - Dearborn, Mohamed Wiem Mkaouer University of Michigan - Flint, Foyzul Hassan University of Michigan at Dearborn | ||
11:20 10mTalk | A Multi-Modality Evaluation of the Reality Gap in Autonomous Driving Systems Research Papers Stefano Carlo Lambertenghi Technische Universität München, fortiss GmbH, Mirena Flores Valdez Technical University of Munich, Andrea Stocco Technical University of Munich, fortiss Pre-print | ||
11:30 10mTalk | On the Robustness Evaluation of 3D Obstacle Detection Against Specifications in Autonomous Driving Research Papers Tri Minh-Triet Pham Concordia University, Bo Yang Concordia University, Jinqiu Yang Concordia University | ||
11:40 10mTalk | TARGET: Traffic Rule-Based Test Generation for Autonomous Driving via Validated LLM-Guided Knowledge Extraction Journal-First Track Yao Deng Macquarie University, Zhi Tu Purdue University, Jiaohong Yao Macquarie University, Mengshi Zhang TensorBlock, Tianyi Zhang Purdue University, Xi Zheng Macquarie University | ||
11:50 10mTalk | IMUFUZZER: Resilience-based Discovery of Signal Injection Attacks on Robotic Aerial Vehicles Research Papers Sudharssan Mohan University of Texas at Dallas, Kyeongseok Yang Korea University, Zelun Kong The University of Texas at Dallas, Yonghwi Kwon University of Maryland, Junghwan Rhee University of Central Oklahoma, Tyler Summers University of Texas at Dallas, Hongjun Choi DGIST, Heejo Lee Korea University, Chung Hwan Kim University of Texas at Dallas | ||
12:00 10mTalk | Argus: Resilience-Oriented Safety Assurance Framework for End-to-End ADSs Research Papers Dingji Wang Fudan University, You Lu Fudan University, Bihuan Chen Fudan University, Shuo Hao Fudan University, Haowen Jiang Fudan University, China, Yifan Tian Fudan University, Xin Peng Fudan University | ||
12:10 10mResearch paper | VRExplorer: A Model-based Approach for Automated Virtual Reality Scene Testing Research Papers Zhu Zhengyang Sun Yat-sen University, Hong-Ning Dai Hong Kong Baptist University, Hanyang Guo School of Software Engineering, Sun Yat-sen University, Zeqin Liao Sun Yat-sen University, Zibin Zheng Sun Yat-sen University Pre-print | ||
12:20 10mTalk | When Autonomous Vehicle Meets V2X Cooperative Perception: How Far Are We? Research Papers An Guo Nanjing University, Shuoxiao Zhang Nanjing University, Enyi Tang Nanjing University, Xinyu Gao , Haomin Pang Guangzhou University, Haoxiang Tian Nanyang Technological University, Singapore, Yanzhou Mu , Wu Wen Guangzhou University, Chunrong Fang Nanjing University, Zhenyu Chen Nanjing University Pre-print | ||