ICSE 2024
Fri 12 - Sun 21 April 2024 Lisbon, Portugal
Fri 19 Apr 2024 11:15 - 11:30 at Fernando Pessoa - Testing: various bug types 2 Chair(s): João F. Ferreira

Multi-sensor fusion stands as a pivotal technique in addressing numerous safety-critical tasks and applications, e.g., self-driving cars and automated robotic arms. With the continuous advancement in data-driven Artificial Intelligence (AI), MSF’s potential for sensing and understanding intricate external environments has been further amplified, bringing a profound impact on intelligent systems and specifically on their perception systems. Similar to traditional software, adequate testing is also required for AI-enabled MSF systems. Yet, existing testing methods primarily concentrate on single-sensor perception systems (e.g., image-/point cloud-based object detection systems). There remains a lack of emphasis on generating multi-modal test cases for MSF systems.

To address these limitations, we design and implement MultiTest, a fitness-guided metamorphic testing method for complex MSF perception systems. MultiTest employs a physical-aware approach to synthesize realistic multi-modal object instances and insert them into critical positions of background images and point clouds. A fitness metric is designed to guide and boost the test generation process. We conduct extensive experiments with five SOTA perception systems to evaluate MultiTest from the perspectives of: (1) generated test cases’ realism, (2) fault detection capabilities, and (3) performance improvement. The results show that MultiTest can generate realistic and modality-consistent test data and effectively detect hundreds of diverse faults of an MSF system under test. Moreover, retraining an MSF system on the test cases generated by MultiTest can improve the system’s robustness.

Fri 19 Apr

Displayed time zone: Lisbon change

11:00 - 12:30
Testing: various bug types 2Research Track / Software Engineering in Practice at Fernando Pessoa
Chair(s): João F. Ferreira INESC-ID and IST, University of Lisbon
11:00
15m
Talk
Towards Finding Accounting Errors in Smart ContractsACM SIGSOFT Distinguished Paper Award
Research Track
Brian Zhang Purdue University
11:15
15m
Talk
MultiTest: Physical-Aware Object Insertion for Testing Multi-sensor Fusion Perception Systems
Research Track
Xinyu Gao , Zhijie Wang University of Alberta, Yang Feng Nanjing University, Lei Ma The University of Tokyo & University of Alberta, Zhenyu Chen Nanjing University, Baowen Xu Nanjing University
Pre-print
11:30
15m
Talk
JLeaks: A Featured Resource Leak Repository Collected From Hundreds of Open-Source Java Projects
Research Track
Tianyang Liu Beijing Institute of Technology, Weixing Ji Beijing Institute of Technology, Xiaohui Dong Beijing Institute of Technology, Wuhuang Yao Beijing Institute of Technology, Yizhuo Wang Beijing Institute of Technology, Hui Liu Beijing Institute of Technology, Haiyang Peng Beijing Institute of Technology, Yuxuan Wang Beijing Institute of Technology
11:45
15m
Talk
S3C: Spatial Semantic Scene Coverage for Autonomous Vehicles
Research Track
Trey Woodlief University of Virginia, Felipe Toledo , Sebastian Elbaum University of Virginia, Matthew B Dwyer University of Virginia
Pre-print
12:00
15m
Talk
FlashSyn: Flash Loan Attack Synthesis via Counter Example Driven Approximation
Research Track
Zhiyang Chen University of Toronto, Sidi Mohamed Beillahi University of Toronto, Fan Long University of Toronto
Pre-print
12:15
15m
Talk
Hawkeye: Change-targeted Testing for Android Apps based on Deep Reinforcement Learning
Software Engineering in Practice
Chao Peng ByteDance, China, Zhengwei Lv ByteDance, Jiarong Fu ByteDance, Jiayuan Liang ByteDance, Zhao Zhang Bytedance Network Technology, Ajitha Rajan University of Edinburgh, Ping Yang Bytedance Network Technology