OpenSBT: A Modular Framework for Search-based Testing of Automated Driving Systems
Search-based software testing (SBST) is an effective and efficient approach for testing automated driving systems (ADS). However, testing pipelines for ADS testing are particularly challenging as they involve integrating complex driving simulation platforms and establishing communication protocols and APIs with the desired search algorithm. This complexity prevents a wide adoption of SBST and thorough empirical comparative experiments with different simulators and search approaches. We present OpenSBT, an open-source, modular and extensible framework to facilitate the SBST of ADS. With OpenSBT, it is possible to integrate simulators with an embedded system under test, search algorithms and fitness functions for testing. We describe the architecture and show the usage of our framework by applying different search algorithms for testing Automated Emergency Braking Systems in CARLA as well in the high-fidelity Prescan simulator in collaboration with our industrial partner DENSO. OpenSBT is available at https://git.fortiss.org/opensbt. A demo video is provided here: https://youtu.be/6csl_UAOD_4.
Fri 19 AprDisplayed time zone: Lisbon change
14:00 - 15:30 | Testing with and for AI 2Journal-first Papers / Research Track / Demonstrations at Sophia de Mello Breyner Andresen Chair(s): João Pascoal Faria Faculty of Engineering, University of Porto and INESC TEC | ||
14:00 15mTalk | Large Language Models are Edge-Case Generators: Crafting Unusual Programs for Fuzzing Deep Learning Libraries Research Track Yinlin Deng University of Illinois at Urbana-Champaign, Chunqiu Steven Xia University of Illinois at Urbana-Champaign, Chenyuan Yang University of Illinois at Urbana-Champaign, Shizhuo Zhang University of Illinois Urbana-Champaign, Shujing Yang University of Illinois Urbana-Champaign, Lingming Zhang University of Illinois at Urbana-Champaign | ||
14:15 15mTalk | Deeply Reinforcing Android GUI Testing with Deep Reinforcement Learning Research Track Yuanhong Lan Nanjing University, Yifei Lu Nanjing University, Zhong Li , Minxue Pan Nanjing University, Wenhua Yang Nanjing University of Aeronautics and Astronautics, Tian Zhang Nanjing University, Xuandong Li Nanjing University | ||
14:30 7mTalk | Black-Box Testing of Deep Neural Networks through Test Case Diversity Journal-first Papers Zohreh Aghababaeyan University of Ottawa Ottawa, Ontario, Canada, Manel Abdellatif Software and Information Technology Engineering Department, École de Technologie Supérieure, Lionel Briand University of Ottawa, Canada; Lero centre, University of Limerick, Ireland, Ramesh S , Mojtaba Bagherzadeh Cisco | ||
14:37 7mTalk | scenoRITA: Generating Diverse, Fully Mutable, Test Scenarios for Autonomous Vehicle Planning Journal-first Papers Yuqi Huai University of California, Irvine, Sumaya Almanee University of California, Irvine, Yuntianyi Chen University of California, Irvine, Xiafa Wu University of California, Irvine, Qi Alfred Chen University of California, Irvine, Joshua Garcia University of California, Irvine | ||
14:44 7mTalk | InterEvo-TR: Interactive Evolutionary Test Generation with Readability Assessment Journal-first Papers Pedro Delgado-Pérez Universidad de Cádiz, Aurora Ramírez University of Córdoba, Kevin Jesús Valle-Gómez Universidad de Cádiz, Inmaculada Medina-Bulo Universidad de Cádiz, José Raúl Romero University of Cordoba, Spain | ||
14:51 7mTalk | Differential testing for machine learning: an analysis for classification algorithms beyond deep learning Journal-first Papers | ||
14:58 7mTalk | Journal First Article: "Syntactic Vs. Semantic similarity of Artificial and Real Faults in Mutation Testing Studies" Journal-first Papers Milos Ojdanic University of Luxembourg, Aayush Garg Luxembourg Institute of Science and Technology, Ahmed Khanfir University of Luxembourg, Renzo Degiovanni Luxembourg Institute of Science and Technology, Mike Papadakis University of Luxembourg, Yves Le Traon University of Luxembourg, Luxembourg | ||
15:05 7mTalk | Causality-driven Testing of Autonomous Driving Systems Journal-first Papers Luca Giamattei Università di Napoli Federico II, Antonio Guerriero Università di Napoli Federico II, Roberto Pietrantuono Università di Napoli Federico II, Stefano Russo Università di Napoli Federico II | ||
15:12 7mTalk | When Less is More: On the Value of ''Co-training'' for Semi-Supervised Software Defect Predictors Journal-first Papers Suvodeep Majumder North Carolina State University, Joymallya Chakraborty Amazon.com, Tim Menzies North Carolina State University Pre-print | ||
15:19 7mTalk | OpenSBT: A Modular Framework for Search-based Testing of Automated Driving Systems Demonstrations Lev Sorokin fortiss, Tiziano Munaro fortiss, Damir Safin fortiss, Brian Hsuan-Cheng Liao DENSO AUTOMOTIVE, Adam Molin DENSO AUTOMOTIVE | ||