ICST 2023
Sun 16 - Thu 20 April 2023 Dublin, Ireland
Wed 19 Apr 2023 11:00 - 11:20 at Grand canal - Session 12: Regression Testing Chair(s): Yvan Labiche

In automotive software engineering, system-level regression testing is crucial to ensure proper integration of oftentimes safety-critical components. Due to the inherent complexity of such systems and components, testing is commonly performed manually and in a black-box manner, which is particularly costly and leads to slow feedback cycles between testers and developers. Regression Test Prioritization (RTP) aims to reduce feedback time by ordering tests to reveal faults earlier during the testing process. However, most prior RTP research does not incorporate varying fault severity, which must be taken into account when evaluating and designing appropriate RTP approaches for safety-critical automotive software systems. In this work, we present a case study at our industry partner MAN, a leading international provider of commercial vehicles. We design and instantiate a domain-specific, severity-aware RTP assessment model and comparatively assess state-of-the-art RTP approaches. Our results indicate that simple and partly well-known heuristics based on test history and test costs have the best cost-effectiveness, achieving between 85% and 90% of the maximum possible feedback time reduction. On the other hand, search-based and machine-learning-based RTP approaches do not perform better, especially if available test history is sparse.

Wed 19 Apr

Displayed time zone: Dublin change

11:00 - 12:30
Session 12: Regression Testing Previous Editions / Industry / Testing Tools / Journal-First Papers at Grand canal
Chair(s): Yvan Labiche Carleton University
11:00
20m
Talk
Severity-Aware Prioritization of System-Level Regression Tests in Automotive Software
Industry
Roland Würsching Technical University of Munich, Daniel Elsner TU Munich, Fabian Leinen Technical University of Munich, Alexander Pretschner Technical University of Munich, Georg Grueneissl MAN Truck & Bus SE, Thomas Neumeyr MAN Truck & Bus SE, Tobias Vosseler MAN Truck & Bus SE
11:20
20m
Talk
BinaryRTS: Cross-language Regression Test Selection for C++ Binaries in CI
Industry
Daniel Elsner TU Munich, Severin Kacianka Technical University of Munich, Stephan Lipp Technical University of Munich, Alexander Pretschner TU Munich, Axel Habermann IVU Traffic Technologies, Maria Graber IVU Traffic Technologies, Silke Reimer IVU Traffic Technologies
Pre-print
11:40
20m
Talk
An Overview of Regression Test Prioritization by Delta Displacement in Test Coverage
Journal-First Papers
Shouvick Mondal IIT Gandhinagar, India, Rupesh Nasre IIT Madras, India
Link to publication DOI Media Attached
12:00
20m
Talk
Patterns of Code-to-Test Co-evolution for Automated Test Suite Maintenance
Previous Editions
Samiha Shimmi Northern Illinois University, Mona Rahimi Northern Illinois University
DOI
12:20
20m
Talk
DIRTS: Dependency Injection Aware Regression Test Selection
Testing Tools
Simon Hundsdorfer Technical University of Munich, Daniel Elsner TU Munich, Alexander Pretschner TU Munich
Pre-print