ICST 2023
Sun 16 - Thu 20 April 2023 Dublin, Ireland
Wed 19 Apr 2023 11:40 - 12:00 at Grand canal - Session 12: Regression Testing Chair(s): Yvan Labiche

The problem of test-case prioritization has been pursued for over three decades now and continues to be one of the active topics in software testing research. In this research work, we focus on a code-coverage based regression test-prioritization solution (Colosseum) that takes into account the position of changed (delta) code elements (basic-blocks) along the loop-free straight-line execution path of the regression test-cases. We propose a heuristic that logically associates each of these paths with three parameters: (i) the offset (displacement a) of the first delta from the starting basic-block, (ii) the offset (displacement c) of the last delta from the terminating basic block, and (iii) the average scattering (displacement b) within all the intermediate basic-blocks. We hypothesize that a regression test-case path with a shorter overall displacement has a good chance of propagating the effects of the code-changes to the observable outputs in the program. Colosseum prioritizes test-cases with smaller overall displacements and executes them early in the regression test-execution cycle. The underlying intuition is that the probability of a test-case revealing a regression fault depends on the probability of the corresponding change propagation. The change in this context can potentially lead to an error. Extending this logic, delta displacement provides an approximation to failed error propagation. Evaluation on 20 open-source C projects (totaling: 694,512 SLOC, 280 versions, and 69,305 test-cases) against four state-of-the-art prioritizations reveals that: Colosseum outperforms the competitors with an overall 84.61% success in terms of 13 prioritization effectiveness metrics, majority of which prefer to execute top-k% prioritized test-cases.

Wed 19 Apr

Displayed time zone: Dublin change

11:00 - 12:30
Session 12: Regression Testing Previous Editions / Industry / Testing Tools / Journal-First Papers at Grand canal
Chair(s): Yvan Labiche Carleton University
11:00
20m
Talk
Severity-Aware Prioritization of System-Level Regression Tests in Automotive Software
Industry
Roland Würsching Technical University of Munich, Daniel Elsner TU Munich, Fabian Leinen Technical University of Munich, Alexander Pretschner Technical University of Munich, Georg Grueneissl MAN Truck & Bus SE, Thomas Neumeyr MAN Truck & Bus SE, Tobias Vosseler MAN Truck & Bus SE
11:20
20m
Talk
BinaryRTS: Cross-language Regression Test Selection for C++ Binaries in CI
Industry
Daniel Elsner TU Munich, Severin Kacianka Technical University of Munich, Stephan Lipp Technical University of Munich, Alexander Pretschner TU Munich, Axel Habermann IVU Traffic Technologies, Maria Graber IVU Traffic Technologies, Silke Reimer IVU Traffic Technologies
Pre-print
11:40
20m
Talk
An Overview of Regression Test Prioritization by Delta Displacement in Test Coverage
Journal-First Papers
Shouvick Mondal IIT Gandhinagar, India, Rupesh Nasre IIT Madras, India
Link to publication DOI Media Attached
12:00
20m
Talk
Patterns of Code-to-Test Co-evolution for Automated Test Suite Maintenance
Previous Editions
Samiha Shimmi Northern Illinois University, Mona Rahimi Northern Illinois University
DOI
12:20
20m
Talk
DIRTS: Dependency Injection Aware Regression Test Selection
Testing Tools
Simon Hundsdorfer Technical University of Munich, Daniel Elsner TU Munich, Alexander Pretschner TU Munich
Pre-print