ICST 2023
Sun 16 - Thu 20 April 2023 Dublin, Ireland
Wed 19 Apr 2023 11:20 - 11:40 at Grand canal - Session 12: Regression Testing Chair(s): Yvan Labiche

Continuous integration (CI) pipelines are commonly used to execute regression tests before pull requests are merged. Regression test selection (RTS) aims to reduce the required testing effort and feedback time for developers. However, existing RTS techniques are imprecise for tests with cross-language links to compiled C++ binaries or unsafe if tests read from external files. This is problematic because modern software in fact involves several programming languages and (non-)code artifacts such as configuration files. In this paper, we present BinaryRTS, a novel RTS technique that leverages dynamic binary instrumentation to collect the covered functions and accessed external files for each test. BinaryRTS then selects tests depending on changes issued to C++ binaries or external (non-)code artifacts. When evaluating BinaryRTS in our large-scale industrial context, we are able to exclude on average up to 74% of tests without missing real failures. We release BinaryRTS as the first publicly available RTS tool for software involving C++ code.

Wed 19 Apr

Displayed time zone: Dublin change

11:00 - 12:30
Session 12: Regression Testing Previous Editions / Industry / Testing Tools / Journal-First Papers at Grand canal
Chair(s): Yvan Labiche Carleton University
11:00
20m
Talk
Severity-Aware Prioritization of System-Level Regression Tests in Automotive Software
Industry
Roland Würsching Technical University of Munich, Daniel Elsner TU Munich, Fabian Leinen Technical University of Munich, Alexander Pretschner Technical University of Munich, Georg Grueneissl MAN Truck & Bus SE, Thomas Neumeyr MAN Truck & Bus SE, Tobias Vosseler MAN Truck & Bus SE
11:20
20m
Talk
BinaryRTS: Cross-language Regression Test Selection for C++ Binaries in CI
Industry
Daniel Elsner TU Munich, Severin Kacianka Technical University of Munich, Stephan Lipp Technical University of Munich, Alexander Pretschner TU Munich, Axel Habermann IVU Traffic Technologies, Maria Graber IVU Traffic Technologies, Silke Reimer IVU Traffic Technologies
Pre-print
11:40
20m
Talk
An Overview of Regression Test Prioritization by Delta Displacement in Test Coverage
Journal-First Papers
Shouvick Mondal IIT Gandhinagar, India, Rupesh Nasre IIT Madras, India
Link to publication DOI Media Attached
12:00
20m
Talk
Patterns of Code-to-Test Co-evolution for Automated Test Suite Maintenance
Previous Editions
Samiha Shimmi Northern Illinois University, Mona Rahimi Northern Illinois University
DOI
12:20
20m
Talk
DIRTS: Dependency Injection Aware Regression Test Selection
Testing Tools
Simon Hundsdorfer Technical University of Munich, Daniel Elsner TU Munich, Alexander Pretschner TU Munich
Pre-print