EASE 2025
Tue 17 - Fri 20 June 2025 Istanbul, Turkey
Wed 18 Jun 2025 11:10 - 11:25 at Workshop Room - Testing Chair(s): Zadia Codabux

Mutation testing is a popular way of assessing and improving test suites by creating defective variants of the code under test (CUT) us- ing mutation operators. A test suite is run against all such defective CUT variants and its adequacy is measured in terms of the number of defective variants it is able to detect. Traditionally, mutation operators target individual statements of the CUT and presume the defect detection ability of mutant-revealing tests on the basis of the coupling effect hypothesis: Tests that reveal all simple faults are sensitive enough to also detect complex faults [8]. This hypothesis has been repeatedly investigated by comparing typical mutations against real defects or more complex (synthetic) mutations.

In this paper we propose to use mutation operators that are de- fined on the basis of empirically derived and confirmed software fault distributions. As these operators are more complex than tradi- tional operators, the corresponding patterns have fewer matches in the CUT. This results in fewer mutants to test with, thereby lower- ing the effort for mutation testing. We comparatively evaluate the utility of the generated mutants against Major, a mutation testing framework with traditional operators, on the Defects4J dataset of Java projects with known defects. The results of our study show that the empirical operators result in fewer mutants to evaluate test suites against, but also that they are easier to detect and less coupled with real defects than traditional mutation testing operators in the majority of cases.

Paper Preprint (main.pdf)759KiB

Wed 18 Jun

Displayed time zone: Athens change

11:00 - 12:30
TestingResearch Papers / Short Papers, Emerging Results at Workshop Room
Chair(s): Zadia Codabux University of Saskatchewan
11:00
10m
Talk
Effectiveness of Combinatorial Interaction Testing in Test Automation - An Industrial Case Study
Short Papers, Emerging Results
Feras Daoud Czech Technical University in Prague, Miroslav Bures Czech Technical University, Czechia, Melchizedek Alipio Czech Technical University in Prague
11:10
15m
Talk
Empirical Fault Patterns for Mutation Testing
Research Papers
Sophia Hans LMU Munich, Matthias Kettl LMU Munich, Stefan Winter LMU Munich
File Attached
11:25
15m
Talk
Empirically Evaluating the Use of Bytecode for Diversity-Based Test Case Prioritisation
Research Papers
Islam Elgendy The University of Sheffield, Robert Hierons The University of Sheffield, Phil McMinn University of Sheffield
Pre-print
11:40
15m
Talk
Systemic Flakiness: An Empirical Analysis of Co-Occurring Flaky Test Failures
Research Papers
Owain Parry University of Sheffield, Gregory Kapfhammer Allegheny College, Michael Hilton Carnegie Mellon University, Phil McMinn University of Sheffield
Pre-print
11:55
10m
Talk
Testing SSD Firmware with State Data-Aware Fuzzing: Accelerating Coverage in Nondeterministic I/O Environments
Short Papers, Emerging Results
Gangho Yoon SungKyunKwan University, Samsung Institute of Technology
Pre-print
12:05
10m
Talk
Toward Automated Test Generation for Dockerfiles Based on Analysis of Docker Image Layers
Short Papers, Emerging Results
Yuki Goto Osaka University, Shinsuke Matsumoto Osaka University, Shinji Kusumoto Osaka University
Pre-print
12:15
15m
Talk
Aspects of complexity in automotive software systems and their relation to maintainability effort-- A case study
Research Papers
Bengt Haraldsson Chalmers University of Technology and University of Gothenburg, Scania CV AB, Miroslaw Staron Chalmers University of Technology and University of Gothenburg
Pre-print