Mutation 2020
Sat 24 Oct 2020 Porto, Portugal
co-located with ICST 2020
Sat 24 Oct 2020 14:30 - 14:45 at Arrábida - Session I

Mutation analysis is a strong, well studied, faultbased testing criterion that has been shown to lead to strong test suites. Still, when using mutation analysis to compare test suites, previous work has shown that its results can be skewed because of redundant mutants. This problem is avoided by using minimal mutants, a set of representative mutants that is computed from a full matrix of all test results against all mutants. Pitest is a state of the art mutation analysis tool for Java and the JVM that can produce the matrix needed to compute minimal mutants. When a mutant leads to a JVM crash, because of a timeout or a memory error for example, Pitest does not record the full information about a mutant, leading to an incomplete matrix. In this work, we update Pitest in order to obtain the complete matrix, and make our updated version available. We then study the impact of the incomplete matrix on both minimal mutant computation and test selection, using both open source projects and developer-made test suites as well as a set of well tested methods. Finally, using the data collected, we see whether particular characteristics of a mutant or a test can help predict whether a test run against a mutant will lead to a JVM crash. Our experiments show that the missing information in Pitest’s matrix has little impact on the computed set of minimal mutants and the tests it selects. We also find no indication that particular mutation operator or test systematically leads to JVM crashes.

Sat 24 Oct

Displayed time zone: Lisbon change

12:40 - 15:00
12:40
25m
Day opening
Warm Up
Mutation 2020

13:05
10m
Day opening
Welcome
Mutation 2020

13:15
75m
Talk
Keynote
Mutation 2020
Mike Papadakis University of Luxembourg, Luxembourg
14:30
15m
Full-paper
On the impact of timeouts and JVM crashes in Pitest
Mutation 2020
Thomas Laurent Lero & University College Dublin, Fionnuala Wall Lero and University College Dublin, Anthony Ventresque Lero and University College Dublin
Link to publication DOI
14:45
15m
Full-paper
Using mutation testing to measure behavioural test diversity
Mutation 2020
Francisco Gomes Chalmers | University of Gothenburg, Felix Dobslaw Chalmers University of Technology, Robert Feldt Chalmers University of Technology
Link to publication DOI