XP 2025
Mon 2 - Thu 5 June 2025 Brugg - Windisch, Switzerland
Wed 4 Jun 2025 15:10 - 15:30 at 5.1A17 (Session) - Testing Chair(s): Per Beining

Previous research has identified mutation testing as a promising technique for detecting unintended changes in test behavior during test code refactoring. Despite its theoretical support, the practical adoption of this approach has been hindered by a lack of corresponding tools. Consequently, these studies have been unable to fully validate the effectiveness of mutation testing across various test refactoring scenarios, leaving an in-depth empirical validation open for future research. To address this gap, this study examines MeteoR, a tool developed as a reference implementation to support test refactoring by using mutation testing as a guardrail to ensure the maintenance of the refactored test behavior. We leverage MeteoR to validate the practical applicability of this approach across diverse test refactoring scenarios. This evaluation uses a catalog of common test refactorings that reflect real-world practices. The results indicate that MeteoR effectively detects changes in test behavior in most scenarios, demonstrating the efficacy of mutation testing in identifying issues during test code refactoring. However, the study also identifies limitations, particularly the occurrence of false negatives when refactorings modify how tests handle dependencies. These findings highlight the potential of the approach for verifying the maintenance of test behavior and contribute to the state-of-the-art by identifying limitations that can be addressed in future studies.

Wed 4 Jun

Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

14:00 - 15:30
TestingResearch Papers at 5.1A17 (Session)
Chair(s): Per Beining XPand ApS
14:00
30m
Talk
Exploratory Software Testing in Scrum: A Qualitative Study
Research Papers
Giulia Neri The University of Sheffield, Rob Marchand The University of Sheffield, Neil Walkinshaw The University of Sheffield
File Attached
14:30
20m
Talk
Fostering New Work Practices Bottom-up Through a Community of Practice - A Case Study in a Large-Scale Agile Software Development Organization
Research Papers
Franziska Tobisch Technical University of Munich (TUM), Florian Matthes Technical University of Munich
Link to publication File Attached
14:50
20m
Talk
A Mosaic of Perspectives: Understanding Ownership in Software Engineering
Research Papers
Tomi Suomi University of Jyväskylä, Petri Ihantola University of Jyväskylä, Tommi Mikkonen University of Helsinki, Niko Mäkitalo University of Jyväskylä
Pre-print File Attached
15:10
20m
Talk
Mutation Testing in Test Code Refactoring: Leveraging Mutants to Ensure Behavioral Consistency
Research Papers
File Attached
:
:
:
: