Mutation Testing in Test Code Refactoring: Leveraging Mutants to Ensure Behavioral Consistency
Previous research has identified mutation testing as a promising technique for detecting unintended changes in test behavior during test code refactoring. Despite its theoretical support, the practical adoption of this approach has been hindered by a lack of corresponding tools. Consequently, these studies have been unable to fully validate the effectiveness of mutation testing across various test refactoring scenarios, leaving an in-depth empirical validation open for future research. To address this gap, this study examines MeteoR, a tool developed as a reference implementation to support test refactoring by using mutation testing as a guardrail to ensure the maintenance of the refactored test behavior. We leverage MeteoR to validate the practical applicability of this approach across diverse test refactoring scenarios. This evaluation uses a catalog of common test refactorings that reflect real-world practices. The results indicate that MeteoR effectively detects changes in test behavior in most scenarios, demonstrating the efficacy of mutation testing in identifying issues during test code refactoring. However, the study also identifies limitations, particularly the occurrence of false negatives when refactorings modify how tests handle dependencies. These findings highlight the potential of the approach for verifying the maintenance of test behavior and contribute to the state-of-the-art by identifying limitations that can be addressed in future studies.
Wed 4 JunDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
14:00 - 15:30 | |||
14:00 30mTalk | Exploratory Software Testing in Scrum: A Qualitative Study Research Papers Giulia Neri The University of Sheffield, Rob Marchand The University of Sheffield, Neil Walkinshaw The University of Sheffield File Attached | ||
14:30 20mTalk | Fostering New Work Practices Bottom-up Through a Community of Practice - A Case Study in a Large-Scale Agile Software Development Organization Research Papers Franziska Tobisch Technical University of Munich (TUM), Florian Matthes Technical University of Munich Link to publication File Attached | ||
14:50 20mTalk | A Mosaic of Perspectives: Understanding Ownership in Software Engineering Research Papers Tomi Suomi University of Jyväskylä, Petri Ihantola University of Jyväskylä, Tommi Mikkonen University of Helsinki, Niko Mäkitalo University of Jyväskylä Pre-print File Attached | ||
15:10 20mTalk | Mutation Testing in Test Code Refactoring: Leveraging Mutants to Ensure Behavioral Consistency Research Papers File Attached |