Mutation testing evaluates test suite quality by injecting intentional faults into source code to verify if tests detect them. Existing engines typically generate mutants by exhaustively applying mutation operators. This creates an implicit blind spot where trivial syntax changes and complex semantic drifts are treated as equally significant. This lack of prioritization wastes computational resources on “easy-to-catch” issues. As a result, the assessment often fails to show whether the test suite is actually capable of catching the most dangerous, subtle bugs that actually matter.
We present Argus, a mutation engine that enhances exhaustive syntactic perturbation with intentional semantic exploration. Our key innovation is modeling mutation as a seed-controlled walk over AST locations, enabling the generation of compositional mutation sequences (i.e., structured chains or trees of dependent edits) that simulate complex regressions rather than isolated, trivial shifts. Argus implements this through three core mechanisms: (1) mutations guided by syntax coverage and semantic properties in tandem, (2) dependency-aware steering toward critical APIs, and (3) an interactive viewer for step-wise traces and mutation trajectories. By allowing developers to interpret and reproduce complex mutation paths, Argus provides a transparent assessment of a test suite’s capability to detect deep semantic drifts that existing tools overlook.
Tue 7 JulDisplayed time zone: Eastern Time (US & Canada) change
16:00 - 17:30 | Test generation 2Tool Demonstrations / Journal-First Paper / Research Papers at MB 5.215 Chair(s): Ezekiel Soremekun Singapore University of Technology and Design | ||
16:00 20mTalk | Failing with Purpose: Dangling Coverage-Guided Negative Test Generation from a Mechanized P4 Type System Research Papers | ||
16:20 10mTalk | Argus: A Guided and Traceable Mutation Testing Engine Tool Demonstrations Zi Yang University of California, Riverside, Zhaorui Yang University of California, Riverside, Jiyuan Wang Tulane University, Qian Zhang University of California at Riverside | ||
16:30 20mTalk | Evaluating LLM-based Regression Test Generation Research Papers Jing Liu Max Planck Institute for Security and Privacy, Seongmin Lee UCLA, Eleonora Losiouk University of Padua, Marcel Böhme MPI for Security and Privacy DOI Pre-print File Attached | ||
16:50 20mTalk | TestLoop: A Process Model Describing Human-in-the-Loop Software Test Suite Generation Journal-First Paper Matthew C. Davis Carnegie Mellon University, Sangheon Choi Rose-Hulman Institute of Technology, Amy Wei University of Michigan, Sam Estep Carnegie Mellon University, Brad A. Myers Carnegie Mellon University, Joshua Sunshine Carnegie Mellon University Link to publication DOI | ||
17:10 20mTalk | MR-Coupler: Automated Metamorphic Test Generation via Functional Coupling Analysis Research Papers Congying Xu The Hong Kong University of Science and Technology, China, Hengcheng Zhu The Hong Kong University of Science and Technology, Songqiang Chen The Hong Kong University of Science and Technology, Jiarong Wu , Valerio Terragni University of Auckland, Shing-Chi Cheung Hong Kong University of Science and Technology Pre-print | ||