FSE 2026
Sun 5 - Thu 9 July 2026 Montreal, Canada
Tue 7 Jul 2026 16:20 - 16:30 at MB 5.215 - Test generation 2 Chair(s): Ezekiel Soremekun

Mutation testing evaluates test suite quality by injecting intentional faults into source code to verify if tests detect them. Existing engines typically generate mutants by exhaustively applying mutation operators. This creates an implicit blind spot where trivial syntax changes and complex semantic drifts are treated as equally significant. This lack of prioritization wastes computational resources on “easy-to-catch” issues. As a result, the assessment often fails to show whether the test suite is actually capable of catching the most dangerous, subtle bugs that actually matter.

We present Argus, a mutation engine that enhances exhaustive syntactic perturbation with intentional semantic exploration. Our key innovation is modeling mutation as a seed-controlled walk over AST locations, enabling the generation of compositional mutation sequences (i.e., structured chains or trees of dependent edits) that simulate complex regressions rather than isolated, trivial shifts. Argus implements this through three core mechanisms: (1) mutations guided by syntax coverage and semantic properties in tandem, (2) dependency-aware steering toward critical APIs, and (3) an interactive viewer for step-wise traces and mutation trajectories. By allowing developers to interpret and reproduce complex mutation paths, Argus provides a transparent assessment of a test suite’s capability to detect deep semantic drifts that existing tools overlook.

Tue 7 Jul

Displayed time zone: Eastern Time (US & Canada) change

16:00 - 17:30
Test generation 2Tool Demonstrations / Journal-First Paper / Research Papers at MB 5.215
Chair(s): Ezekiel Soremekun Singapore University of Technology and Design
16:00
20m
Talk
Failing with Purpose: Dangling Coverage-Guided Negative Test Generation from a Mechanized P4 Type System
Research Papers
16:20
10m
Talk
Argus: A Guided and Traceable Mutation Testing Engine
Tool Demonstrations
Zi Yang University of California, Riverside, Zhaorui Yang University of California, Riverside, Jiyuan Wang Tulane University, Qian Zhang University of California at Riverside
16:30
20m
Talk
Evaluating LLM-based Regression Test Generation
Research Papers
Jing Liu Max Planck Institute for Security and Privacy, Seongmin Lee UCLA, Eleonora Losiouk University of Padua, Marcel Böhme MPI for Security and Privacy
DOI Pre-print File Attached
16:50
20m
Talk
TestLoop: A Process Model Describing Human-in-the-Loop Software Test Suite Generation
Journal-First Paper
Matthew C. Davis Carnegie Mellon University, Sangheon Choi Rose-Hulman Institute of Technology, Amy Wei University of Michigan, Sam Estep Carnegie Mellon University, Brad A. Myers Carnegie Mellon University, Joshua Sunshine Carnegie Mellon University
Link to publication DOI
17:10
20m
Talk
MR-Coupler: Automated Metamorphic Test Generation via Functional Coupling Analysis
Research Papers
Congying Xu The Hong Kong University of Science and Technology, China, Hengcheng Zhu The Hong Kong University of Science and Technology, Songqiang Chen The Hong Kong University of Science and Technology, Jiarong Wu , Valerio Terragni University of Auckland, Shing-Chi Cheung Hong Kong University of Science and Technology
Pre-print