Towards Effective Lightweight Test Oracles for Automated Multi-Fault Program Repair
This program is tentative and subject to change.
We investigate the oracle problem in automated repair of multi-fault programs, focusing on validating partial patches produced during incremental repair phases. Given a multi-fault program P with faults (f₁, …, fₙ) and a test suite T triggering these faults, the goal is to design validation oracles (O¹, …, Oⁿ) for intermediate patches (pt₁, …, ptₙ) that address individual faults.
Validating partial patches raises two major issues. First, such patches are typically generated incrementally by automated program repair (APR) tools and may address only a subset of the program’s faults, leaving others unresolved. As a result, they often fail to produce correct outputs when evaluated in isolation. Second, validation must account for interactions with remaining faults to avoid rejecting valid fixes.
To address these issues, we introduce a new validation framework that blends the strengths of output-based, halting, and assertion-based oracles, some of which are informed by bug reports. The framework provides a modular approach to assess both partial and composite patches in programs with multiple defects by integrating formal reasoning and modeling fault interactions.
This approach lays the groundwork for more fault-aware and interaction-sensitive repair techniques and brings us closer to a deeper, more practical understanding of how to assess patch correctness in complex, real-world multi-fault scenarios.
This program is tentative and subject to change.
Wed 10 SepDisplayed time zone: Auckland, Wellington change
13:30 - 15:00 | Session 4 - Testing 1Research Papers Track / Registered Reports / Journal First Track / NIER Track / Industry Track / Tool Demonstration Track at Case Room 2 260-057 Chair(s): Sigrid Eldh Ericsson AB, Mälardalen University, Carleton University | ||
13:30 15m | Performance Testing in Open-Source Web Projects: Adoption, Maintenance, and a Change Taxonomy Research Papers Track Sergio Di Meglio Università degli Studi di Napoli Federico II, Luigi Libero Lucio Starace Università degli Studi di Napoli Federico II, Valeria Pontillo Gran Sasso Science Institute, Ruben Opdebeeck Vrije Universiteit Brussel, Coen De Roover Vrije Universiteit Brussel, Sergio Di Martino Università degli Studi di Napoli Federico II Pre-print | ||
13:45 15m | Harnessing LLMs for Document-Guided Fuzzing of OpenCV Library Research Papers Track Bin Duan The University of Queensland, Tarek Mahmud Texas State University, Meiru Che Central Queensland University, Yan Yan University of Illinois Chicago, Naipeng Dong The University of Queensland, Australia, Dan Dongseong Kim The University of Queensland, Guowei Yang University of Queensland | ||
14:00 10m | XTestGen: Natural Language to Maintainable E2E Test Scripts with LLMs Tool Demonstration Track File Attached | ||
14:10 10m | Towards Effective Lightweight Test Oracles for Automated Multi-Fault Program Repair NIER Track Omar I. Al-Bataineh Gran Sasso Science Institute (GSSI) Media Attached | ||
14:20 15m | Testing Is Not Boring: Characterizing Challenge in Software Testing Tasks Industry Track Davi Gama Hardman CESAR - Recife Center for Advanced Studies and Systems, César França Federal Rural University of Pernambuco (UFRPE), Brody Stuart-Verner University of Calgary, Ronnie de Souza Santos University of Calgary | ||
14:35 15m | Enriching automatic test case generation by extracting relevant test inputs from bug reports Journal First Track Wendkuuni Arzouma Marc Christian OUEDRAOGO University of Luxembourg, Laura Plein CISPA Helmholtz Center for Information Security, Abdoul Kader Kaboré University of Luxembourg, Andrew Habib ABB Corporate Research, Germany, Jacques Klein University of Luxembourg, David Lo Singapore Management University, Tegawendé F. Bissyandé University of Luxembourg | ||
14:50 10m | An Empirical Study of Complexity, Heterogeneity, and Compliance of GitHub Actions Workflows Registered Reports Edward Abrokwah Department of Computer Science, Trent University, Peterborough, Canada, Taher A. Ghaleb Trent University Pre-print |