Patch Correctness Assessment in Automated Program Repair Based on the Impact of Patches on Production and Test Code
Fri 22 Jul 2022 07:40 - 08:00 at ISSTA 2 - Session 2-14: Program Repair B Chair(s): Christoph Csallner
Test-based generate-and-validate automated program repair (APR) systems often generate many patches that pass the test suite without fixing the bug. The generated patches must be manually inspected by the developers, so previous research proposed various techniques for automatic correctness assessment of APR-generated patches. Among them, dynamic patch correctness assessment techniques rely on the assumption that, when running the originally passing test cases, the correct patches will not alter the program behavior in a significant way, \textit{e.g.}, removing the code implementing correct functionality of the program. In this paper, we propose and evaluate a novel technique, named Shibboleth, for automatic correctness assessment of the patches generated by test-based generate-and-validate APR systems. Unlike existing works, the impact of the patches is captured along three complementary facets, allowing more effective patch correctness assessment. Specifically, we measure the impact of patches on both production code (\textit{via} syntactic and semantic similarity) and test code (\textit{via} code coverage of passing tests) to separate the patches that result in similar programs and that do not delete desired program elements. Shibboleth assesses the correctness of patches \textit{via} both ranking and classification. We evaluated our technique on 1,871 patches, generated by 29 Java-based APR systems for Defects4J programs. The technique outperforms state-of-the-art raking and classification techniques. Specifically, in our ranking data set, in 43% (66%) of the cases, Shibboleth ranks the correct patch in top-1 (top-2) positions, and in classification mode applied on our classification data set, it achieves an accuracy and F1-score of 0.887 and 0.852, respectively.
Fri 22 JulDisplayed time zone: Seoul change
03:00 - 03:40 | |||
03:00 20mTalk | ATR: Template-based Repair for Alloy Specifications Technical Papers Guolong Zheng University of Nebraska Lincoln, ThanhVu Nguyen George Mason University, Simón Gutiérrez Brida University of Rio Cuarto and CONICET, Argentina, Germán Regis Universidad Nacional de Río Cuarto, Nazareno Aguirre University of Rio Cuarto and CONICET, Argentina, Marcelo F. Frias Dept. of Software Engineering Instituto Tecnológico de Buenos Aires, Hamid Bagheri University of Nebraska-Lincoln DOI | ||
03:20 20mTalk | Patch Correctness Assessment in Automated Program Repair Based on the Impact of Patches on Production and Test Code Technical Papers DOI Pre-print |
07:00 - 08:20 | Session 2-14: Program Repair BTechnical Papers at ISSTA 2 Chair(s): Christoph Csallner University of Texas at Arlington | ||
07:00 20mTalk | ATR: Template-based Repair for Alloy Specifications Technical Papers Guolong Zheng University of Nebraska Lincoln, ThanhVu Nguyen George Mason University, Simón Gutiérrez Brida University of Rio Cuarto and CONICET, Argentina, Germán Regis Universidad Nacional de Río Cuarto, Nazareno Aguirre University of Rio Cuarto and CONICET, Argentina, Marcelo F. Frias Dept. of Software Engineering Instituto Tecnológico de Buenos Aires, Hamid Bagheri University of Nebraska-Lincoln DOI | ||
07:20 20mTalk | CIRCLE: Continual Repair across Programming Languages Technical Papers Wei Yuan The University of Queensland, Quanjun Zhang Nanjing University, Tieke He Nanjing University, Chunrong Fang Nanjing University, Nguyen Quoc Viet Hung Griffith University, Xiaodong Hao Nanjing University, Hongzhi Yin The University of Queensland DOI | ||
07:40 20mTalk | Patch Correctness Assessment in Automated Program Repair Based on the Impact of Patches on Production and Test Code Technical Papers DOI Pre-print | ||
08:00 20mTalk | Program Vulnerability Repair via Inductive Inference Technical Papers Yuntong Zhang National University of Singapore, Xiang Gao Beihang University, China, Gregory J. Duck National University of Singapore, Abhik Roychoudhury National University of Singapore DOI |