On the Effectiveness of Unified Debugging: An Extensive Study on 16 Program Repair Systems
Automated debugging techniques, including fault localization and program repair, have been studied for decades. The existing connection between fault localization and program repair is that fault localization computes the potential buggy elements for program repair to patch. Recently, a pioneering work, ProFL, explored the unified debugging idea to unify fault localization and program repair in the other direction for the first time to boost both areas. More specifically, ProFL utilizes the patch execution results from one state-of-the-art repair system, PraPR, to help improve state-of-the-art fault localization. In this way, ProFL not only improves fault localization for manual repair, but also extends the application scope of automated repair to all possible bugs (not only the small ratio of bugs that can be automatically fixed). In this work, we perform an extensive study of the ProFL unified-debugging approach on 16 state-of-the-art program repair systems for the first time. Our experimental results on the widely studied Defects4J benchmark suite reveal various practical guidelines for unified de-bugging, such as : (1) nearly all the studied 16 repair systems can contribute to unified debugging despite of their varying repairing capabilities, (2) repair systems targeting multi-edit patches canbring noise for unified debugging, (3) repair systems with more executed/plausible patches tend to perform better for unified debugging, (4) unified debugging effectiveness does not rely on the availability of correct patches in automated repair. Based on our study outcome, we further propose an advanced unified debugging technique, UniDebug++, which can localize over 20% more bugs within Top-1 positions than state-of-the-art ProFL.
Thu 24 SepDisplayed time zone: (UTC) Coordinated Universal Time change
02:20 - 03:20 | Empirical Software Engineering (2)Research Papers at Koala Chair(s): Julia Rubin University of British Columbia, Canada | ||
02:20 20mTalk | Understanding Performance Concerns in the API Documentation of Data Science Libraries Research Papers Yida Tao Shenzhen University, Jiefang Jiang Shenzhen University, Yepang Liu Southern University of Science and Technology, Zhiwu Xu Shenzhen University, Shengchao Qin University of Teesside | ||
02:40 20mTalk | On the Effectiveness of Unified Debugging: An Extensive Study on 16 Program Repair Systems Research Papers Samuel Benton The University of Texas at Dallas, Xia Li Kennesaw State University, Yiling Lou Peking University, China, Lingming Zhang University of Illinois at Urbana-Champaign, USA | ||
03:00 20mTalk | Automated Third-party Library Detection for Android Applications: Are We There Yet?Experience Research Papers Xian Zhan The Hong Kong Polytechnic University, Lingling Fan Nanyang Technological University, Singapore, Tianming Liu Monash University, Australia, Sen Chen Nanyang Technological University, Singapore, Li Li Monash University, Australia, Haoyu Wang Beijing University of Posts and Telecommunications, China, Yifei Xu Southern University of Science and Technology, Xiapu Luo The Hong Kong Polytechnic University, Yang Liu Nanyang Technological University, Singapore |