Abductive Reasoning for Neurosymbolic Fault Localization
Fault localization is essential for debugging. Recently, Large Language Model (LLM)-based techniques have been proposed to identify buggy methods from failing test cases. The state-of-the-art approach, \textit{SoapFL}, adopts a structured multi-phase procedure. Given a test failure, suspicious classes and methods are identified based on its analysis of the test failure. We conduct a funnel analysis of the multi-phase approach. While effective, our analysis highlights a limitation: the early selection of a single hypothesis can cause useful alternatives to be discarded. Motivated by how developers consider multiple competing hypotheses of the root cause of a bug as they analyze the evidence, we prototype \textit{HypoDeduce}, which applies abductive reasoning. \textit{HypoDeduce} generates and evaluates competing hypotheses, integrates evidence across classes and methods, and then identifies suspicious methods.
On Defects4J, our prototype successfully localizes the most suspicious method for 48.6% of bugs, improving over \textit{SoapFL} by 6%. These results suggest that structured hypothesis management enhances fault localization. We propose a research agenda for better supporting abductive analysis with more principled forms of reasoning supported by neurosymbolic approaches. In particular, we highlight the need for probabilistic reasoning, a combination of neural and symbolic methods for code navigation, as well as counterfactual analysis for suspicious code selection.
Fri 17 AprDisplayed time zone: Brasilia, Distrito Federal, Brazil change
11:00 - 12:30 | Testing and Analysis 17Demonstrations / Journal-first Papers / New Ideas and Emerging Results (NIER) at Oceania I Chair(s): Rangeet Pan IBM Research | ||
11:00 15mTalk | PySTAAR: An End-to-End, Extensible Framework for Automated Python Type Error Repair Demonstrations Wonseok Oh Korea University, Hyobin Park Kyungpook National University, Miryeong Kang Korea University, Seungbin Choi Kyungpook National University, Yunja Choi Kyungpook National University, Hakjoo Oh Korea University | ||
11:15 15mTalk | FlakeSync: A Tool for Automatically Repairing Async Flaky Tests Demonstrations Nandita Jayanthi The University of Texas at Austin, Shanto Rahman The University of Texas at Austin, August Shi The University of Texas at Austin | ||
11:30 15mTalk | The Sustainability Face of Automated Program Repair Tools Journal-first Papers Matias Martinez Universitat Politècnica de Catalunya (UPC), Silverio Martínez-Fernández UPC-BarcelonaTech, Xavier Franch Universitat Politècnica de Catalunya | ||
11:45 15mTalk | Towards Understanding the Challenges of Bug Localization in Deep Learning Systems Journal-first Papers Sigma Jahan Dalhousie University, Mehil Shah Dalhousie University, Masud Rahman Dalhousie University Pre-print File Attached | ||
12:00 15mTalk | Hypothesize-Then-Verify: Speculative Root Cause Analysis for Microservices with Pathwise Parallelism New Ideas and Emerging Results (NIER) Lingzhe Zhang Peking University, China, Tong Jia Institute for Artificial Intelligence, Peking University, Beijing, China, Yunpeng Zhai Alibaba Group, Leyi Pan Tsinghua University, Chiming Duan Peking University, Minghua He Peking University, Pei Xiao Peking University, Ying Li School of Software and Microelectronics, Peking University, Beijing, China | ||
12:15 15mTalk | Abductive Reasoning for Neurosymbolic Fault Localization New Ideas and Emerging Results (NIER) Minh Tam Le The University of Sydney, Australia, Xi Zheng Macquarie University, Hong Jin Kang University of Sydney | ||