Empowering Autonomous Debugging Agents with Efficient Dynamic Analysis
Autonomous agents for automated program repair represent a promising frontier in software engineering, yet their effectiveness is often hindered by reliance on post-mortem, coarse-grained execution feedback. While integrating traditional interactive debuggers seems a natural solution, their low-level, line-by-line interaction paradigm turns to be cost-inefficient for LLM-based agents, leading to exhausted budgets and unproductive loops. To mitigate this, we introduce Agent-centric Debugging Interface (ADI), a novel agent-centric debugging interface designed for cost-efficient, end-to-end autonomous interaction. Specifically, Agent-centric Debugging Interface realizes a function-level interaction paradigm, powered by our Frame Lifetime Trace—a comprehensive data structure encapsulating a function’s stateful execution trace—and a set of high-level navigational commands.
Our extensive evaluation on the SWE-bench benchmark demonstrates the effectiveness and efficiency of ADI. By simply equipping a basic agent with ADI, it successfully resolves 63.8% of the tasks on the SWE-bench Verified set, even slightly outperforming the highly-optimized and high-investment Claude-Tools agent, at an average cost of $1.28 per task with Claude-Sonnet-3.7. Furthermore, we demonstrate ADI’s generality by integrating it as a plug-and-play component into the existing SOTA agents, delivering consistent gains ranging from 6.2% to 18.5% on the resolved tasks. These results indicate that Agent-centric Debugging Interface could achieve a general and efficient enhancement for the existing autonomous agents.
Tue 7 JulDisplayed time zone: Eastern Time (US & Canada) change
14:00 - 15:10 | DebuggingResearch Papers / Ideas, Visions and Reflections at MB 2.430 Chair(s): Taher A. Ghaleb Trent University | ||
14:00 20mTalk | Empowering Autonomous Debugging Agents with Efficient Dynamic Analysis Research Papers Jiahong Xiang Southern University of Science and Technology, Xiaoyang Xu Southern University of Science and Technology, Xiaopan Chu Southern University of Science and Technology, Hongliang Tian Ant Group, Yuqun Zhang Southern University of Science and Technology Pre-print | ||
14:40 20mTalk | Debugging Engine Enhanced by Prior Knowledge: Can We Teach LLM How to Debug? Research Papers Kunyi Li Zhejiang University, China, Sai Wu Zhejiang University, Xiu Tang Zhejiang University, Chang Yao Zhejiang University, Songhao Bu Zhejiang University, Quanqing Xu OceanBase, Ant Group, Gang Chen Zhejiang University DOI Pre-print | ||
15:00 20mTalk | A Grounded Theory of Debugging in Professional Software Engineering Practice Research Papers Link to publication DOI Pre-print | ||
15:20 10mTalk | Towards Output Directed Debugging of Finite Model Finders Ideas, Visions and Reflections Mohammad Nurullah Patwary The Unviersity of Texas at Arlington, Allison Sullivan University of Texas at Arlington | ||