Mining Long Tail Bugs: Identifying Rare and Overlooked Issues in Code
Using data mining to extract frequent code patterns for bug detection has proven effective. However, prior studies have overlooked the prevalence of infrequent (rare) patterns, even though violations of such patterns can also lead to bugs.
In this paper, we present LTMiner, which mines rare patterns from large-scale projects and detects potential bugs by checking for violations of these patterns. In practice, rare patterns far outnumber frequent ones and lack strong statistical support. Consequently, we face a pattern explosion, and many rare patterns and their violations are uninteresting. LTMiner addresses this by using instance-based ranking and filtering to prioritize violations of rare patterns. It further employs a large language model (LLM) as a domain expert to audit top-ranked violations; mined information supports in-context learning, and task decomposition and self-reflection mitigate possible hallucinations. This pipeline effectively curbs pattern explosion and false positives, uncovering previously unknown bugs in large-scale projects at an acceptable cost.
Applied to Linux 6.12.1, LTMiner identified 42 previously unknown bugs, 27 of which have been confirmed by developers. These results indicate that, although rare-pattern bugs are sparse, a considerable number remain and exhibit a non-negligible long tail. We believe that rare-pattern bugs constitute a promising blue ocean for bug detection.
Tue 7 JulDisplayed time zone: Eastern Time (US & Canada) change
14:00 - 15:30 | MSR 1Research Papers / Ideas, Visions and Reflections / Journal-First Paper at MB 3.430 Chair(s): Miroslaw Staron Chalmers University of Technology and University of Gothenburg | ||
14:00 20mTalk | Mining Long Tail Bugs: Identifying Rare and Overlooked Issues in Code Research Papers Wentao Liang Institute of Software, Chinese Academy of Sciences, Yanjun Wu Institute of Software, Chinese Academy of Sciences, Xiang Ling Institute of Software, Chinese Academy of Sciences, Tianyue Luo Institute of Software, Chinese Academy of Sciences, Dinghao Liu Shandong University, Haotian Zhang Institute of Software, Chinese Academy of Sciences, Jingzheng Wu Institute of Software, The Chinese Academy of Sciences DOI Media Attached | ||
14:20 20mTalk | LinkAnchor: An Autonomous LLM-Based Agent for Issue-to-Commit Link Recovery Research Papers Arshia Akhavan San Diego State University, Alireza Hoseinpour Bowling Green State University, Abbas Heydarnoori Bowling Green State University, Hamid Bagheri University of Nebraska-Lincoln, Mehdi Keshani University of Zurich, Zurich, Switzerland DOI Pre-print Media Attached File Attached | ||
14:40 20mTalk | Automated Identification of Sexual Orientation and Gender Identity Discriminatory Texts from Issue Comments Journal-First Paper Sayma Sultana Tulane University, USA, Jaydeb Sarker University of Nebraska at Omaha, Farzana Israt Wayne State University, Rajshakhar Paul Wayne State University, Amiangshu Bosu Wayne State University Link to publication DOI Pre-print | ||
15:00 10mTalk | Rethinking Software Quality Measurement: A Vision for AI-Assisted Triangulation in the Post-Metrics Era Ideas, Visions and Reflections Jomar Thomas Almonte The Pennsylvania State University, Nathalia Nascimento Pennsylvania State University | ||
15:10 20mTalk | UNICS: Multilingual Code Search via Unified Pseudocode and Contrastive Transfer Learning Research Papers Ye Fan Nanjing University, Jidong Ge Nanjing University, Chuanyi Li Nanjing University, Liguo Huang Southern Methodist University, Bin Luo Nanjing University DOI Pre-print | ||