BuggIn: Automatic Intrinsic Bugs Classification Model using NLP and ML
Recent studies have shown that bugs can be categorized into in- trinsic and extrinsic types. Intrinsic bugs can be backtracked to specific changes in the version control system (VCS), while extrin- sic bugs originate from external changes to the VCS and lack a direct bug-inducing change. Using only intrinsic bugs to train bug prediction models has been reported as beneficial to improve the performance of such models. However, there is currently no auto- mated approach to identify intrinsic bugs. To bridge this gap, our study employs Natural Language Processing (NLP) techniques to automatically identify intrinsic bugs. Specifically, we utilize two embedding techniques, seBERT and TF-IDF, applied to the title and description text of bug reports. The resulting embeddings are fed into well-established machine learning algorithms such as Support Vector Machine, Logistic Regression, Decision Tree, Random Forest, and K-Nearest Neighbors. The primary objective of this paper is to assess the performance of various NLP and machine learning techniques in identifying intrinsic bugs using the textual informa- tion extracted from bug reports. The results demonstrate that both seBERT and TF-IDF can be effectively utilized for intrinsic bug identification. The highest performance scores were achieved by combining TF-IDF with the Decision Tree algorithm and utilizing the bug titles (yielding an F1 score of 78%). This was closely fol- lowed by seBERT, Support Vector Machine, and bug titles (with an F1 score of 77%). In summary, this paper introduces an innovative approach that automates the identification of intrinsic bugs using textual information derived from bug reports.
Fri 8 DecDisplayed time zone: Pacific Time (US & Canada) change
11:00 - 12:30 | Bugs, smells, and vulnerabilitiesPROMISE 2023 at Foothill G Chair(s): Miroslaw Staron University of Gothenburg | ||
11:00 30mPaper | BuggIn: Automatic Intrinsic Bugs Classification Model using NLP and ML PROMISE 2023 Pragya Bhandari University of British Columbia, Gema Rodríguez-Pérez University of British Columbia (UBC) DOI | ||
11:30 30mPaper | Do Developers Fix Continuous Integration Smells? PROMISE 2023 Ayberk Yaşa Bilkent University, Ege Ergül Bilkent University, Eray Tüzün Bilkent University, Hakan Erdogmus Carnegie Mellon University DOI | ||
12:00 30mPaper | Large Scale Study of Orphan Vulnerabilities in the Software Supply Chain PROMISE 2023 David Reid University of Tennessee, Kristiina Rahkema University of Tartu, James Walden Northern Kentucky University DOI |