Fri 8 Dec 2023 11:00 - 11:30 at Foothill G - Bugs, smells, and vulnerabilities Chair(s): Miroslaw Staron

Recent studies have shown that bugs can be categorized into in- trinsic and extrinsic types. Intrinsic bugs can be backtracked to specific changes in the version control system (VCS), while extrin- sic bugs originate from external changes to the VCS and lack a direct bug-inducing change. Using only intrinsic bugs to train bug prediction models has been reported as beneficial to improve the performance of such models. However, there is currently no auto- mated approach to identify intrinsic bugs. To bridge this gap, our study employs Natural Language Processing (NLP) techniques to automatically identify intrinsic bugs. Specifically, we utilize two embedding techniques, seBERT and TF-IDF, applied to the title and description text of bug reports. The resulting embeddings are fed into well-established machine learning algorithms such as Support Vector Machine, Logistic Regression, Decision Tree, Random Forest, and K-Nearest Neighbors. The primary objective of this paper is to assess the performance of various NLP and machine learning techniques in identifying intrinsic bugs using the textual informa- tion extracted from bug reports. The results demonstrate that both seBERT and TF-IDF can be effectively utilized for intrinsic bug identification. The highest performance scores were achieved by combining TF-IDF with the Decision Tree algorithm and utilizing the bug titles (yielding an F1 score of 78%). This was closely fol- lowed by seBERT, Support Vector Machine, and bug titles (with an F1 score of 77%). In summary, this paper introduces an innovative approach that automates the identification of intrinsic bugs using textual information derived from bug reports.

Fri 8 Dec

Displayed time zone: Pacific Time (US & Canada) change

11:00 - 12:30
Bugs, smells, and vulnerabilitiesPROMISE 2023 at Foothill G
Chair(s): Miroslaw Staron University of Gothenburg
11:00
30m
Paper
BuggIn: Automatic Intrinsic Bugs Classification Model using NLP and ML
PROMISE 2023
Pragya Bhandari University of British Columbia, Gema Rodríguez-Pérez University of British Columbia (UBC)
DOI
11:30
30m
Paper
Do Developers Fix Continuous Integration Smells?
PROMISE 2023
Ayberk Yaşa Bilkent University, Ege Ergül Bilkent University, Eray Tüzün Bilkent University, Hakan Erdogmus Carnegie Mellon University
DOI
12:00
30m
Paper
Large Scale Study of Orphan Vulnerabilities in the Software Supply Chain
PROMISE 2023
David Reid University of Tennessee, Kristiina Rahkema University of Tartu, James Walden Northern Kentucky University
DOI