ASE 2024
Sun 27 October - Fri 1 November 2024 Sacramento, California, United States
Thu 31 Oct 2024 14:45 - 15:00 at Magnoila - Code and issue report Chair(s): Baishakhi Ray

Bug reports, containing crucial information such as the Observed Behavior (OB), the Expected Behavior (EB), and the Steps to Reproduce (S2R), can help developers reproduce and fix bugs efficiently. However, due to the limited experience of the some report writer and the complexity of some bugs, the bug reports often miss this crucial information. Although some machine learning based approaches and information retrieval (IR) based techniques are proposed to detect and supplement the missing information in bug reports, the performance of these approaches depends heavily on the size and quality of the bug report dataset. The development of fine-tuning pre-trained models and LLMs can effectively alleviate the problems. In this paper, we present ChatBR, a method for automated assessment and improvement of bug report quality using ChatGPT. First, we fine-tune a pre-trained BERT model using manually annotated bug reports to create a statement-level multi-label classifier to assess the quality of bug reports by detecting whether existing OB, EB, and S2R. Then, we use ChatGPT in a zero-shot setup to generate missing information (OB, EB, and S2R) to improve the quality of the bug report. Finally, we manually check the consistency of the output of ChatGPT with that of the classifier with high confidence. Experimental results show that, in the task of detecting missing information in bug reports, ChatBR outperforms the state-of-the-art methods by 25.38%-29.20% in terms of precision. In the task of generating missing information in bug reports, ChatBR can achieve an average of 84.10% in terms of semantic similarity of the generated information across six different projects. Furthermore, ChatBR can generate more than 99.9% of high quality bug reports (i.e., bug reports that are full of OB, EB, and S2R) within five calls to ChatGPT.

Thu 31 Oct

Displayed time zone: Pacific Time (US & Canada) change

13:30 - 15:00
Code and issue reportResearch Papers at Magnoila
Chair(s): Baishakhi Ray Columbia University, New York; AWS AI Lab
13:30
15m
Talk
PatUntrack: Automated Generating Patch Examples for Issue Reports without Tracked Insecure Code
Research Papers
Ziyou Jiang Institute of Software at Chinese Academy of Sciences, Lin Shi Beihang University, Guowei Yang University of Queensland, Qing Wang Institute of Software at Chinese Academy of Sciences
DOI Pre-print
13:45
15m
Talk
Understanding Code Changes Practically with Small-Scale Language Models
Research Papers
Cong Li Zhejiang University; Ant Group, Zhaogui Xu Ant Group, Peng Di Ant Group, Dongxia Wang Zhejiang University, Zheng Li Ant Group, Qian Zheng Ant Group
14:00
15m
Talk
DRMiner: Extracting Latent Design Rationale from Jira Issue LogsACM SigSoft Distinguished Paper Award
Research Papers
Jiuang Zhao Beihang University, Zitian Yang Beihang University, Li Zhang Beihang University, Xiaoli Lian Beihang University, China, Donghao Yang Beihang University, Xin Tan Beihang University
14:15
15m
Talk
An Empirical Study on Learning-based Techniques for Explicit and Implicit Commit Messages Generation
Research Papers
Zhiquan Huang Sun Yat-sen University, Yuan Huang Sun Yat-sen University, Xiangping Chen Sun Yat-sen University, Xiaocong Zhou School of Computer Science and Engineering, Sun Yat-sen University, Guangzhou 510006, China, Changlin Yang Sun Yat-sen University, Zibin Zheng Sun Yat-sen University
14:30
15m
Talk
RCFG2Vec: Considering Long-Distance Dependency for Binary Code Similarity Detection
Research Papers
Weilong Li School of Computer Science and Engineering,Sun Yat-sen University, Jintian Lu College of Computer Science and Engineering, Jishou University, Ruizhi Xiao School of Computer Science and Engineering,Sun Yat-sen University, Pengfei Shao China Southern Power Grid Digital Grid Group Information and Telecommunication Technology Co., Ltd., Shuyuan Jin School of Computer Science and Engineering,Sun Yat-sen University
14:45
15m
Talk
ChatBR: Automated assessment and improvement of bug report quality using ChatGPT
Research Papers
Lili Bo Yangzhou University, wangjie ji Yangzhou University, Xiaobing Sun Yangzhou University, Ting Zhang Singapore Management University, Xiaoxue Wu Yangzhou University, Ying Wei Yangzhou University