Write a Blog >>
ICSE 2023
Sun 14 - Sat 20 May 2023 Melbourne, Australia
Tue 16 May 2023 11:30 - 11:50 at Meeting Room 104 - Morning session

To support software developers in finding and fixing software bugs, several automated program repair techniques have been introduced. Given a test suite, standard methods usually either synthesize a repair, or navigate a search space of software edits to find test-suite passing variants. Recent program repair methods are based on deep learning approaches. One of these novel methods, which is not primarily intended for automated program repair, but is still suitable for it, is ChatGPT. The bug fixing performance of ChatGPT, however, is so far unclear. Therefore, in this paper we evaluate ChatGPT on the standard bug fixing benchmark set, QuixBugs, and compare the performance with the results of several other approaches reported in the literature. We find that ChatGPT’s bug fixing performance is competitive to the common deep learning approaches CoCoNut and Codex and notably better than the results reported for the standard program repair approaches. In contrast to previous approaches, ChatGPT offers a dialogue system through which further information, e.g., the expected output for a certain input or an observed error message, can be entered. By providing such hints to ChatGPT, its success rate can be further increased, fixing 31 out of 40 bugs, outperforming state-of-the-art.

Tue 16 May

Displayed time zone: Hobart change

11:00 - 12:30
Morning sessionAPR at Meeting Room 104
11:15
15m
Talk
Quick Repair of Semantic Errors for Debugging
APR
Steven P. Reiss Brown University, USA, Xuan Wei Wuhan University, Qi Xin Wuhan University
11:30
20m
Talk
An Analysis of the Automatic Bug Fixing Performance of ChatGPT
APR
Dominik Sobania Johannes Gutenberg University Mainz, Martin Briesch Johannes Gutenberg University Mainz, Carol Hanna University College London, Justyna Petke University College London
11:50
20m
Talk
An Extensive Study on Model Architecture and Program Representation in the Domain of Learning-based Automated Program Repair
APR
Dániel Horváth Department of Software Engineering, University of Szeged, Szeged, Hungary, Viktor Csuvik Department of Software Engineering, MTA-SZTE Research Group on Artificial Intelligence, University of Szeged, Szeged, Hungary, Tibor Gyimóthy University of Szeged, Hungary, László Vidács University of Szeged, Hungary
12:10
20m
Talk
Mining Fix Patterns with Context Information for Automatic Program Repair
APR
Phan Thi Thanh Huyen Hitachi, Ltd., Research &Development Group, Kazuya Yasuda Hitachi, Ltd., Shinji Itoh Hitachi, Ltd., Research &Development Group
12:30
90m
Lunch
Lunch
APR