Write a Blog >>
ICSE 2023
Sun 14 - Sat 20 May 2023 Melbourne, Australia
Tue 16 May 2023 11:50 - 12:10 at Meeting Room 104 - Morning session

Bug fixing is one of the most time consuming and resource intensive task in the software development life cycle. Automated Program Repair (APR) might be able to help in this process, but it still has to overcome many obstacles. Deep learning models have shown promise for automated program repair in recent years, but their effectiveness can depend on the representation of the source code used as input. In this paper, we conduct an experimental study to compare the performance of deep learning models on two popular programming languages, Java and JavaScript, using three different code representations: raw text, command sequences and abstract syntax trees (ASTs). We also experiment with different baseline models, including T5, CodeT5, (for solving sequence-to-sequence tasks) RoBERTa and GPTNeo (to encode/decode AST graph information). We evaluate the models on a set of real-world defects from open-source projects and compare the performance and the repair patches generated by the models. Our results show that training on command sequences representation outperforms most of the other configurations. We achieve a best of 19.88% accuracy on java-small dataset, and 11.87% on java-medium, using text representation. Using command sequence representation, we achieve 30.64% on java-small, and 18.53% on the medium dataset. However when representing the source with ast+text information, our models significantly underperform compared to other representations, achieving results below one percent. Our findings contribute to a better understanding of the strengths and limitations of deep learning models for automated program repair and provide practical guidance for their use in practice.

Tue 16 May

Displayed time zone: Hobart change

11:00 - 12:30
Morning sessionAPR at Meeting Room 104
11:15
15m
Talk
Quick Repair of Semantic Errors for Debugging
APR
Steven P. Reiss Brown University, USA, Xuan Wei Wuhan University, Qi Xin Wuhan University
11:30
20m
Talk
An Analysis of the Automatic Bug Fixing Performance of ChatGPT
APR
Dominik Sobania Johannes Gutenberg University Mainz, Martin Briesch Johannes Gutenberg University Mainz, Carol Hanna University College London, Justyna Petke University College London
11:50
20m
Talk
An Extensive Study on Model Architecture and Program Representation in the Domain of Learning-based Automated Program Repair
APR
Dániel Horváth Department of Software Engineering, University of Szeged, Szeged, Hungary, Viktor Csuvik Department of Software Engineering, MTA-SZTE Research Group on Artificial Intelligence, University of Szeged, Szeged, Hungary, Tibor Gyimóthy University of Szeged, Hungary, László Vidács University of Szeged, Hungary
12:10
20m
Talk
Mining Fix Patterns with Context Information for Automatic Program Repair
APR
Phan Thi Thanh Huyen Hitachi, Ltd., Research &Development Group, Kazuya Yasuda Hitachi, Ltd., Shinji Itoh Hitachi, Ltd., Research &Development Group
12:30
90m
Lunch
Lunch
APR