APSEC 2024
Tue 3 - Fri 6 December 2024 China
Fri 6 Dec 2024 11:40 - 12:00 at Room 1 (Zunhui Room) - Session (17) Chair(s): Meng Yan

In recent years, Automated Program Repair (APR), which focuses on automatically fixing source code without human intervention, has become a hot topic in the field of software engineering, leading to the proposal of various automatic repair techniques. Additionally, Lapvikai et al. introduced a new software quality metric called “Autorepairability”. Autorepairability is a metric that indicates how easily bugs in the target source code can be fixed using APR techniques.

By utilizing Autorepairability, it becomes possible to pre-check whether the program repair techniques will work effectively on the target software and to perform refactoring to improve Autorepairability. Lapvikai et al. not only proposed Autorepairability but also measured it using traditional APR techniques based on genetic programming. However, in the past two to three years, program repair using large language models (LLMs) has become more prevalent, and several studies have revealed that these models exhibit superior repair capabilities compared to traditional APR techniques.

In this study, we applied Autorepairability for the performance comparison of multiple APR techniques. Specifically, we measured and compared Autorepairability using ChatGPT and Gemini, which are representative large language models, as well as kGenProg, a traditional APR technique. The results demonstrated that Gemini exhibited higher repair capabilities compared to both ChatGPT and the traditional APR technique kGenProg.

Fri 6 Dec

Displayed time zone: Beijing, Chongqing, Hong Kong, Urumqi change

11:00 - 12:20
Session (17)SEIP - Software Engineering in Practice / ERA - Early Research Achievements at Room 1 (Zunhui Room)
Chair(s): Meng Yan School of Big Data & Software Engineering, Chongqing University
11:00
20m
Talk
Large Language Models Empowered Online Log Anomaly Detection in AIOps
SEIP - Software Engineering in Practice
11:20
20m
Talk
Leveraging Generative AI for Accelarating Enterprise Application Development: Insights from ChatGPT
SEIP - Software Engineering in Practice
Asha Rajbhoj TCS Research, Tanay Sant Tata Consultancy Services, Akanksha Somase Tata Consultancy Services, Vinay Kulkarni Tata Consultancy Services Research
11:40
20m
Talk
Autorepairability of ChatGPT and Gemini: A Comparative Study
ERA - Early Research Achievements
Chutweeraya Sriwilailak Mahidol University, Yoshiki Higo Osaka University, Pongpop Lapvikai Mahidol University, Chaiyong Rakhitwetsagul Mahidol University, Thailand, Morakot Choetkiertikul Mahidol University, Thailand
12:00
20m
Talk
Towards Log-based Execution Status Estimation Using Graph Neural Networks
ERA - Early Research Achievements