ICSME 2025
Sun 7 - Fri 12 September 2025 Auckland, New Zealand

This program is tentative and subject to change.

When a system failure is sufficiently severe, system owners may conduct a post-mortem analysis to learn from the failure and then propose ways to evolve the system in an effort to prevent similar failures in the future. Our interest in this paper is broadly in characterizing the system evolution that follows from post-mortem analysis. Specifically, we have three research questions: (1) what aspects of an incident motivate proposed changes, (2) what parts of the system are targeted by the proposed changes, and (3) what are the intended effects of the proposed changes on system characteristics. To answer these questions, we have conducted an empirical study of 360 proposed changes from 75 public incident reports. From our analysis we have found that proposed changes are motivated by a wide variety of events experienced during the incident, including how the incident was triggered, ways the failure propagated, response related events, and the recovery of the system. We have also found that a wide variety of system parts are targeted by AIs, including system aspects that may not be considered for evolution in other contexts. Finally, we have found that AIs primarily propose to evolve performance efficiency, reliability and to a lesser degree flexibility and safety, and propose to do so by considering narrow scenarios related to the incident.

This program is tentative and subject to change.

Thu 11 Sep

Displayed time zone: Auckland, Wellington change

15:30 - 17:00
Session 11 - Human Factors 1Journal First Track / Research Papers Track at Case Room 3 260-055
Chair(s): Gregorio Robles Universidad Rey Juan Carlos, Alexander Serebrenik Eindhoven University of Technology
15:30
15m
Characterizing the System Evolution That is Proposed After a Software Incident
Research Papers Track
Matt Pope Brigham Young University, Jonathan Sillito Brigham Young University
15:45
15m
Social Media Reactions to Open Source Promotions: AI-Powered GitHub Projects on Hacker News
Research Papers Track
Prachnachai Meakpaiboonwattana Mahidol University, Warittha Tarntong Mahidol University, Thai Mekratanavorakul Mahidol University, Chaiyong Rakhitwetsagul Mahidol University, Thailand, Pattaraporn Sangaroonsilp Mahidol University, Raula Gaikovina Kula The University of Osaka, Morakot Choetkiertikul Mahidol University, Thailand, Kenichi Matsumoto Nara Institute of Science and Technology, Thanwadee Sunetnanta Mahidol University
16:00
15m
Does Editing Improve Answer Quality on Stack Overflow? A Data-Driven Investigation
Research Papers Track
Saikat Mondal University of Saskatchewan, Chanchal K. Roy University of Saskatchewan
Pre-print
16:15
15m
Accessibility Rank: A Machine Learning Approach for Prioritizing Accessibility User Feedback
Journal First Track
Xiaoqi Chai Beihang University (Work conducted at The University of Auckland), James Tizard University of Auckland, Kelly Blincoe University of Auckland
16:30
15m
Don't Settle for the First! How Many GitHub Copilot Solutions Should You Check?
Journal First Track
Julian Oertel University of Rostock, Jil Klünder University of Applied Sciences | FHDW Hannover, Regina Hebig Universität Rostock, Rostock, Germany
16:45
15m
Adoption of Automated Software Engineering Tools and Techniques in Thailand
Journal First Track
Chaiyong Rakhitwetsagul Mahidol University, Thailand, Jens Krinke University College London, Morakot Choetkiertikul Mahidol University, Thailand, Thanwadee Sunetnanta Mahidol University, Federica Sarro University College London