ICSE 2024
Fri 12 - Sun 21 April 2024 Lisbon, Portugal
Wed 17 Apr 2024 12:00 - 12:15 at Eugénio de Andrade - Testing 1 Chair(s): Ajitha Rajan

Developers often use crash reports to understand the root cause of bugs. However, locating the buggy source code snippet from such information is a challenging task, mainly when the log database contains many crash reports. To mitigate this issue, recent research has proposed and evaluated approaches for grouping crash report data and using stack trace information to locate bugs. The effectiveness of such approaches has been evaluated by mainly comparing the candidate buggy code snippets with the actual changed code in bug-fix commits—which happens in the context of retrospective repository mining studies. Therefore, the existing literature still lacks discussing the use of such approaches in the daily life of a software company, which could explain the developers’ perceptions on the use of these approaches. In this paper, we report our experience of using an approach for grouping crash reports and finding buggy code on a weekly basis for 18 months, within three development teams in a software company. We grouped over 750,000 crash reports, opened over 130 issues, and collected feedback from 18 developers and team leaders. Among other results, we observe that the amount of system logs related to a crash report group is not the only criteria developers use to choose a candidate bug to be analyzed. Instead, other factors were considered, such as the need to deliver customer-prioritized features and the difficulty of solving complex crash reports (e.g., architectural debts), to cite some. The approach investigated in this study correctly suggested the buggy file most of the time—the approach’s precision was around 80%. In this study, the developers also shared their perspectives on the usefulness of the suspicious files and methods extracted from crash reports to fix related bugs.

Wed 17 Apr

Displayed time zone: Lisbon change

11:00 - 12:30
11:00
15m
Talk
A First Look at the Inheritance-Induced Redundant Test Execution
Research Track
Dong Jae Kim Concordia University, Jinqiu Yang Concordia University, Tse-Hsun (Peter) Chen Concordia University
11:15
15m
Talk
Hypertesting of Programs: Theoretical Foundation and Automated Test Generation
Research Track
Michele Pasqua University of Verona, Mariano Ceccato University of Verona, Paolo Tonella USI Lugano
Pre-print
11:30
15m
Talk
Gamifying a Software Testing Course with Continuous Integration
Software Engineering Education and Training
Philipp Straubinger University of Passau, Gordon Fraser University of Passau
Pre-print
11:45
15m
Talk
Enhancing Testing at Meta with Rich-State Simulated Populations
Software Engineering in Practice
Kinga Bojarczuk Meta, Mark Harman Meta Platforms, Inc. and UCL, Nadia Alshahwan Meta Platforms, Arianna Blasi Meta Platforms, Inc., Andrea Ciancone Meta, Natalija Gucevska Meta, Michal Krolikowski Meta, Rubmary Rojas Meta, Dragos Martac Meta, Simon Schellaert Meta, Kate Ustiuzhanina Meta, Inna Harper Meta, Yue Jia Meta, Will Lewis Meta
12:00
15m
Talk
The Impact Of Bug Localization Based on Crash Report Mining: A Developers' Perspective
Software Engineering in Practice
Marcos Medeiros Federal University of Rio Grande do Norte, Uirá Kulesza Federal University of Rio Grande do Norte, Roberta Coelho , Rodrigo Bonifácio Computer Science Department - University of Brasília, Christoph Treude Singapore Management University, Eiji Adachi Barbosa Federal University of Rio Grande do Norte (UFRN)
Pre-print
12:15
7m
Talk
Stress Testing Control Loops in Cyber-Physical Systems
Journal-first Papers
Claudio Mandrioli University of Luxembourg, Seung Yeob Shin University of Luxembourg, Martina Maggio Saarland University, Germany / Lund University, Sweden, Domenico Bianculli University of Luxembourg, Lionel Briand University of Ottawa, Canada; Lero centre, University of Limerick, Ireland
Pre-print