ICST 2025
Mon 31 March - Fri 4 April 2025 Naples, Italy
Wed 2 Apr 2025 16:00 - 16:15 at Room A - Software Testing and Fault Analysis Chair(s): Luigi Libero Lucio Starace

Original abstract from Journal article:

A core principle of open science is the clear, concise and accessible publication of empirical data, including “raw” observational data as well as processed results. However, in empirical software engineering there are no established standards (de jure or de facto) for representing and “opening” observations collected in test-driven software experiments — that is, experiments involving the execution of software subjects in controlled scenarios. Execution data is therefore usually represented in ad hoc ways, often making it abstruse and difficult to access without significant manual effort. In this paper we present new data structures designed to address this problem by clearly defining, correlating and representing the stimuli and responses used to execute software subjects in test-driven experiments. To demonstrate their utility, we show how they can be used to promote the repetition, replication and reproduction of experimental evaluations of AI-based code completion tools. We also show how the proposed data structures facilitate the incremental expansion of execution data sets, and thus promote their repurposing for new experiments addressing new research questions.

Wed 2 Apr

Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

16:00 - 17:00
Software Testing and Fault AnalysisJournal-First Papers / Short Papers, Vision and Emerging Results at Room A
Chair(s): Luigi Libero Lucio Starace Università degli Studi di Napoli Federico II
16:00
15m
Talk
Promoting Open Science in Test-driven Software Experiments
Journal-First Papers
Marcus Kessel University of Mannheim, Colin Atkinson University of Mannheim
16:15
15m
Talk
A New Perspective on the Competent Programmer Hypothesis Through the Reproduction of Real Faults With Repeated Mutations
Journal-First Papers
Zaheed Ahmed University of Goettingen, Eike Schwass , Steffen Herbold University of Passau, Fabian Trautsch University of Göttingen, Jens Grabowski
16:30
7m
Talk
Addressing Data Leakage in HumanEval Using Combinatorial Test Design
Short Papers, Vision and Emerging Results
Jeremy Bradbury Ontario Tech University, Riddhi More Ontario Tech University
16:37
7m
Talk
Towards Refined Code Coverage: A New Predictive Problem in Software Testing
Short Papers, Vision and Emerging Results
Carolin Brandt Delft University of Technology, Aurora Ramírez University of Córdoba
Pre-print
16:44
7m
Talk
Weighted Call Frequency-based Fault Localization
Short Papers, Vision and Emerging Results
Attila Szatmári , ORBAN, Aondowase James , Tamás Gergely Department of Software Engineering, University of Szeged
16:51
7m
Talk
Towards Cross-Build Differential Testing
Short Papers, Vision and Emerging Results
Jens Dietrich Victoria University of Wellington, Tim White , Valerio Terragni University of Auckland, Behnaz Hassanshahi Oracle Labs, Australia
:
:
:
: