ICST 2025
Mon 31 March - Fri 4 April 2025 Naples, Italy
Fri 4 Apr 2025 14:30 - 14:45 at Aula Magna (AM) - Test Quality Chair(s): Carolin Brandt

Research in the area of automated test generation has seen remarkable progress in recent years, resulting in several approaches and tools for effective and efficient generation of test cases. In particular, the EvoSuite tool has been at the forefront of this progress embodying various algorithms for automated test generation of Java programs. EvoSuite has been used to generate test cases for a wide variety of programs as well. While there are a number of empirical studies that report results on the effectiveness, in terms of code coverage and other related metrics, of the various test generation strategies and algorithms implemented in EvoSuite, there are no studies, to the best of our knowledge, on the energy consumption associated to the automated test generation. In this paper, we set out to investigate this aspect by measuring the energy consumed by EvoSuite when generating tests. We also measure the energy consumed in the execution of the test cases generated, comparing them with those manually written by developers. The results show that the different test generation algorithms consumed different amounts of energy, in particular on classes with high cyclomatic complexity. Furthermore, we also observe that manual tests tend to consume more energy as compared to automatically generated tests, without necessarily achieving higher code coverage. Our results also give insight into the methods that consume significantly higher levels of energy, indicating potential points of improvement both for EvoSuite as well as the different programs under test.

Fri 4 Apr

Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

14:00 - 15:30
Test QualityResearch Papers / Short Papers, Vision and Emerging Results / Industry at Aula Magna (AM)
Chair(s): Carolin Brandt Delft University of Technology
14:00
15m
Talk
Detecting and evaluating order-dependent flaky tests in JavaScript
Research Papers
Negar Hashemi Massey University, Amjed Tahir Massey University, Shawn Rasheed Universal College of Learning, August Shi The University of Texas at Austin, Rachel Blagojevic Massey University
Pre-print
14:15
15m
Talk
An empirical study of web flaky tests: Understanding and unveiling DOM event interaction challenges
Research Papers
yu pei , Jeongju Sohn Kyungpook National University, Mike Papadakis University of Luxembourg
14:30
15m
Talk
On The Energy Consumption of Test Generation
Research Papers
Fitsum Kifetew Fondazione Bruno Kessler, Davide Prandi Fondazione Bruno Kessler, Angelo Susi Fondazione Bruno Kessler
Pre-print
14:45
7m
Talk
Improving the Comprehensibility of Generated Test Suites Using Test Case Clustering
Short Papers, Vision and Emerging Results
Mitchell Olsthoorn Delft University of Technology
14:52
7m
Talk
Harnessing Test Call Structures for Improved Fault Localization Effectiveness
Short Papers, Vision and Emerging Results
14:59
7m
Talk
Batch Execution of Microbenchmarks for Efficient Performance Testing
Short Papers, Vision and Emerging Results
Mostafa Jangali Concordia University, Kundi Yao University of Waterloo, Yiming Tang Rochester Institute of Technology, Diego Elias Costa Concordia University, Canada, Weiyi Shang University of Waterloo
15:06
15m
Talk
A Tale from the Trenches: Applying Metamorphic and Differential Testing to Bioinformatics Software
Industry
Alexis L. Marsh Iowa State University, Myra Cohen Iowa State University, Robert Cottingham Oak Ridge National Laboratory
:
:
:
: