ICSME 2025
Sun 7 - Fri 12 September 2025 Auckland, New Zealand
Wed 10 Sep 2025 14:50 - 15:00 at Case Room 2 260-057 - Session 4 - Testing 1 Chair(s): Sigrid Eldh

Continuous Integration (CI) has evolved from a tooling strategy to a fundamental mindset in modern CI engineering. It enables teams to develop, test, and deliver software rapidly and collaboratively. Among CI services, GitHub Actions (GHA) has emerged as a dominant service due to its deep integration with GitHub and a vast ecosystem of reusable workflow actions. Although GHA provides official documentation and community-supported best practices, there appears to be limited empirical understanding of how open-source real-world CI workflows align with such practices. Many workflows might be unnecessarily complex and not aligned with the simplicity goals of CI practices. This study will investigate the structure, complexity, heterogeneity, and compliance of GHA workflows in open-source software repositories. Using a large dataset of GHA workflows from Java, Python, and C++ repositories, our goal is to (a) identify workflow complexities, (b) analyze recurring and heterogeneous structuring patterns, (c) assess compliance with GHA best practices, and (d) uncover differences in CI pipeline design across programming languages. Our findings are expected to reveal both areas of strong adherence to best practices and areas for improvement where needed. These insights will also have implications for CI services, as they will highlight the need for clearer guidelines and comprehensive examples in CI documentation.

Wed 10 Sep

Displayed time zone: Auckland, Wellington change

13:30 - 15:00
Session 4 - Testing 1Research Papers Track / Registered Reports / Journal First Track / NIER Track / Industry Track / Tool Demonstration Track at Case Room 2 260-057
Chair(s): Sigrid Eldh Ericsson AB, Mälardalen University, Carleton University
13:30
15m
Performance Testing in Open-Source Web Projects: Adoption, Maintenance, and a Change Taxonomy
Research Papers Track
Sergio Di Meglio Università degli Studi di Napoli Federico II, Luigi Libero Lucio Starace Università degli Studi di Napoli Federico II, Valeria Pontillo Gran Sasso Science Institute, Ruben Opdebeeck Vrije Universiteit Brussel, Coen De Roover Vrije Universiteit Brussel, Sergio Di Martino Università degli Studi di Napoli Federico II
Pre-print
13:45
15m
Harnessing LLMs for Document-Guided Fuzzing of OpenCV Library
Research Papers Track
Bin Duan The University of Queensland, Tarek Mahmud Texas State University, Meiru Che Central Queensland University, Yan Yan University of Illinois Chicago, Naipeng Dong The University of Queensland, Australia, Dan Dongseong Kim The University of Queensland, Guowei Yang University of Queensland
14:00
10m
XTestGen: Natural Language to Maintainable E2E Test Scripts with LLMs
Tool Demonstration Track
Hiroyuki Kirinuki NTT, Masaki Tajima NTT Software Innovation Center, Kei Wakabayashi NTT
File Attached
14:10
10m
Towards Effective Lightweight Test Oracles for Automated Multi-Fault Program RepairOnline
NIER Track
Omar I. Al-Bataineh Gran Sasso Science Institute (GSSI)
14:20
15m
Testing Is Not Boring: Characterizing Challenge in Software Testing Tasks
Industry Track
Davi Gama Hardman CESAR - Recife Center for Advanced Studies and Systems, César França Federal Rural University of Pernambuco (UFRPE), Brody Stuart-Verner University of Calgary, Ronnie de Souza Santos University of Calgary
14:35
15m
Enriching automatic test case generation by extracting relevant test inputs from bug reports
Journal First Track
Wendkuuni Arzouma Marc Christian OUEDRAOGO University of Luxembourg, Laura Plein CISPA Helmholtz Center for Information Security, Abdoul Kader Kaboré University of Luxembourg, Andrew Habib ABB Corporate Research, Germany, Jacques Klein University of Luxembourg, David Lo Singapore Management University, Tegawendé F. Bissyandé University of Luxembourg
14:50
10m
An Empirical Study of Complexity, Heterogeneity, and Compliance of GitHub Actions Workflows
Registered Reports
Edward Abrokwah Department of Computer Science, Trent University, Peterborough, Canada, Taher A. Ghaleb Trent University
Pre-print