ICST 2025 - Research Papers

The Research Papers track of ICST 2025 invites high-quality submissions in all areas of software testing, verification, and validation. Papers for the research track should present novel and original work that advances the state-of-the-art. Case studies and empirical research papers are also welcome. For more information, check out the Call for Papers.

Time Zone

The program is currently displayed in (GMT+02:00) Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna.

Use conference time zone: (GMT+02:00) Amsterdam, Berlin, Bern, Rome, Stockholm, ViennaSelect other time zone

The GMT offsets shown reflect the offsets at the moment of the conference.

Time Band

By setting a time band, the program will dim events that are outside this time window. This is useful for (virtual) conferences with a continuous program (with repeated sessions).
The time band will also limit the events that are included in the personal iCalendar subscription service.

Display full programSpecify a time band

Save

You're viewing the program in a time zone which is different from your device's time zone change time zone

Wed 2 Apr
Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

10:30 - 11:00	BreakSocial at Buffet Area

10:30 30m Coffee break		Break Social

11:00 - 12:30	LLMs in TestingResearch Papers / Industry / Journal-First Papers at Aula Magna (AM) Chair(s): Phil McMinn University of Sheffield

11:00 15m Talk		AugmenTest: Enhancing Tests with LLM-driven Oracles Research Papers Shaker Mahmud Khandaker Fondazione Bruno Kessler, Fitsum Kifetew Fondazione Bruno Kessler, Davide Prandi Fondazione Bruno Kessler, Angelo Susi Fondazione Bruno Kessler Pre-print
11:15 15m Talk		Impact of Large Language Models of Code on Fault Localization Research Papers Suhwan Ji Yonsei University, Sanghwa Lee Kangwon National University, Changsup Lee Kangwon National University, Yo-Sub Han Yonsei University, Hyeonseung Im Kangwon National University, South Korea
11:30 15m Talk		An Analysis of LLM Fine-Tuning and Few-Shot Learning for Flaky Test Detection and Classification Research Papers Riddhi More Ontario Tech University, Jeremy Bradbury Ontario Tech University
11:45 15m Talk		Evaluating the Effectiveness of LLMs in Detecting Security Vulnerabilities Research Papers Avishree Khare , Saikat Dutta Cornell University, Ziyang Li University of Pennsylvania, Alaia Solko-Breslin University of Pennsylvania, Mayur Naik UPenn, Rajeev Alur University of Pennsylvania
12:00 15m Talk		FlakyFix: Using Large Language Models for Predicting Flaky Test Fix Categories and Test Code Repair Journal-First Papers Sakina Fatima University of Ottawa, Hadi Hemmati York University, Lionel Briand University of Ottawa, Canada; Lero centre, University of Limerick, Ireland
12:15 15m Talk		Integrating LLM-based Text Generation with Dynamic Context Retrieval for GUI Testing Industry Juyeon Yoon Korea Advanced Institute of Science and Technology, Seah Kim Samsung Research, Somin Kim Korea Advanced Institute of Science and Technology, Sukchul Jung Samsung Research, Shin Yoo KAIST

11:00 - 12:30	Testing, Localisation and RepairJournal-First Papers / Research Papers / Industry at Room A Chair(s): Shin Yoo KAIST

11:00 15m Talk		A Taxonomy of Integration-relevant Faults for Microservice Testing Research Papers Lena Gregor Technical University of Munich, Anja Hentschel Siemens AG, Leon Kastner Technical University of Munich, Alexander Pretschner TU Munich Pre-print
11:15 15m Talk		Suspicious Types and Bad Neighborhoods- Filtering Spectra with Compiler Information Research Papers Leonhard Applis Delft University of Technology, Matthías Páll Gissurarson Chalmers University of Technology, Sweden, Annibale Panichella Delft University of Technology
11:30 15m Talk		Summary of Automated Program Repair for Variability Bugs in Software Product Line Systems Journal-First Papers Thu-Trang Nguyen , Xiao-Yi Zhang University of Science and Technology Beijing, Paolo Arcaini National Institute of Informatics , Fuyuki Ishikawa National Institute of Informatics, Hieu Vo VNU University of Engineering and Technology Link to publication DOI
11:45 15m Talk		Automated Engineering of Domain-Specific Metamorphic Testing Environments Journal-First Papers Pablo Gómez-Abajo Universidad Autónoma de Madrid, Pablo C Canizares Autonomous University of Madrid, Spain, Alberto Núňez University Complutense of Madrid, Spain., Esther Guerra Universidad Autónoma de Madrid, Juan de Lara Autonomous University of Madrid Link to publication DOI
12:00 15m Talk		Speculative Testing at Google with Transition Prediction Industry Avi Kondareddy Google, Sushmita Azad Google, Abhayendra Singh Google, Inc, Tim A. D. Henderson Google Link to publication Pre-print
12:15 15m Talk		Challenges, Strategies, and Impacts: A Qualitative Study on UI Testing in CI/CD Processes from GitHub Developers’ Perspectives Research Papers XIAOXIAO GAN Virginia Tech, Huayu Liang Virginia Tech, Chris Brown Virginia Tech

11:00 - 12:30	Fuzzing and SecurityResearch Papers / Industry / Journal-First Papers at Room A1 Chair(s): Serge Demeyer University of Antwerp and Flanders Make vzw

11:00 15m Talk		SPIDER: Fuzzing for Stateful Performance Issues in the ONOS Software-Defined Network Controller Research Papers Ao Li Carnegie Mellon University, Rohan Padhye Carnegie Mellon University, Vyas Sekar Carnegie Mellon University
11:15 15m Talk		Mutation-based Fuzzing of the Swift Compiler With Incomplete Type Information Research Papers Sarah Canto Hyatt University of California, Santa Barbara, Kyle Dewey California State University, Northridge
11:30 15m Talk		Scalable SMT Sampling for Floating-point Formulas via Coverage-guided Fuzzing Research Papers Manuel Carrasco Imperial College London, Cristian Cadar Imperial College London, Alastair F. Donaldson Imperial College London
11:45 15m Talk		Introducing Black-Box Fuzz Testing for REST APIs in Industry: Challenges and Solutions Industry Andrea Arcuri Kristiania University College and Oslo Metropolitan University, Alexander Poth Volkswagen AG, Olsi Rrjolli Volkswagen AG
12:00 15m Talk		Compiler Fuzzing in Continuous Integration: a Case Study on Dafny Industry Karnbongkot Boonriong Imperial College London, Stefan Zetzsche Amazon Web Services, Alastair F. Donaldson Imperial College London
12:15 15m Talk		Automated SC-MCC Test Case Generation using Coverage Guided Fuzzing Journal-First Papers Golla Monika Rani , Sangharatna Godboley National Institute of Technology Warangal

12:30 - 14:00	LunchSocial at Room A3

12:30 90m Lunch		Lunch Social

14:00 - 15:30	Test OracleJournal-First Papers / Research Papers / Industry at Aula Magna (AM) Chair(s): Mike Papadakis University of Luxembourg

14:00 15m Talk		Differential Testing of Concurrent Classes Research Papers Valerio Terragni University of Auckland, Shing-Chi Cheung Hong Kong University of Science and Technology
14:15 15m Talk		Hybrid Equivalence/Non-Equivalence Testing Research Papers Laboni Sarker University of California at Santa Barbara, Tevfik Bultan University of California at Santa Barbara
14:30 15m Talk		Metamorphic Testing for Pose Estimation Systems Research Papers Matias Duran Trinity College Dublin, Ireland, Thomas Laurent Lero@Trinity College Dublin, Ellen Rushe School of Computing Dublin City University, Anthony Ventresque Trinity College Dublin & Lero, Ireland
14:45 15m Talk		Mutation-Guided Metamorphic Testing of Optimality in AI Planning Journal-First Papers Quentin Mazouni Simula Research Laboratory, Arnaud Gotlieb Simula Research Laboratory, Helge Spieker Simula Research Laboratory, Mathieu Acher University of Rennes - Inria - CNRS - IRISA, Benoit Combemale University of Rennes, Inria, CNRS, IRISA Link to publication DOI
15:00 15m Talk		LLMs in the Heart of Differential Testing: A Case Study on a Medical Rule Engine Industry Erblin Isaku Simula Research Laboratory, and University of Oslo (UiO), Christoph Laaber Simula Research Laboratory, Hassan Sartaj Simula Research Laboratory, Shaukat Ali Simula Research Laboratory and Oslo Metropolitan University, Thomas Schwitalla Cancer Registry of Norway, Jan F. Nygård Cancer Registry of Norway

14:00 - 15:30	Insights from IndustryIndustry at Room A Chair(s): Tim A. D. Henderson Google

14:00 15m Talk		Accessible Smart Contracts Verification: Synthesizing Formal Models with Tamed LLMs Industry Jan Corazza TU Dortmund University, Ivan Gavran Informal Systems, Gabriela Moreira Informal Systems, Danel Neider TU Dortmund University
14:15 15m Talk		Evaluation of the Choice of LLM in a Multi-agent solution for GUI-test Generation Industry Stevan Tomic Blekinge Institute of Technology, Emil Alégroth Blekinge Institute of Technology, Maycel Isaac Synteda
14:30 15m Talk		Assessing the Uncertainty and Robustness of the Laptop Refurbishing Software Industry Chengjie Lu Simula Research Laboratory and University of Oslo, Jiahui Wu Simula Research Laboratory and University of Oslo, Shaukat Ali Simula Research Laboratory and Oslo Metropolitan University, Mikkel Labori Olsen Danish Technological Institute
14:45 15m Talk		FuzzE, Development of a Fuzzing Approach for Odoo's Tours Integration Testing Plateform Industry Gabriel Benoit University of Namur, François Georis Odoo S.A., Géry Debongnie Odoo S.A., Benoît Vanderose University of Namur, Xavier Devroey University of Namur Pre-print
15:00 15m Talk		Early V&V in Knowledge-Centric Systems Engineering: Advances and Benefits in Practice Industry Jose Luis de la Vara Universidad de Castilla - La Mancha, Juan Manuel Morote Independent Researcher, Clara Ayora Universidad de Castilla-La Mancha, Giovanni Giachetti Universidad Andrés Bello Chile, Luis Alonso The REUSE Company, Roy Mendieta The REUSE Company, David Muñoz The REUSE Company, Ricardo Ruiz Nolasco RGB Medical Devices, Antonio González RGB Medical Devices S.A.
15:15 15m Talk		Practical Pipeline-Aware Regression Test Optimization for Continuous Integration Industry Daniel Schwendner BMW Group, Maximilian Jungwirth BMW Group, University of Passau, Martin Gruber BMW Group, Martin Knoche BMW Group, Daniel Merget BMW Group, Gordon Fraser University of Passau

14:00 - 15:30	EducationEducation at Room A1 Chair(s): Dietmar Pfahl University of Tartu

14:00 15m Talk		Can Test Generation and Program Repair Inform Automated Assessment of Programming Projects? Education Ruizhen Gu University of Sheffield, José Miguel Rojas University of Sheffield, Donghwan Shin University of Sheffield Pre-print
14:15 15m Talk		Combining Logic and Large Language Models for Assisted Debugging and Repair of ASP Programs Education Ricardo Brancas INESC-ID, Instituto Superior Técnico, Vasco Manquinho INESC-ID; Universidade de Lisboa, Ruben Martins Carnegie Mellon University Pre-print
14:30 15m Talk		Experience Report on using Experiential Learning to Facilitate Learning of Bug Investigation Steps Education Adina Moldovan Altom, Oana Casapu Altom, Andreea Vescan Babes-Bolyai University
14:45 15m Talk		Requirements for an Automated Assessment Tool for Learning Programming by Doing Education Arthur Rump University of Twente, Vadim Zaytsev University of Twente, Netherlands, Angelika Mader University of Twente Pre-print
15:00 15m Talk		Teaching Bug Advocacy through Flipped Classroom Education Andreea Galbin-Nasui Babes-Bolyai University, Cluj-Napoca, Andreea Vescan Babes-Bolyai University
15:15 15m Talk		A System-Level Testing Framework for Automated Assessment of Programming Assignments Allowing Students Object-Oriented Design Freedom Education Valerio Terragni University of Auckland, Nasser Giacaman The University of Auckland

15:30 - 16:00	BreakSocial at Buffet Area

15:30 30m Coffee break		Break Social

16:00 - 17:00	Test Case Selection, Prioritisation, ReductionResearch Papers / Industry at Aula Magna (AM) Chair(s): Andrea Stocco Technical University of Munich, fortiss

16:00 15m Talk		The Impact of List Reduction for Language Agnostic Test Case Reducers Research Papers Tobias Heineken Friedrich-Alexander-Universität Erlangen-Nürnberg, Michael Philippsen Friedrich-Alexander Universität Erlangen-Nürnberg (FAU), Programming Systems Group
16:15 15m Talk		RustyRTS: Regression Test Selection for Rust Research Papers Simon Hundsdorfer Technical University of Munich, Roland Würsching Technical University of Munich, Alexander Pretschner TU Munich
16:30 15m Talk		ML-Based Test Case Prioritization: A Research and Production Perspective in CI Environments Industry Md Asif Khan Ontario Tech University, Akramul Azim Ontario Tech University, Ramiro Liscano Ontario Tech University, Kevin Smith International Business Machines Corporation (IBM), Yee-Kang Chang International Business Machines Corporation (IBM), Gkerta Seferi International Business Machines Corporation (IBM), Qasim Tauseef International Business Machines Corporation (IBM)
16:45 15m Talk		Evaluating Machine Learning-Based Test Case Prioritization in the Real World: An Experiment with SAP HANA Industry Jeongki Son SAP Labs Korea, Gabin An KAIST, Jingun Hong SAP Labs, Shin Yoo KAIST

16:00 - 17:00	Software Testing and Fault AnalysisJournal-First Papers / Short Papers, Vision and Emerging Results at Room A Chair(s): Luigi Libero Lucio Starace Università degli Studi di Napoli Federico II

16:00 15m Talk		Promoting Open Science in Test-driven Software Experiments Journal-First Papers Marcus Kessel University of Mannheim, Colin Atkinson University of Mannheim
16:15 15m Talk		A New Perspective on the Competent Programmer Hypothesis Through the Reproduction of Real Faults With Repeated Mutations Journal-First Papers Zaheed Ahmed University of Goettingen, Eike Schwass , Steffen Herbold University of Passau, Fabian Trautsch University of Göttingen, Jens Grabowski
16:30 7m Talk		Addressing Data Leakage in HumanEval Using Combinatorial Test Design Short Papers, Vision and Emerging Results Jeremy Bradbury Ontario Tech University, Riddhi More Ontario Tech University
16:37 7m Talk		Towards Refined Code Coverage: A New Predictive Problem in Software Testing Short Papers, Vision and Emerging Results Carolin Brandt Delft University of Technology, Aurora Ramírez University of Córdoba Pre-print
16:44 7m Talk		Weighted Call Frequency-based Fault Localization Short Papers, Vision and Emerging Results Attila Szatmári , ORBAN, Aondowase James , Tamás Gergely Department of Software Engineering, University of Szeged
16:51 7m Talk		Towards Cross-Build Differential Testing Short Papers, Vision and Emerging Results Jens Dietrich Victoria University of Wellington, Tim White , Valerio Terragni University of Auckland, Behnaz Hassanshahi Oracle Labs, Australia

17:00 - 18:00	Open Steering Committee MeetingSocial at Aula Magna (AM)

17:00 60m Social Event		Open Steering Committee Meeting Social

Thu 3 Apr
Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

10:30 - 11:00	BreakSocial at Buffet Area

10:30 30m Coffee break		Break Social

11:00 - 12:30	Testing ML Systems and Fault LocalisationIndustry / Research Papers at Aula Magna (AM) Chair(s): Atif Memon Apple

11:00 15m Talk		On Accelerating Deep Neural Network Mutation Analysis by Neuron and Mutant Clustering Research Papers Lauren Lyons Auburn University, Ali Ghanbari Auburn University Pre-print
11:15 15m Talk		Benchmarking Image Perturbations for Testing Automated Driving Assistance Systems Research Papers Stefano Carlo Lambertenghi Technische Universität München, fortiss GmbH, Hannes Leonhard Technical University of Munich, Andrea Stocco Technical University of Munich, fortiss Pre-print
11:30 15m Talk		Turbulence: Systematically and Automatically Testing Instruction-Tuned Large Language Models for Code Research Papers Shahin Honarvar Imperial College London, Mark van der Wilk University of Oxford, Alastair F. Donaldson Imperial College London
11:45 15m Talk		Taming Uncertainty for Critical Scenario Generation in Automated Driving Industry Selma Grosse DENSO Automotive GmbH, Dejan Nickovic Austrian Institute of Technology, Cristinel Mateis AIT Austrian Institute of Technology GmbH, Alessio Gambi Austrian Institute of Technology (AIT), Adam Molin DENSO AUTOMOTIVE
12:00 15m Talk		Multi-Project Just-in-Time Software Defect Prediction Based on Multi-Task Learning for Mobile Applications Research Papers Feng Chen Chongqing University of Posts and Telecommunications, Ke Yuxin Chongqing University of Posts and Telecommunications, Liu Xin Chongqing University of Posts and Telecommunications, Wei Qingjie Chongqing University of Posts and Telecommunications
12:15 15m Talk		Fault Localization via Fine-tuning Large Language Models with Mutation Generated Stack Traces Industry Neetha Jambigi University of Cologne, Bartosz Bogacz SAP SE, Moritz Mueller SAP SE, Thomas Bach SAP, Michael Felderer German Aerospace Center (DLR) & University of Cologne

11:00 - 12:22	LLMs in TestingResearch Papers / Short Papers, Vision and Emerging Results at Room A Chair(s): Valerio Terragni University of Auckland

11:00 15m Talk		Improving the Readability of Automatically Generated Tests using Large Language Models Research Papers Matteo Biagiola Università della Svizzera italiana, Gianluca Ghislotti Università della Svizzera italiana, Paolo Tonella USI Lugano
11:15 15m Talk		Test Wars: A Comparative Study of SBST, Symbolic Execution, and LLM-Based Approaches to Unit Test Generation Research Papers Azat Abdullin JetBrains Research, TU Delft, Pouria Derakhshanfar JetBrains Research, Annibale Panichella Delft University of Technology
11:30 15m Talk		Benchmarking Open-source Large Language Models For Log Level Suggestion Research Papers Yi Wen HENG Concordia University, Zeyang Ma Concordia University, Zhenhao Li York University, Dong Jae Kim DePaul University, Tse-Hsun (Peter) Chen Concordia University
11:45 15m Talk		Understanding and Enhancing Attribute Prioritization in Fixing Web UI Tests with LLMs Research Papers Zhuolin Xu Concordia University, Qiushi Li Concordia University, Shin Hwei Tan Concordia University
12:00 15m Talk		Benchmarking Generative AI Models for Deep Learning Test Input Generation Research Papers Maryam Maryam University of Udine, Matteo Biagiola Università della Svizzera italiana, Andrea Stocco Technical University of Munich, fortiss, Vincenzo Riccio University of Udine Pre-print
12:15 7m Talk		Leveraging Large Language Models for Explicit Wait Management in End-to-End Web Testing Short Papers, Vision and Emerging Results Dario Olianas DIBRIS, University of Genova, Italy, Maurizio Leotta DIBRIS, University of Genova, Italy, Filippo Ricca Università di Genova

11:00 - 12:30	Testing Tools and Data ShowcaseTesting Tools and Data Showcase at Room A1 Chair(s): Domenico Bianculli University of Luxembourg

11:00 15m Talk		Rocket: A System-Level Fuzz-Testing Framework for the XRPL Consensus Algorithm Testing Tools and Data Showcase Wishaal Kanhai , Ivar van Loon , Yuraj Mangalgi , Thijs van der Valk , Lucas Witte Delft University of Technology, Annibale Panichella Delft University of Technology, Mitchell Olsthoorn Delft University of Technology, Burcu Kulahcioglu Ozkan Delft University of Technology
11:15 15m Talk		RESTgym: A Flexible Infrastructure for Empirical Assessment of Automated REST API Testing Tools Testing Tools and Data Showcase Davide Corradini University of Luxembourg, Michele Pasqua University of Verona, Mariano Ceccato University of Verona
11:30 15m Talk		ViMoTest: A Tool to Specify ViewModel-based GUI Test Scenarios using Projectional Editing Testing Tools and Data Showcase Mario Fuksa University of Stuttgart, Sandro Speth Institute of Software Engineering, University of Stuttgart, Steffen Becker University of Stuttgart
11:45 15m Talk		E2E-Loader: A Tool to Generate Performance Tests from End-to-End GUI-level Tests Testing Tools and Data Showcase Sergio Di Meglio Università degli Studi di Napoli Federico II, Luigi Libero Lucio Starace Università degli Studi di Napoli Federico II, Sergio Di Martino Università degli Studi di Napoli Federico II
12:00 15m Talk		AMBER: AI-enabled Java Microbenchmark Harness Testing Tools and Data Showcase Antonio Trovato University of Salerno, Luca Traini University of L'Aquila, Federico Di Menna University of L'Aquila, Dario Di Nucci University of Salerno Pre-print
12:15 15m Talk		Codehacks: A Dataset of Adversarial Tests For Competitive Programming Problems Obtained From Codeforces Testing Tools and Data Showcase Max Hort Simula Research Laboratory, Leon Moonen Simula Research Laboratory

12:30 - 14:00	LunchSocial at Room A3

12:30 90m Lunch		Lunch Social

Fri 4 Apr
Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

09:00 - 10:30	Awards & Most Influential PaperSocial at Aula Magna (AM) & A1 (streaming) Chair(s): Aldeida Aleti Monash University, Ali Mesbah University of British Columbia

09:00 30m Awards		Awards Social
09:30 60m Awards		Most Influential Paper Social

10:30 - 11:00	BreakSocial at Buffet Area

10:30 30m Coffee break		Break Social

11:00 - 12:30	Automated TestingIndustry / Research Papers / Journal-First Papers / Education at Aula Magna (AM) Chair(s): Cristian Cadar Imperial College London

11:00 15m Talk		Testing Practices, Challenges, and Developer Perspectives in Open-Source IoT Platforms Research Papers Daniel Rodriguez-Cardenas William & Mary, Safwat Ali Khan George Mason University, Prianka Mandal William & Mary, Adwait Nadkarni William & Mary, Kevin Moran University of Central Florida, Denys Poshyvanyk William & Mary Pre-print
11:15 15m Talk		Many-Objective Neuroevolution for Testing Games Research Papers Patric Feldmeier University of Passau, Katrin Schmelz University of Passau, Gordon Fraser University of Passau Pre-print
11:30 15m Talk		Black-Box Testing for Practitioners Education Matthias Hamburg IEEE Computer Society; International Software Testing Qualifications Board, Adam Roman Jagiellonian University, Faculty of Mathematics and Computer Science; International Software Testing Qualifications Board
11:45 15m Talk		CUBETESTERAI: Automated JUnit Test Generation using the LLaMA Model Industry Daniele Gorla Department of Computer Science, Sapienza University of Rome, Shivam Kumar , Pietro Nicolaus Roselli Lorenzini , Alireza Alipourfaz
12:00 15m Talk		Can Search-Based Testing with Pareto Optimization Effectively Cover Failure-Revealing Test Inputs? Journal-First Papers Lev Sorokin Technische Universität München, Germany, Damir Safin fortiss, Shiva Nejati University of Ottawa
12:15 15m Talk		[prerecorded] ADGE: Automated Directed GUI Explorer for Android Applications Research Papers Yue Jiang Institute of Information Engineering, Chinese Academy of Sciences, Beijing, China, Xiaobo Xiang Singular Security Lab, Beijing, China, Qingli Guo Institute of Information Engineering, Chinese Academy of Sciences, Qi Gong Key Laboratory of Network Assessment Technology, Institute of Information Engineering, Chinese Academy of Sciences, China, Xiaorui Gong Institute of Information Engineering, Chinese Academy of Science

12:30 - 14:00	LunchSocial at Room A3

12:30 90m Lunch		Lunch Social

14:00 - 15:30	Test QualityResearch Papers / Short Papers, Vision and Emerging Results / Industry at Aula Magna (AM) Chair(s): Carolin Brandt Delft University of Technology

14:00 15m Talk		Detecting and evaluating order-dependent flaky tests in JavaScript Research Papers Negar Hashemi Massey University, Amjed Tahir Massey University, Shawn Rasheed Universal College of Learning, August Shi The University of Texas at Austin, Rachel Blagojevic Massey University Pre-print
14:15 15m Talk		An empirical study of web flaky tests: Understanding and unveiling DOM event interaction challenges Research Papers yu pei , Jeongju Sohn Kyungpook National University, Mike Papadakis University of Luxembourg
14:30 15m Talk		On The Energy Consumption of Test Generation Research Papers Fitsum Kifetew Fondazione Bruno Kessler, Davide Prandi Fondazione Bruno Kessler, Angelo Susi Fondazione Bruno Kessler Pre-print
14:45 7m Talk		Improving the Comprehensibility of Generated Test Suites Using Test Case Clustering Short Papers, Vision and Emerging Results Mitchell Olsthoorn Delft University of Technology
14:52 7m Talk		Harnessing Test Call Structures for Improved Fault Localization Effectiveness Short Papers, Vision and Emerging Results Attila Szatmári
14:59 7m Talk		Batch Execution of Microbenchmarks for Efficient Performance Testing Short Papers, Vision and Emerging Results Mostafa Jangali Concordia University, Kundi Yao University of Waterloo, Yiming Tang Rochester Institute of Technology, Diego Elias Costa Concordia University, Canada, Weiyi Shang University of Waterloo
15:06 15m Talk		A Tale from the Trenches: Applying Metamorphic and Differential Testing to Bioinformatics Software Industry Alexis L. Marsh Iowa State University, Myra Cohen Iowa State University, Robert Cottingham Oak Ridge National Laboratory

14:00 - 15:28	Advances in Software TestingResearch Papers / Short Papers, Vision and Emerging Results / Industry / Education at Room A1 Chair(s): Annibale Panichella Delft University of Technology

14:00 15m Talk		Code, Test and Coverage Evolution in Mature Software Systems: Changes over the Past Decade Research Papers Thomas Bailey Imperial College London, Cristian Cadar Imperial College London
14:15 15m Talk		Coverage Metrics for T-Wise Feature Interactions Research Papers Sabrina Böhm University of Ulm, Germany, Tim Jannik Schmidt University of Ulm, TU Braunschweig, Germany, Sebastian Krieter TU Braunschweig, Germany, Tobias Pett Karlsruhe Institute for Technology (KIT), Germany, Thomas Thüm TU Braunschweig, Germany, Malte Lochau University of Siegen
14:30 15m Talk		LLM-based Labelling of Recorded Automated GUI-based Test cases Industry Diogo Buarque Franzosi Blekinge Institute of Technology, Emil Alégroth Blekinge Institute of Technology, Maycel Isaac Synteda
14:45 15m Talk		A Tool-assisted Training Approach for Empowering Localization and Internationalization Testing Proficiency Education Maria Couto Federal University of Pernambuco, Breno Miranda Centro de Informática at Universidade Federal de Pernambuco, Kiev Gama Universidade Federal de Pernambuco
15:00 7m Short-paper		Pre-trained Models for Bytecode Instructions Short Papers, Vision and Emerging Results Donggyu Kim Handong Global University, Taemin Kim Handong Global University, Jiho Shin York University, Song Wang York University, Heeyoul Choi , Jaechang Nam Handong Global University Pre-print
15:07 7m Short-paper		EnCus: Customizing Search Space for Automated Program Repair Short Papers, Vision and Emerging Results Seongbin Kim , Sechang Jang , Jindae Kim Seoul National University of Science and Technology, Jaechang Nam Handong Global University Pre-print
15:14 7m Talk		Test Generation from Use Case Specifications for IoT Systems: Custom, LLM-Based, and Hybrid Approaches Short Papers, Vision and Emerging Results Zacharie Chenail-Larcher École de technologie supérieure (ÉTS), Jean Baptiste Minani Concordia University, Montreal, Canada, Naouel Moha École de Technologie Supérieure (ETS)

15:30 - 16:00	BreakSocial at Buffet Area

15:30 30m Coffee break		Break Social

16:00 - 16:30	ClosingSocial at Aula Magna (AM) & A1 (streaming)

16:00 30m Social Event		Closing Social

Accepted Papers

	Title
	An Analysis of LLM Fine-Tuning and Few-Shot Learning for Flaky Test Detection and Classification Research Papers Riddhi More, Jeremy Bradbury
	An empirical study of web flaky tests: Understanding and unveiling DOM event interaction challenges Research Papers yu pei, Jeongju Sohn, Mike Papadakis
	A Taxonomy of Integration-relevant Faults for Microservice Testing Research Papers Lena Gregor, Anja Hentschel, Leon Kastner, Alexander Pretschner Pre-print
	AugmenTest: Enhancing Tests with LLM-driven Oracles Research Papers Shaker Mahmud Khandaker, Fitsum Kifetew, Davide Prandi, Angelo Susi Pre-print
	Benchmarking Generative AI Models for Deep Learning Test Input Generation Research Papers Maryam Maryam, Matteo Biagiola, Andrea Stocco, Vincenzo Riccio Pre-print
	Benchmarking Image Perturbations for Testing Automated Driving Assistance Systems Research Papers Stefano Carlo Lambertenghi, Hannes Leonhard, Andrea Stocco Pre-print
	Benchmarking Open-source Large Language Models For Log Level Suggestion Research Papers Yi Wen HENG, Zeyang Ma, Zhenhao Li, Dong Jae Kim, Tse-Hsun (Peter) Chen
	Challenges, Strategies, and Impacts: A Qualitative Study on UI Testing in CI/CD Processes from GitHub Developers’ Perspectives Research Papers XIAOXIAO GAN, Huayu Liang, Chris Brown
	Code, Test and Coverage Evolution in Mature Software Systems: Changes over the Past Decade Research Papers Thomas Bailey, Cristian Cadar
	Coverage Metrics for T-Wise Feature Interactions Research Papers Sabrina Böhm, Tim Jannik Schmidt, Sebastian Krieter, Tobias Pett, Thomas Thüm, Malte Lochau
	Detecting and evaluating order-dependent flaky tests in JavaScript Research Papers Negar Hashemi, Amjed Tahir, Shawn Rasheed, August Shi, Rachel Blagojevic Pre-print
	Differential Testing of Concurrent Classes Research Papers Valerio Terragni, Shing-Chi Cheung
	Evaluating the Effectiveness of LLMs in Detecting Security Vulnerabilities Research Papers Avishree Khare, Saikat Dutta, Ziyang Li, Alaia Solko-Breslin, Mayur Naik, Rajeev Alur
	Hybrid Equivalence/Non-Equivalence Testing Research Papers Laboni Sarker, Tevfik Bultan
	Impact of Large Language Models of Code on Fault Localization Research Papers Suhwan Ji, Sanghwa Lee, Changsup Lee, Yo-Sub Han, Hyeonseung Im
	Improving the Readability of Automatically Generated Tests using Large Language Models Research Papers Matteo Biagiola, Gianluca Ghislotti, Paolo Tonella
	Many-Objective Neuroevolution for Testing Games Research Papers Patric Feldmeier, Katrin Schmelz, Gordon Fraser Pre-print
	Metamorphic Testing for Pose Estimation Systems Research Papers Matias Duran, Thomas Laurent, Ellen Rushe, Anthony Ventresque
	Multi-Project Just-in-Time Software Defect Prediction Based on Multi-Task Learning for Mobile Applications Research Papers Feng Chen, Ke Yuxin, Liu Xin, Wei Qingjie
	Mutation-based Fuzzing of the Swift Compiler With Incomplete Type Information Research Papers Sarah Canto Hyatt, Kyle Dewey
	On Accelerating Deep Neural Network Mutation Analysis by Neuron and Mutant Clustering Research Papers Lauren Lyons, Ali Ghanbari Pre-print
	On The Energy Consumption of Test Generation Research Papers Fitsum Kifetew, Davide Prandi, Angelo Susi Pre-print
	[prerecorded] ADGE: Automated Directed GUI Explorer for Android Applications Research Papers Yue Jiang, Xiaobo Xiang, Qingli Guo, Qi Gong, Xiaorui Gong
	RustyRTS: Regression Test Selection for Rust Research Papers Simon Hundsdorfer, Roland Würsching, Alexander Pretschner
	Scalable SMT Sampling for Floating-point Formulas via Coverage-guided Fuzzing Research Papers Manuel Carrasco, Cristian Cadar, Alastair F. Donaldson
	SPIDER: Fuzzing for Stateful Performance Issues in the ONOS Software-Defined Network Controller Research Papers Ao Li, Rohan Padhye, Vyas Sekar
	Suspicious Types and Bad Neighborhoods- Filtering Spectra with Compiler Information Research Papers Leonhard Applis, Matthías Páll Gissurarson, Annibale Panichella
	Testing Practices, Challenges, and Developer Perspectives in Open-Source IoT Platforms Research Papers Daniel Rodriguez-Cardenas, Safwat Ali Khan, Prianka Mandal, Adwait Nadkarni, Kevin Moran, Denys Poshyvanyk Pre-print
	Test Wars: A Comparative Study of SBST, Symbolic Execution, and LLM-Based Approaches to Unit Test Generation Research Papers Azat Abdullin, Pouria Derakhshanfar, Annibale Panichella
	The Impact of List Reduction for Language Agnostic Test Case Reducers Research Papers Tobias Heineken, Michael Philippsen
	Turbulence: Systematically and Automatically Testing Instruction-Tuned Large Language Models for Code Research Papers Shahin Honarvar, Mark van der Wilk, Alastair F. Donaldson
	Understanding and Enhancing Attribute Prioritization in Fixing Web UI Tests with LLMs Research Papers Zhuolin Xu, Qiushi Li, Shin Hwei Tan

Call for Papers

ICST 2025 invites high-quality submissions in all software testing, verification, and validation areas. Topics of interest include, but are not limited to, the following:

AI-assisted software testing
Automated test generation
Formal verification
Manual and social aspects of the software testing process
Replications, empirical studies, case studies, experience reports
Software reliability
Static and dynamic analysis
Test automation
Test-driven development and Agile testing
Testability, test design, and adequacy criteria
Testing AI-based systems
Testing and development processes
Testing, debugging, and repair tools
Testing education
Testing in specific domains, such as mobile, web, embedded/cyber-physical systems, concurrent, distributed, cloud, GUI, context-aware, IoT, real-time systems, video games, augmented/virtual reality applications
Testing of non-functional properties such as security, accessibility, and performance
Theory of software testing
Validation and user acceptance techniques

Papers for the research track should present novel and original work that advances the state-of-the-art. Case studies, replication studies, and empirical research papers are also welcome.

Papers with a strong industrial/practical component and focus more on impact than (technical) novelty are encouraged to consider the industry track instead.

Submission Format

Full Research papers must conform to the two-column IEEE conference publication format, and not exceed 10 pages, including all text, figures, tables, and appendices; two additional pages containing only references are permitted. It must conform to the IEEE Conference Proceedings Formatting Guidelines (use the letter format template and conference option). The ICST 2025 research track only accepts full research papers. Short papers are not accepted to the research track.

Authors must comply with the IEEE Plagiarism Guidelines. In particular, a submission must not have been published elsewhere and must not be under review elsewhere while under review for ICST. The submission must also comply with the IEEE Policy on Authorship.

Double-blind Reviewing

Each submission will be reviewed by at least three members of the ICST 2025 Program Committee. We employ a double-blind reviewing process. No submission may reveal its authors’ identities. Authors must make every effort to honour the double-anonymous review process. In particular, the authors’ names must be omitted from the submission, and references to their prior work should be in the third person. All artifacts, such as replication packages and tools, associated with the submission must also be anonymized. Any submission that does not comply with the above requirements may be rejected by the PC Chairs without further review. Authors with further questions on double-blind reviewing are encouraged to contact the Program Chairs by email.

Submissions

Submissions to the Research Papers Track that meet the above requirements can be made via HotCRP at https://icst2025.hotcrp.com/. If a submission is accepted, at least one author of the paper is required to register for ICST 2025 and present the paper. We expect that the conference will be in-person.

Replication Material

Submissions must supply all information needed to replicate the results and therefore are expected to include or point to an anonymized replication package with the necessary software, data, and instructions. The program committee may consult these packages to resolve open issues. If a paper does not come with a replication package, authors should comment on its absence.

Research PapersICST 2025

Program Display Configuration

Wed 2 AprDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

Thu 3 AprDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

Fri 4 AprDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

Accepted Papers

Call for Papers

Submission Format

Double-blind Reviewing

Submissions

Replication Material

Aldeida AletiProgram Co-Chair

Monash University

Australia

Ali MesbahProgram Co-Chair

University of British Columbia

Canada

Rui AbreuCommittee Member

Faculty of Engineering of the University of Porto, Portugal

Portugal

Shaukat AliCommittee Member

Simula Research Laboratory and Oslo Metropolitan University

Norway

Paolo ArcainiCommittee Member

National Institute of Informatics

Japan

Andrea ArcuriCommittee Member

Kristiania University College and Oslo Metropolitan University

Norway

Aitor ArrietaCommittee Member

Mondragon University

Spain

Benoit BaudryCommittee Member

Université de Montréal

Canada

Antonia BertolinoCommittee Member

Gran Sasso Science Institute

Italy

Soneya Binta HossainCommittee Member

University of Virginia

United States

Markus BorgCommittee Member

CodeScene

Sweden

Wing-Kwong ChanCommittee Member

City University of Hong Kong

China

Sudipta ChattopadhyayCommittee Member

Singapore University of Technology and Design

Junjie ChenCommittee Member

Tianjin University

China

Chun Yong ChongCommittee Member

Monash University Malaysia

Malaysia

Victor Crespo-RodriguezCommittee Member

Monash University

Australia

Marcio Eduardo DelamaroCommittee Member

Universidade de São Paulo

Brazil

Massimiliano Di PentaCommittee Member

University of Sannio, Italy

Italy

Alastair F. DonaldsonCommittee Member

Imperial College London

United Kingdom

Arnaud GotliebCommittee Member

Simula Research Laboratory

Norway

Pinjia HeCommittee Member

Chinese University of Hong Kong, Shenzhen

China

Robert HieronsCommittee Member

The University of Sheffield

United Kingdom

Mingyue JiangCommittee Member

Zhejiang Sci-Tech University

China

Nafiseh KahaniCommittee Member

Wed 2 Apr
Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

Thu 3 Apr
Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

Fri 4 Apr
Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change