Supporters
Dates
Tracks
Wed 2 AprDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
Wed 2 Apr
Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
11:00 - 12:30 | LLMs in TestingResearch Papers / Industry / Journal-First Papers at Aula Magna (AM) Chair(s): Phil McMinn University of Sheffield | ||
11:00 15mTalk | AugmenTest: Enhancing Tests with LLM-driven Oracles Research Papers Shaker Mahmud Khandaker Fondazione Bruno Kessler, Fitsum Kifetew Fondazione Bruno Kessler, Davide Prandi Fondazione Bruno Kessler, Angelo Susi Fondazione Bruno Kessler Pre-print | ||
11:15 15mTalk | Impact of Large Language Models of Code on Fault Localization Research Papers Suhwan Ji Yonsei University, Sanghwa Lee Kangwon National University, Changsup Lee Kangwon National University, Yo-Sub Han Yonsei University, Hyeonseung Im Kangwon National University, South Korea | ||
11:30 15mTalk | An Analysis of LLM Fine-Tuning and Few-Shot Learning for Flaky Test Detection and Classification Research Papers | ||
11:45 15mTalk | Evaluating the Effectiveness of LLMs in Detecting Security Vulnerabilities Research Papers Avishree Khare , Saikat Dutta Cornell University, Ziyang Li University of Pennsylvania, Alaia Solko-Breslin University of Pennsylvania, Mayur Naik UPenn, Rajeev Alur University of Pennsylvania | ||
12:00 15mTalk | FlakyFix: Using Large Language Models for Predicting Flaky Test Fix Categories and Test Code Repair Journal-First Papers Sakina Fatima University of Ottawa, Hadi Hemmati York University, Lionel Briand University of Ottawa, Canada; Lero centre, University of Limerick, Ireland | ||
12:15 15mTalk | Integrating LLM-based Text Generation with Dynamic Context Retrieval for GUI Testing Industry Juyeon Yoon Korea Advanced Institute of Science and Technology, Seah Kim Samsung Research, Somin Kim Korea Advanced Institute of Science and Technology, Sukchul Jung Samsung Research, Shin Yoo KAIST | ||
14:00 - 15:30 | Test OracleJournal-First Papers / Research Papers / Industry at Aula Magna (AM) Chair(s): Mike Papadakis University of Luxembourg | ||
14:00 15mTalk | Differential Testing of Concurrent Classes Research Papers Valerio Terragni University of Auckland, Shing-Chi Cheung Hong Kong University of Science and Technology | ||
14:15 15mTalk | Hybrid Equivalence/Non-Equivalence Testing Research Papers Laboni Sarker University of California at Santa Barbara, Tevfik Bultan University of California at Santa Barbara | ||
14:30 15mTalk | Metamorphic Testing for Pose Estimation Systems Research Papers Matias Duran Trinity College Dublin, Ireland, Thomas Laurent Lero@Trinity College Dublin, Ellen Rushe School of Computing Dublin City University, Anthony Ventresque Trinity College Dublin & Lero, Ireland | ||
14:45 15mTalk | Mutation-Guided Metamorphic Testing of Optimality in AI Planning Journal-First Papers Quentin Mazouni Simula Research Laboratory, Arnaud Gotlieb Simula Research Laboratory, Helge Spieker Simula Research Laboratory, Mathieu Acher University of Rennes - Inria - CNRS - IRISA, Benoit Combemale University of Rennes, Inria, CNRS, IRISA Link to publication DOI | ||
15:00 15mTalk | LLMs in the Heart of Differential Testing: A Case Study on a Medical Rule Engine Industry Erblin Isaku Simula Research Laboratory, and University of Oslo (UiO), Christoph Laaber Simula Research Laboratory, Hassan Sartaj Simula Research Laboratory, Shaukat Ali Simula Research Laboratory and Oslo Metropolitan University, Thomas Schwitalla Cancer Registry of Norway, Jan F. Nygård Cancer Registry of Norway | ||
16:00 - 17:00 | Test Case Selection, Prioritisation, ReductionResearch Papers / Industry at Aula Magna (AM) Chair(s): Andrea Stocco Technical University of Munich, fortiss | ||
16:00 15mTalk | The Impact of List Reduction for Language Agnostic Test Case Reducers Research Papers Tobias Heineken Friedrich-Alexander-Universität Erlangen-Nürnberg, Michael Philippsen Friedrich-Alexander Universität Erlangen-Nürnberg (FAU), Programming Systems Group | ||
16:15 15mTalk | RustyRTS: Regression Test Selection for Rust Research Papers Simon Hundsdorfer Technical University of Munich, Roland Würsching Technical University of Munich, Alexander Pretschner TU Munich | ||
16:30 15mTalk | ML-Based Test Case Prioritization: A Research and Production Perspective in CI Environments Industry Md Asif Khan Ontario Tech University, Akramul Azim Ontario Tech University, Ramiro Liscano Ontario Tech University, Kevin Smith International Business Machines Corporation (IBM), Yee-Kang Chang International Business Machines Corporation (IBM), Gkerta Seferi International Business Machines Corporation (IBM), Qasim Tauseef International Business Machines Corporation (IBM) | ||
16:45 15mTalk | Evaluating Machine Learning-Based Test Case Prioritization in the Real World: An Experiment with SAP HANA Industry | ||
Thu 3 AprDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
Thu 3 Apr
Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
11:00 - 12:30 | Testing ML Systems and Fault LocalisationIndustry / Research Papers at Aula Magna (AM) Chair(s): Atif Memon Apple | ||
11:00 15mTalk | On Accelerating Deep Neural Network Mutation Analysis by Neuron and Mutant Clustering Research Papers Pre-print | ||
11:15 15mTalk | Benchmarking Image Perturbations for Testing Automated Driving Assistance Systems Research Papers Stefano Carlo Lambertenghi Technische Universität München, fortiss GmbH, Hannes Leonhard Technical University of Munich, Andrea Stocco Technical University of Munich, fortiss Pre-print | ||
11:30 15mTalk | Turbulence: Systematically and Automatically Testing Instruction-Tuned Large Language Models for Code Research Papers Shahin Honarvar Imperial College London, Mark van der Wilk University of Oxford, Alastair F. Donaldson Imperial College London | ||
11:45 15mTalk | Taming Uncertainty for Critical Scenario Generation in Automated Driving Industry Selma Grosse DENSO Automotive GmbH, Dejan Nickovic Austrian Institute of Technology, Cristinel Mateis AIT Austrian Institute of Technology GmbH, Alessio Gambi Austrian Institute of Technology (AIT), Adam Molin DENSO AUTOMOTIVE | ||
12:00 15mTalk | Multi-Project Just-in-Time Software Defect Prediction Based on Multi-Task Learning for Mobile Applications Research Papers Feng Chen Chongqing University of Posts and Telecommunications, Ke Yuxin Chongqing University of Posts and Telecommunications, Liu Xin Chongqing University of Posts and Telecommunications, Wei Qingjie Chongqing University of Posts and Telecommunications | ||
12:15 15mTalk | Fault Localization via Fine-tuning Large Language Models with Mutation Generated Stack Traces Industry Neetha Jambigi University of Cologne, Bartosz Bogacz SAP SE, Moritz Mueller SAP SE, Thomas Bach SAP, Michael Felderer German Aerospace Center (DLR) & University of Cologne | ||
Fri 4 AprDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
Fri 4 Apr
Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
11:00 - 12:30 | Automated TestingIndustry / Research Papers / Journal-First Papers / Education at Aula Magna (AM) Chair(s): Cristian Cadar Imperial College London | ||
11:00 15mTalk | Testing Practices, Challenges, and Developer Perspectives in Open-Source IoT Platforms Research Papers Daniel Rodriguez-Cardenas William & Mary, Safwat Ali Khan George Mason University, Prianka Mandal William & Mary, Adwait Nadkarni William & Mary, Kevin Moran University of Central Florida, Denys Poshyvanyk William & Mary Pre-print | ||
11:15 15mTalk | Many-Objective Neuroevolution for Testing Games Research Papers Patric Feldmeier University of Passau, Katrin Schmelz University of Passau, Gordon Fraser University of Passau Pre-print | ||
11:30 15mTalk | Black-Box Testing for Practitioners Education Matthias Hamburg IEEE Computer Society; International Software Testing Qualifications Board, Adam Roman Jagiellonian University, Faculty of Mathematics and Computer Science; International Software Testing Qualifications Board | ||
11:45 15mTalk | CUBETESTERAI: Automated JUnit Test Generation using the LLaMA Model Industry Daniele Gorla Department of Computer Science, Sapienza University of Rome, Shivam Kumar , Pietro Nicolaus Roselli Lorenzini , Alireza Alipourfaz | ||
12:00 15mTalk | Can Search-Based Testing with Pareto Optimization Effectively Cover Failure-Revealing Test Inputs? Journal-First Papers Lev Sorokin Technische Universität München, Germany, Damir Safin fortiss, Shiva Nejati University of Ottawa | ||
12:15 15mTalk | [prerecorded] ADGE: Automated Directed GUI Explorer for Android Applications Research Papers Yue Jiang Institute of Information Engineering, Chinese Academy of Sciences, Beijing, China, Xiaobo Xiang Singular Security Lab, Beijing, China, Qingli Guo Institute of Information Engineering, Chinese Academy of Sciences, Qi Gong Key Laboratory of Network Assessment Technology, Institute of Information Engineering, Chinese Academy of Sciences, China, Xiaorui Gong Institute of Information Engineering, Chinese Academy of Science | ||
14:00 - 15:28 | Advances in Software TestingResearch Papers / Short Papers, Vision and Emerging Results / Industry / Education at Room A1 Chair(s): Annibale Panichella Delft University of Technology | ||
14:00 15mTalk | Code, Test and Coverage Evolution in Mature Software Systems: Changes over the Past Decade Research Papers | ||
14:15 15mTalk | Coverage Metrics for T-Wise Feature Interactions Research Papers Sabrina Böhm University of Ulm, Germany, Tim Jannik Schmidt University of Ulm, TU Braunschweig, Germany, Sebastian Krieter TU Braunschweig, Germany, Tobias Pett Karlsruhe Institute for Technology (KIT), Germany, Thomas Thüm TU Braunschweig, Germany, Malte Lochau University of Siegen | ||
14:30 15mTalk | LLM-based Labelling of Recorded Automated GUI-based Test cases Industry Diogo Buarque Franzosi Blekinge Institute of Technology, Emil Alégroth Blekinge Institute of Technology, Maycel Isaac Synteda | ||
14:45 15mTalk | A Tool-assisted Training Approach for Empowering Localization and Internationalization Testing Proficiency Education Maria Couto Federal University of Pernambuco, Breno Miranda Centro de Informática at Universidade Federal de Pernambuco, Kiev Gama Universidade Federal de Pernambuco | ||
15:00 7mShort-paper | Pre-trained Models for Bytecode Instructions Short Papers, Vision and Emerging Results Donggyu Kim Handong Global University, Taemin Kim Handong Global University, Jiho Shin York University, Song Wang York University, Heeyoul Choi , Jaechang Nam Handong Global University Pre-print | ||
15:07 7mShort-paper | EnCus: Customizing Search Space for Automated Program Repair Short Papers, Vision and Emerging Results Seongbin Kim , Sechang Jang , Jindae Kim Seoul National University of Science and Technology, Jaechang Nam Handong Global University Pre-print | ||
15:14 7mTalk | Test Generation from Use Case Specifications for IoT Systems: Custom, LLM-Based, and Hybrid Approaches Short Papers, Vision and Emerging Results Zacharie Chenail-Larcher École de technologie supérieure (ÉTS), Jean Baptiste Minani Concordia University, Montreal, Canada, Naouel Moha École de Technologie Supérieure (ETS) | ||
Accepted Papers
Call for Journal-First Presentations
ICST 2025 invites submissions for presentations of journal-first papers published recently in prestigious software engineering journals in all areas of software testing, verification, and validation. This will both enrich the ICST program as well as offer the authors an opportunity to present their work to the community.
Eligibility
Applications for journal papers published in:
- IEEE Transactions on Software Engineering (TSE)
- ACM Transactions on Software Engineering and Methodology (TOSEM)
- Empirical Software Engineering (EMSE)
- Journal of Systems and Software (JSS)
- Software Quality Journal (SQJ)
- Information and Software Technology (IST)
- Software Testing, Verification and Reliability (STVR)
Other journals may be considered on a case-by-case basis. A journal-first presentation submitted to ICST 2025 must adhere to the following criteria:
- The paper was accepted for publication (i.e., the date of the acceptance notification) no earlier than 1 January 2023.
- The paper is in the scope of the conference, as defined in the call for ICST 2025 research papers.
- The paper reports completely new research results or presents novel contributions that were not previously reported in prior published work.
- The paper has not been presented and is not under consideration for journal-first programs of other conferences.
Topics of Interest
Topics of interest include, but are not limited to, the following:
- Automated test generation, e.g., fuzz testing, search-based test generation, (dynamic) symbolic execution
- Manual testing practices and techniques
- Security testing
- Model-based testing
- Test automation
- Static analysis and symbolic execution
- Formal verification and model checking
- Software reliability
- Social aspects of the software testing process
- Testability and design
- Testing and development processes
- Testing education
- Testing in specific domains, such as mobile, web, embedded/cyber-physical systems, concurrent, distributed, cloud, GUI, and real-time systems
- Testing for learning-enabled software, including deep learning and Large Language Models (LLMs)
- Testing video games, augmented reality
- Testing/debugging tools
- Theory of software testing
- Empirical studies
- Experience reports
Submission of Proposals
If you have a journal publication that meets the aforementioned criteria, you can submit a one-page proposal via EasyChair.
The submission should consist of:
- the paper title;
- names of all authors;
- an extended abstract using the two-column IEEE conference publication format (same as the research track submission);
- a short statement on how the work satisfies the journal-first criteria;
- a pointer to the original journal paper.
Please list all authors of the original journal paper as authors of your submission in EasyChair (https://easychair.org/conferences/?conf=icst2025).
Important Dates
- Journal First Submissions Deadline: Dec 1st 2024
- Journal First Acceptance Notification: Dec 15th 2024
- Submissions close at 23:59 AoE (Anywhere on Earth, UTC-12)
Publication
The JF manuscripts have already been, or will be, published through the journals and therefore will NOT be part of the ICST proceedings. The journal-first papers will be listed in the conference program and the proceedings will only contain the abstract and a pointer to the journal publication.
Presentation
If a submission is accepted for the journal-first program, at least one author of the associated journal paper must register and attend the conference to present the paper in person.
Important Dates AoE (UTC-12h)
| Sun 15 Dec 2024 Author Notification |
| Sun 1 Dec 2024 Submission Deadline |
Submission Link
