IFIP-ICTSS is a well-established conference where researchers, developers, testers, and users from academia and industry get together to present and discuss the most recent innovations, experiences and open challenges related to testing software and systems and measuring software quality.
For more information about the conference series, see https://sites.google.com/site/ictssmain/
Topics of interest include, but are not limited to:
- Aspects of testing: test derivation, test selection, test generation, test coverage, test concretization, test implementation and execution, test result analysis, test oracle, verdict computation, test management, active testing and passive testing, monitoring and runtime verification.
- Testing new technologies: this year we encourage submissions focused on testing Large Language Models (LLMs), audit machine learning systems (especially for applications to health) and Quantum systems (programs, computers, and simulators).
- Diversity on testing: diverse generation, selecting diverse test suites, foundations of testing and diversity, applications of entropy and Kolmogorov complexity on test suite diversity.
- Theoretical approaches: formalisms (such as automata, state machines, process algebra, logics, Markov-chains…), testing frameworks, results for compositionality, refinement, soundness and completeness, addressing complex systems, heterogeneous or hybrid systems.
- Modelling languages (such as UML, MATLAB, Simulink, Modelica…) and associated tooling for model-based testing: test generation from models, model-based oracles. Scalability, traceability, quantification issues. Automated support of any parts of the testing activities, testing processes, test-driven development, sound metrics and measurements.
- Testing of quality aspects: Functional, interoperability, unit, integration, performance, load, conformance, non-regression, reliability, robustness.
- Security Testing: methodologies and techniques for continuous security assessment, security monitoring, security review, penetration testing, verification of certification compliance; automation of security testing processes.
- Cross domains and combination of techniques: using other techniques such as proof, model-checking, symbolic execution, abstract interpretation, static analysis, simulation, model learning, machine learning, expert systems, neural networks, genetic algorithms… to improve quality and reduce the effort in testing processes.
- Application aspects and case studies: Communicating systems such as cyberphysical systems, systems of systems, embedded systems, web services systems, smart grids, cloud computing systems, business information systems, real-time systems, distributed and concurrent systems. Case studies and industrial applications involving qualified empirical evaluations.
Wed 17 SepDisplayed time zone: Athens change
09:30 - 10:30 | Keynote Eoin WoodsECSA Keynote Speakers at Phoenix Chair(s): Vasilios Andrikopoulos University of Groningen | ||
09:30 60mKeynote | Software Architecture Doesn’t Matter Any More - Does It? ECSA Keynote Speakers Eoin Woods Artechra | ||
10:30 - 11:00 | |||
11:00 - 12:30 | Opening + ICTSS KeynoteGeneral Track at Atrium C Chair(s): George Angelos Papadopoulos University of Cyprus Opening Keynote speech by Bertrand Meyer Title: The Future of Verification in the age of AI | ||
12:30 - 14:00 | |||
12:30 - 14:00 | |||
14:00 - 15:30 | Metrics and Human-Centric Approaches to TestingGeneral Track at Atrium C Chair(s): Nina Yevtushenko Ivannikov Institute for System Programming of the RussianAcademy of Sciences | ||
14:00 30mTalk | Time for Quiescence: Modelling Quiescent Behaviour in Testing via Time-outs in Timed Automata General Track Laura Brandán Briones Universidad Nacional de Córdoba, Marcus Gerhold University of Twente, The Netherlands, Petra van den Bos University of Twente, The Netherlands, Marielle Stoelinga University of Twente and Radboud University, Nijmegen | ||
14:30 30mTalk | Enhancing Path Testing with Eye-Tracking: A Human-Centric Approach to Functional Software Testing General Track Angelos Fotopoulos University of Patras, Fezo Metsi University of Patras, Michalis Xenos University of Patras | ||
15:00 30mTalk | New convex-based metamorphic relations and large-scale machine learning model evaluation General Track Jessy Colonval Université Marie et Louis Pasteur, CNRS, institut FEMTO-ST(UMR 6174), F-25000, Fabrice Bouquet University of Bourgogne Franche-Comté | ||
15:30 - 16:00 | |||
15:30 - 16:00 | |||
16:00 - 17:40 | Automated Test Generation and AI-Driven TestingGeneral Track at Atrium C Chair(s): Tolgahan Bardakci University of Antwerp and Flanders Make | ||
16:00 30mTalk | On the evaluation of test suites generated by large language models General Track | ||
16:30 30mTalk | On the use of imbalanced datasets for learning-based vulnerability detection General Track | ||
17:00 20mTalk | Tracing Vulnerability Propagation Across Open Source Software Ecosystems General Track Jukka Ruohonen University of Southern Denmark, Qusai Ramadan The Maersk Mc-Kinney Moller Institute, University of Southern Denmark | ||
17:20 20mTalk | Localization Testing in Video Games using Text Recognition General Track Guillermo Jimenez-Diaz Universidad Complutense de Madrid, Dewei Chen Universidad Complutense de Madrid | ||
Thu 18 SepDisplayed time zone: Athens change
09:30 - 10:30 | Keynote Catia TrubianiECSA Keynote Speakers at Phoenix Chair(s): Cesare Pautasso Software Institute, Faculty of Informatics, USI Lugano | ||
09:30 60mKeynote | Quantifying the Software Performance of Architectural Decisions ECSA Keynote Speakers Catia Trubiani Gran Sasso Science Institute | ||
10:30 - 11:00 | |||
10:30 - 11:00 | |||
11:00 - 12:30 | Frameworks and Test AutomationGeneral Track at Atrium C Chair(s): Petra van den Bos University of Twente, The Netherlands | ||
11:00 30mTalk | Introducing CreaTest: a framework for test case generation in itemis CREATE General Track Andrea Bombarda University of Bergamo, Silvia Bonfanti University of Bergamo, Angelo Gargantini University of Bergamo, Nico Pellegrinelli University of Bergamo | ||
11:30 30mTalk | Distributed Critical Test Generation for Cyber-Physical Systems General Track | ||
12:00 30mTalk | Automating Performance Testing in CI/CD - Tools Evaluation General Track | ||
12:30 - 14:00 | |||
12:30 - 14:00 | |||
14:00 - 15:30 | Testing in Complex and Safety-Critical SystemsGeneral Track at Atrium C Chair(s): Franz Wotawa Graz University of Technology | ||
14:00 30mTalk | Assessing Test Scenarios for Autonomous Driving Using Probabilistic Model Checking General Track Jean-Baptiste Horel INRIA, Philippe Ledent AEDVICES Consulting, Radu Mateescu INRIA, Wendelin Serwe INRIA, Aline Uwimbabazi INRIA | ||
14:30 30mTalk | Passive Testing of Vehicular Embedded Systems: An Industrial Case Study with T-EARS and Napkin Studio General Track Aleksandra Nicaj Malardalen University, Daniel Flemström RISE, Eduard P. Enoiu Malardalen University, Wasif Afzal Mälardalen University | ||
15:00 30mTalk | False Positive Detection in Instrumentation and Control System Testing General Track | ||
15:30 - 16:00 | |||
15:30 30mCoffee break | Break ECSA Catering | ||
15:30 - 16:00 | |||
16:00 - 17:40 | Foundations and Advanced Testing TechniquesGeneral Track at Atrium C Chair(s): Bertrand Meyer Constructor Institute Schaffhausen | ||
16:00 25mTalk | A Time Series Analysis of Assertions in the Linux Kernel General Track Jukka Ruohonen University of Southern Denmark | ||
16:25 25mTalk | Loop unrolling: formal definition and application to testing General Track Li Huang Constructor Institute Schaffhausen, Reto Weber PhD Student of Constructor Institute of Technology, Bertrand Meyer Constructor Institute Schaffhausen | ||
16:50 25mTalk | On using Homing Sequences instead of Distinguishing in FSM-based Testing General Track Natalia Kushik SAMOVAR, Télécom SudParis, Institut Polytechnique de Paris, Nina Yevtushenko Ivannikov Institute for System Programming of the RussianAcademy of Sciences | ||
17:15 25mTalk | Testability Indicators for Refactoring General Track Tom Holvoet imec-DistriNet KU Leuven | ||
18:00 - 23:00 | Tour & Conference DinnerECSA Catering | ||
Fri 19 SepDisplayed time zone: Athens change
09:30 - 10:30 | Keynote Elisabetta Di NittoECSA Keynote Speakers at Phoenix Chair(s): Jacopo Soldani University of Pisa, Italy | ||
09:30 60mKeynote | Development of Infrastructure as Code: approaches, challenges and trends ECSA Keynote Speakers Elisabetta Di Nitto Politecnico di Milano | ||
10:30 - 11:00 | |||
10:30 30mCoffee break | Break ECSA Catering | ||
10:30 - 11:00 | |||
11:00 - 12:30 | Reinforcement Learning and Generative TestingGeneral Track at Atrium C Chair(s): Li Huang Constructor Institute Schaffhausen | ||
11:00 30mTalk | Reusable Test Suites for Reinforcement Learning General Track Jørn Eirik Betten Simula Research Laboratory; Oslo Metropolitan University, Quentin Mazouni Simula Research Laboratory, Dennis Gross Simula Research Laboratory, Pedro Lind Oslo Metropolitan University; School of Economics,Innovation and Technology, Kristiania University of AppliedSciences, Helge Spieker Simula Research Laboratory | ||
11:30 30mTalk | Test Generation for Deep Reinforcement Learning Using LRP-Guided Mutation of Classified Configurations General Track Brice Tchuenkam Université du Québec en Outaouais, Omer Nguena Timo Université du Québec en Outaouais | ||
12:00 30mTalk | Test Amplification for REST APIs via Single and Multi-Agent LLM Systems General Track Robbe Nooyens University of Antwerp, Tolgahan Bardakci University of Antwerp and Flanders Make, Mutlu Beyazıt University of Antwerp and Flanders Make vzw, Serge Demeyer University of Antwerp and Flanders Make vzw | ||
12:30 - 14:00 | |||
12:30 - 14:00 | |||
14:00 - 15:30 | LLMs and Agent-Based TestingGeneral Track at Atrium C Chair(s): Jørn Eirik Betten Simula Research Laboratory; Oslo Metropolitan University | ||
14:00 30mTalk | Reverse Engineering for Input Modeling: Input Parameter Model Inference from Network Traces General Track Manuel Leithner SBA Research, Salzburg University of Applied Sciences, Dimitris E. Simos Salzburg University of Applied Sciences, Paris LodronUniversity of Salzburg | ||
14:30 30mTalk | Automated Exploration of Conversational Agents for the Synthesis of Testing Profiles General Track Iván Sotillo del Horno Universidad Autónoma de Madrid, Alejandro del Pozzo Universidad Autónoma de Madrid, Esther Guerra Universidad Autónoma de Madrid, Juan de Lara Autonomous University of Madrid Pre-print Media Attached | ||
15:00 30mTalk | Extracting Threats from System Descriptions with LLMs - Comparing One and Two Agents Strategies General Track | ||
15:30 - 15:40 | |||
15:30 - 16:00 | |||
16:00 - 16:30 | |||
Accepted Papers
Journal Special Issue
Call for Papers Topical Issue of SN Computer Science:
Testing Software and Systems: Challenges and Emerging Trends
Submission Deadline: December 31, 2025
Guest Editors:
- Dr. Silvia Bonfanti, University of Bergamo, Italy
- Dr. George A. Papadopoulos, University of Cyprus, Cyprus
Testing is the most important technique which can be used for assessing and validating the quality, functionality, performance, and reliability of software. Testing remains very challenging in all its different aspects: methods and tools, theory, modelling languages, measuring of quality, and industrial applications. The topical issue will address the issues related to testing software and systems, paying attention to contemporary challenges and emerging trends, such as (but not limited to) complexity, scalability and performance, security and privacy, involvement of AI and ML, human factors, etc.
The topical issue will focus on the papers accepted at the conference ICTSS 2025. Selected papers will be invited to submit extended versions with at least 30% new material, which will be subjected to standard review process as per journal’s editorial policies.
All submissions should follow the instructions available at https://link.springer.com/journal/42979/submission-guidelines
Submission Link: https://www.editorialmanager.com/sncs/default.aspx
Submission process: At the time of article submission, please select the Topical Issue (TI) of your choice. This Topical Issue section can be found under the ‘Additional Information’ Section. Please follow the given steps:
- Step I - ‘Does this manuscript belong to a special issue? Yes/No’. Please enter ‘Yes’.
- Step II - The author must choose the Topical Issue of choice, which will be: Testing Software and Systems: Challenges and Emerging Trends. Select the topical issue from the dropdown list.
All enquiries regarding the topical issue should be sent to
Dr. Silvia Bonfanti - Send Email
or
Springer Nature contact: Teena Bedi - Send Email
Call For Papers
Call for papers ICTSS 2025
IFIP-ICTSS is a well-established conference where researchers, developers, testers, and users from industry get together to present and discuss the most recent innovations, experiences and open challenges related to testing software and systems and measuring software quality.
Topics of interest include, but are not limited to:
- AI for Software Testing and Testing of AI: the growing interest in the use of AI has also spread in to various aspects of software testing. In addition, work is underway to test and validate AI systems/applications (machine learning, expert systems, neural networks).
- Aspects of testing: test derivation, test selection, test generation, test coverage, test concretization, test implementation and execution, test result analysis, test oracle, verdict computation, test management, active testing and passive testing, monitoring and runtime verification.
- Testing new technologies: this year we encourage submissions focused on testing Large Language Models (LLMs), audit machine learning systems (especially for applications to health) and Quantum systems (programs, computers, and simulators).
- Diversity on testing: diverse generation, selecting diverse test suites, foundations of testing and diversity, applications of entropy and Kolmogorov complexity on test suite diversity.
- Theoretical approaches: formalisms (such as automata, state machines, process algebra, logics, Markov-chains…), testing frameworks, results for compositionality, refinement, soundness and completeness, addressing complex systems, heterogeneous or hybrid systems.
- Modelling languages (such as UML, MATLAB, Simulink, Modelica…) and associated tooling for model-based testing: test generation from models, model-based oracles. Scalability, traceability, quantification issues. Automated support of any parts of the testing activities, testing processes, test-driven development, sound metrics and measurements.
- Testing of quality aspects: Functional, interoperability, unit, integration, performance, load, conformance, non-regression, reliability, robustness.
- Security Testing: methodologies and techniques for continuous security assessment, security monitoring, security review, penetration testing, verification of certification compliance; automation of security testing processes.
- Testing emerging technologies: quantum systems (programs, computers, and simulators), genetic algorithms, metaverse, and any other technology in the early stages of testing.
- Human Aspects of Testing: human psychology and management attitude play major roles in formulating and adopting testing in practice.
- Cross domains and combination of techniques: using other techniques such as proof, model-checking, symbolic execution, abstract interpretation, static analysis, simulation, model learning, machine learning, expert systems, neural networks, genetic algorithms… to improve quality and reduce the effort in testing processes.
- Application aspects and case studies: Communicating systems such as cyberphysical systems, systems of systems, embedded systems, web services systems, smart grids, cloud computing systems, business information systems, real-time systems, distributed and concurrent systems. Case studies and industrial applications involving qualified empirical evaluations.
IFIP-ICTSS invites:
Full papers (12 to 15 pages plus at most 2 extra pages for references in the one-column Springer LNCS format) describing original research contributions with sufficient evidence for the interest of the proposed approach.
Industry papers (12 to 15 pages plus at most 2 extra pages for references in the one-column Springer LNCS format) describing original research or experience report conducted within an industrial environment or in collaboration with an industry partner.
Short papers or work-in-progress papers (up to 6 pages plus at most 1 extra page for references in the one-column Springer LNCS format) describing academic work in progress or tool implementations, as well as testing processes, achievements and feedback on testing methods for industrial case studies.
Journal-First The aim of the Journal-First (JF) submission category is to further enrich the program of ICTSS, as well as to provide an overall more flexible path to publication and dissemination of original research that is within the scope of ICTSS. A submission in this category must adhere to the following criteria:
- It should be clearly within the scope of the conference.
- It should be recent: it should have been accepted and made publicly available in a journal (online or in print) by January 1, 2023 or more recently.
- It has not been presented at, and is not under consideration for, Journal- First tracks of other conferences or workshops.
- The submission has to be in the form of a 4-page extended abstract and has to provide a concise summary of the published journal paper.
- It must be marked as such in the submission’s, and must explicitly include full bibliographic details (including a DOI) of the journal publication they are based on. Since the referenced journal papers have already been reviewed and accepted by the corresponding journals, submissions in the JF category will not be reviewed again for technical content. Submissions will be judged on the basis of the above criteria, but also considering how well they would complement the conference’s technical program. Accepted submissions in this category will be part of the proceedings of ICTSS 2025, with the title equal to the original title of the article with the prefix *Summary of*.
The submission link is: https://easychair.org/conferences/?conf=ictss2025
The papers will be published by Springer in the LNCS volume.
Authors should consult Springer’s Instructions for Authors of Proceedings and use either the LaTeX or the Word templates provided on the authors’ page. Springer’s proceedings LaTeX templates are available in Overleaf.
Authors are encouraged to include their ORCIDs in their papers.
Journal Special Issue
Best papers of the conference will be invited to submit an extended version of their article at a special (topical) issue of the Springer Nature of Computer Science https://www.springer.com/journal/42979. Deadline will be near the end of December 2025 with a tentative publication date for the middle 2026.