ICTSS 2024
Wed 30 October - Fri 1 November 2024 London, United Kingdom

IFIP-ICTSS is a well-established conference where researchers, developers, testers, and users from academia and industry get together to present and discuss the most recent innovations, experiences and open challenges related to testing software and systems and measuring software quality.

For more information about the conference series, see https://sites.google.com/site/ictssmain/

Topics of interest include, but are not limited to:

  • Aspects of testing: test derivation, test selection, test generation, test coverage, test concretization, test implementation and execution, test result analysis, test oracle, verdict computation, test management, active testing and passive testing, monitoring and runtime verification.
  • Testing new technologies: this year we encourage submissions focused on testing Large Language Models (LLMs), audit machine learning systems (especially for applications to health) and Quantum systems (programs, computers, and simulators).
  • Diversity on testing: diverse generation, selecting diverse test suites, foundations of testing and diversity, applications of entropy and Kolmogorov complexity on test suite diversity.
  • Theoretical approaches: formalisms (such as automata, state machines, process algebra, logics, Markov-chains…), testing frameworks, results for compositionality, refinement, soundness and completeness, addressing complex systems, heterogeneous or hybrid systems.
  • Modelling languages (such as UML, MATLAB, Simulink, Modelica…) and associated tooling for model-based testing: test generation from models, model-based oracles. Scalability, traceability, quantification issues. Automated support of any parts of the testing activities, testing processes, test-driven development, sound metrics and measurements.
  • Testing of quality aspects: Functional, interoperability, unit, integration, performance, load, conformance, non-regression, reliability, robustness.
  • Security Testing: methodologies and techniques for continuous security assessment, security monitoring, security review, penetration testing, verification of certification compliance; automation of security testing processes.
  • Cross domains and combination of techniques: using other techniques such as proof, model-checking, symbolic execution, abstract interpretation, static analysis, simulation, model learning, machine learning, expert systems, neural networks, genetic algorithms… to improve quality and reduce the effort in testing processes.
  • Application aspects and case studies: Communicating systems such as cyberphysical systems, systems of systems, embedded systems, web services systems, smart grids, cloud computing systems, business information systems, real-time systems, distributed and concurrent systems. Case studies and industrial applications involving qualified empirical evaluations.
Dates
You're viewing the program in a time zone which is different from your device's time zone change time zone

Wed 30 Oct

Displayed time zone: London change

09:00 - 09:30
09:30 - 10:00
10:30 - 11:00
15:00 - 15:30

Fri 1 Nov

Displayed time zone: London change

09:00 - 09:30
10:30 - 11:00
11:00 - 12:30
Keynote Speaker: Rob HieronsGeneral Track at Russell & Gordon Meeting room
13:40 - 14:00
15:00 - 15:30
16:30 - 16:40
18:00 - 22:00
Social Event - Swingers Golf ClubGeneral Track at Swingers Golf Club

Accepted Papers

Title
Alessandro Marchetto and Rosmael Zidane Lekeufack Foulefack. Enhancing Vulnerability Detection with Domain Knowledge: a Comparison of Different Mechanisms
General Track

Angela Gonzales de Diego and Franz Wotawa. On the variations of ChatGPT's response quality for generating source code across programming languages
General Track

Arsham Gholamzadeh Khoee, Yinan Yu, Robert Feldt, Andris Freimanis, Patrick Andersson Rhodin and Dhasarathy Parthasarathy. GoNoGo: An Efficient LLM-based Multi-Agent System for Streamlining Automotive Software Release Decision-Making
General Track

Constantin Cezar Petrescu, Sam Smith, Alexis Butler and Santanu Kumar Dash. Checking Test Suite Efficacy Through Dual-Channel Techniques
General Track

Cristian Augusto Alonso, Jesús Morán, Antonia Bertolino, Claudio De La Riva and Javier Tuya. Software System Testing assisted by Large Language Models: An Exploratory Study
General Track

Dennis Gross and Helge Spieker. Enhancing RL Safety with Counterfactual LLM Reasoning
General Track

Dorian Knoblauch and Abhishek Shrestha. Continuous Auditing Based Conformity Assessment for AI Systems: A Proof-of-Concept Evaluation
General Track

Guannan Lou, Donghwan Shin, Neil Walkinshaw and Robert Hierons. Autonomous Driving Sysrem Testing: Traffic Density Does Matter
General Track

HandErol and Hasan Sozer. Test Prioritization based on the Coverage of Recently Modified Source Code: An Industrial Case Study
General Track

Héctor Menéndez and Guillermo Suárez-Tangil. Journal First: Summary of ObfSec: Measuring the security of obfuscations from a testing perspective
General Track

Joanna Kisaakye, Mutlu Beyazıt and Serge Demeyer. Extending a Flakiness Score for System-Level Tests
General Track

Laura Wingfield, Katie Wainwright, Simon Knight and Helena Webb. A trusted friend in the middle of the night: End-user perspectives on Artificial Intelligence informed software systems as a decision-making aid
General Track

Liliana Marie Prikler and Franz Wotawa. Mutating Clingo's AST with clingabomino
General Track

Liliana Marie Prikler and Franz Wotawa. Reevaluating the small-scope testing hypothesis of answer set programs
General Track

Luiza Corpaci, Michael Wagner, Sebastian Raubitzek, Ludwig Kampel, Kevin Mallinger and Dimitris E. Simos. Estimating Combinatorial t-way Coverage based on Matrix Complexity Metrics
General Track

Malsha Ashani Mahawatta Dona, Beatriz Cabrero-Daniel, Yinan Yu and Christian Berger. LLMs Can Check Their Own Results to Mitigate Hallucinations in Traffic Understanding Tasks
General Track

Manuel Jesús Cerezo Manzón, Ricardo Moya García, Ekaitz ArrioGarcía, Miguel Herencia García del Castillo and Guillermo Iglesias. Binary Classification Optimisation with AI-Generated Data
General Track

Markus Fugger, Manuel Leithner and Dimitris E. Simos. Annotation-based input modeling for combinatorial testing
General Track

Martina Vecellio Reane, Daniele Dall'Anese, Rosmael Zidane Lekeufack Foulefack and Alessandro Marchetto. Towards a Knowledge Graph based approach for vulnerable code weaknesses identification
General Track

Pepita Barnard, John Robert Bautista, Aidan Dakhama, Arya Farahi, Kazim Laos, Anqi Liu and Héctor Menéndez. Responsible MLOps Design Methodology for an Auditing System for AI-based Clinical Decision Support Systems
General Track

Rosmaël Zidane Lekeufack Foulefack and Alessandro Marchetto. Enhanced Graph Neural Networks for Vulnerability Detection in Java via Advanced Subgraph Construction
General Track

Call for Papers

Call for Research Papers

IFIP-ICTSS is a well-established conference where researchers, developers, testers, and users from academia and industry get together to present and discuss the most recent innovations, experiences and open challenges related to testing software and systems and measuring software quality.

For more information about the conference series, see https://sites.google.com/site/ictssmain/

Topics of interest include, but are not limited to:

  • Aspects of testing: test derivation, test selection, test generation, test coverage, test concretization, test implementation and execution, test result analysis, test oracle, verdict computation, test management, active testing and passive testing, monitoring and runtime verification.
  • Testing new technologies: this year we encourage submissions focused on testing Large Language Models (LLMs), audit machine learning systems (especially for applications to health) and Quantum systems (programs, computers, and simulators).
  • Diversity on testing: diverse generation, selecting diverse test suites, foundations of testing and diversity, applications of entropy and Kolmogorov complexity on test suite diversity.
  • Theoretical approaches: formalisms (such as automata, state machines, process algebra, logics, Markov-chains…), testing frameworks, results for compositionality, refinement, soundness and completeness, addressing complex systems, heterogeneous or hybrid systems.
  • Modelling languages (such as UML, MATLAB, Simulink, Modelica…) and associated tooling for model-based testing: test generation from models, model-based oracles. Scalability, traceability, quantification issues. Automated support of any parts of the testing activities, testing processes, test-driven development, sound metrics and measurements.
  • Testing of quality aspects: Functional, interoperability, unit, integration, performance, load, conformance, non-regression, reliability, robustness.
  • Security Testing: methodologies and techniques for continuous security assessment, security monitoring, security review, penetration testing, verification of certification compliance; automation of security testing processes.
  • Cross domains and combination of techniques: using other techniques such as proof, model-checking, symbolic execution, abstract interpretation, static analysis, simulation, model learning, machine learning, expert systems, neural networks, genetic algorithms… to improve quality and reduce the effort in testing processes.
  • Application aspects and case studies: Communicating systems such as cyberphysical systems, systems of systems, embedded systems, web services systems, smart grids, cloud computing systems, business information systems, real-time systems, distributed and concurrent systems. Case studies and industrial applications involving qualified empirical evaluations.

IFIP-ICTSS invites:

  • Full papers
  • Short papers
  • Posters
  • Journal First

The aim of the Full papers submission category is to describe original research contributions with sufficient evidence for the interest of the proposed approach (12 to 15 pages , plus at most 2 extra pages for references in the one-column Springer LNCS format).

Short papers or work-in-progress papers (up to 6 pages plus at most 1 extra page for references in the one-column Springer LNCS format) describing academic work in progress or tool implementations, as well as testing processes, achievements and feedbacks on testing methods for industrial case studies.

Posters (up to 4 pages plus at most 1 extra page for references in the one-column Springer LNCS format) describing academic work, novel ideas in progress or tool presentations, as well as testing processes, achievements and feedbacks on testing methods for industrial case studies.

The aim of the Journal-First (JF) submission category is to further enrich the program of ICTSS, as well as to provide an overall more flexible path to publication and dissemination of original research that is within the scope of ICTSS (up to 4 pages plus at most 1 extra page for references in the one-column Springer LNCS format). A submission in this category must adhere to the following criteria:

  • It should be clearly within the scope of the conference.
  • It should be recent: it should have been accepted and made publicly available in a journal (online or in print) by January 1, 2022 or more recently.
  • It has not been presented at, and is not under consideration for, Journal- First tracks of other conferences or workshops.
  • The submission has to be in the form of a 4-pages extended abstract and has to provide a concise summary of the published journal paper.
  • Journal-First submissions must be marked as such in the submission’s, and must explicitly include full bibliographic details (including a DOI) of the journal publication they are based on. Since the referenced journal papers have already been reviewed and accepted by the corresponding journals, submissions in the JF category will not be reviewed again for technical content. Submissions will be judged on the basis of the above criteria, but also considering how well they would complement the conference’s technical program. Accepted submissions in this category will be part of the proceedings of ICTSS 2024, with the title equal to the original title of the article with the prefix Summary of.

The submission link is https://easychair.org/conferences/?conf=ictss2024

The papers will be published by Springer in the LNCS volume.

Authors should consult Springer’s Instructions for Authors of Proceedings and use either the LaTeX or the Word templates provided on the authors’ page. Springer’s proceedings LaTeX templates are available in Overleaf.

Authors are encouraged to include their ORCIDs in their papers.