ICTSS 2023
Mon 18 - Wed 20 September 2023 Bergamo, Italy

IFIP-ICTSS is a well-established conference where researchers, developers, testers, and users from industry get together to present and discuss the most recent innovations, experiences and open challenges related to testing software and systems and measuring software quality.

Dates
You're viewing the program in a time zone which is different from your device's time zone change time zone

Mon 18 Sep

Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

09:00 - 09:20
Welcome and introductionsIFIP-ICTSS 35th International Conference on Testing Software and Systems at Room 5 - Conference room
Chair(s): Silvia Bonfanti University of Bergamo, Angelo Gargantini University of Bergamo, Paolo Salvaneschi Salvaneschi & Partners
09:20 - 10:40
09:20
40m
Industry talk
The design of software testing plans
IFIP-ICTSS 35th International Conference on Testing Software and Systems
Paolo Salvaneschi Salvaneschi & Partners
10:00
40m
Industry talk
Lesson learned introducing a Testing Automation approach to a B2C structured company: critical issues and advantages
IFIP-ICTSS 35th International Conference on Testing Software and Systems
11:10 - 12:30
11:10
40m
Industry talk
L’esperienza di Gruppo San Donato nella creazione di servizi digitali di alta qualità
IFIP-ICTSS 35th International Conference on Testing Software and Systems
Marco Denti Gruppo San Donato
11:50
40m
Industry talk
ISTQB®: the international scheme for certification of competences in SW testing. State of the art and future perspectives
IFIP-ICTSS 35th International Conference on Testing Software and Systems
14:00 - 16:00
14:00
40m
Industry talk
How do we assure quality in a leading ABB Electrification web app
IFIP-ICTSS 35th International Conference on Testing Software and Systems
14:40
40m
Industry talk
Test Case Generation Made Easy: The Power of Decision Trees
IFIP-ICTSS 35th International Conference on Testing Software and Systems
Daniela Spezia TXT Quence
15:20
40m
Industry talk
No code vs. coded Test Automation Solutions: competition or complementarity? Can we go beyond this?
IFIP-ICTSS 35th International Conference on Testing Software and Systems
Gianluca Zani TXT Quence

Tue 19 Sep

Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

09:10 - 11:00
Session on Test automation and designIFIP-ICTSS 35th International Conference on Testing Software and Systems at Room 5 - Conference room
Chair(s): Mercedes G. Merayo Universidad Complutense de Madrid
09:10
20m
Talk
Multi-device, robust, and integrated Android GUI testing: A conceptual framework
IFIP-ICTSS 35th International Conference on Testing Software and Systems
Riccardo Coppola Politecnico di Torino, Luca Ardito Politecnico di Torino, Marco Torchiano Politecnico di Torino
09:30
30m
Talk
How Do Different Types of Testing Goals Affect Test Case Design?
IFIP-ICTSS 35th International Conference on Testing Software and Systems
Dia Istanbuly , Max Zimmer , Gregory Gay Chalmers | University of Gothenburg
Pre-print
10:00
30m
Talk
Empirical Verification of TQED - a New Test Design Heuristic Technique
IFIP-ICTSS 35th International Conference on Testing Software and Systems
10:30
30m
Talk
Who is Afraid of Test Smells? Assessing Technical Debt from Developer Actions
IFIP-ICTSS 35th International Conference on Testing Software and Systems
Zhongyan Chen The University of Manchester, Suzanne Embury , Markel Vigo
11:30 - 12:30
11:30
60m
Keynote
Failure Analysis in CPS Simulink Models
IFIP-ICTSS 35th International Conference on Testing Software and Systems
Leonardo Mariani University of Milano-Bicocca
14:00 - 15:30
Session on Test GenerationIFIP-ICTSS 35th International Conference on Testing Software and Systems at Room 5 - Conference room
Chair(s): Gregory Gay Chalmers | University of Gothenburg
14:00
30m
Talk
Seeding Contradiction: a fast method for generating full-coverage test suites
IFIP-ICTSS 35th International Conference on Testing Software and Systems
Li Huang Constructor Institute Schaffhausen, Bertrand Meyer Constructor Institute Schaffhausen, Manuel Oriol Constructor Institute Schaffhausen
14:30
30m
Talk
A Rapid Review on Fuzz Security Testing for Software Protocol Implementations
IFIP-ICTSS 35th International Conference on Testing Software and Systems
Alessandro Marchetto Università di Trento
15:00
30m
Talk
On the Evaluation of Photometric Stereo Application Testing
IFIP-ICTSS 35th International Conference on Testing Software and Systems
Franz Wotawa Graz University of Technology, Ledio Jahaj Technische Universitaet Graz, Nicole Brosch
16:00 - 17:30
Session on AI and smart contactsIFIP-ICTSS 35th International Conference on Testing Software and Systems at Room 5 - Conference room
Chair(s): Bertrand Meyer Constructor Institute Schaffhausen
16:00
30m
Talk
Testing Quality of Training in QoE-aware SFC Orchestration based on DRL Approach
IFIP-ICTSS 35th International Conference on Testing Software and Systems
Mohamed Escheikh , Wiem Taktak Yakoub , Kamel Barkaoui CEDRIC - CNAM - Paris, France
16:30
20m
Talk
GResilience: Trading off between the Greenness and the Resilience of Collaborative AI Systems
IFIP-ICTSS 35th International Conference on Testing Software and Systems
Diaeddin Rimawi Free University of Bozen-Bolzano, Antonio Liotta , Marco Todescato , Barbara Russo Free University of Bolzano
16:50
20m
Talk
CATANA: Replay Testing for the Ethereum Blockchain
IFIP-ICTSS 35th International Conference on Testing Software and Systems
17:10
20m
Talk
Applying Pairwise Combinatorial Testing to Large Language Model Testing
IFIP-ICTSS 35th International Conference on Testing Software and Systems
Bernhard Garn SBA Research, Ludwig Kampel , Manuel Leithner SBA Research, Berina Celic , Ceren Çulha , Irene Hiess , Klaus Kieseberg , Marlene Koelbing , Dominik-Philip Schreiber MATRIS Research Group, SBA Research, Michael Wagner , Christoph Wech , Jovan Zivanovic MATRIS Research Group, SBA Research, Dimitris Simos SBA Research
18:00 - 18:20
Career AwardIFIP-ICTSS 35th International Conference on Testing Software and Systems at Room 5 - Conference room

Alexandre Petrenko will be awarded the ICTSS career award 2023. The ceremony is open to all https://shorturl.at/bfpy4

Wed 20 Sep

Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

09:10 - 10:40
09:10
30m
Talk
Compositionality in Model-Based Testing
IFIP-ICTSS 35th International Conference on Testing Software and Systems
Gijs van Cuyck Radboud University Nijmegen, Lars van Arragon , Jan Tretmans Radboud University Nijmegen, TNO-ESI
09:40
30m
Talk
A Systematic Literature Review on prioritizing software test cases using Markov chains
IFIP-ICTSS 35th International Conference on Testing Software and Systems
Gerson Barbosa Eldorado Institute, Érica F. Souza Federal Technological University of Paraná, Cornélio Procópio - PR, Luciana Rebelo GSSI, Marlon Silva , Juliana Balera , Nandamudi Vijaykumar
10:10
30m
Talk
Complete Property-Oriented Module Testing
IFIP-ICTSS 35th International Conference on Testing Software and Systems
11:10 - 12:30
Session on Test automation and design IFIP-ICTSS 35th International Conference on Testing Software and Systems at Room 5 - Conference room
Chair(s): Natalia Kushik SAMOVAR, Télécom SudParis, Institut Polytechnique de Paris
11:10
20m
Talk
Automated Testing of Systems of Systems
IFIP-ICTSS 35th International Conference on Testing Software and Systems
Özge Akat , Hasan Sozer Ozyegin University
11:30
30m
Talk
Understanding Problem Solving in Software Testing: An Exploration of Tester Routines and Behavior
IFIP-ICTSS 35th International Conference on Testing Software and Systems
Eduard Paul Enoiu Mälardalen University, Gregory Gay Chalmers | University of Gothenburg, Jameel Esber , Robert Feldt Chalmers | University of Gothenburg, Blekinge Institute of Technology
Pre-print
12:00
30m
Talk
Enhancing Synthetic Test Data Generation with Language Models Using a More Expressive Domain-Specific Language
IFIP-ICTSS 35th International Conference on Testing Software and Systems
14:00 - 15:20
Session on Test design and Model Based testing IFIP-ICTSS 35th International Conference on Testing Software and Systems at Room 5 - Conference room
Chair(s): Claudio Menghi University of Bergamo; McMaster University
14:00
30m
Talk
RQCODE: Security Requirements Formalization with Testing
IFIP-ICTSS 35th International Conference on Testing Software and Systems
Ildar Nigmatullin , Andrey Sadovykh Softeam, Sophie Ebersold , Nan Messe IRIT - University of Toulouse
14:30
30m
Talk
Prioritizing test cases with Markov Chains: a Preliminary Investigation
IFIP-ICTSS 35th International Conference on Testing Software and Systems
Luciana Rebelo GSSI, Érica F. Souza Federal Technological University of Paraná, Cornélio Procópio - PR, Gian Berkenbrock , Gerson Barbosa Eldorado Institute, Marlon Silva , André T. Endo Federal University of São Carlos, Brazil, Nandamudi Vijaykumar , Catia Trubiani Gran Sasso Science Institute
15:00
20m
Talk
Probabilistic approach for minimizing checking sequences for non-deterministic FSMs
IFIP-ICTSS 35th International Conference on Testing Software and Systems
Natalia Kushik SAMOVAR, Télécom SudParis, Institut Polytechnique de Paris, Nina Yevtushenko , Jorge Lopez Airbus

Not scheduled yet

Not scheduled yet
Industry talk
TBD
IFIP-ICTSS 35th International Conference on Testing Software and Systems

Not scheduled yet
Social Event
Welcome reception
IFIP-ICTSS 35th International Conference on Testing Software and Systems

Not scheduled yet
Social Event
Surprise event
IFIP-ICTSS 35th International Conference on Testing Software and Systems

Not scheduled yet
Coffee break
Coffee break
IFIP-ICTSS 35th International Conference on Testing Software and Systems

Not scheduled yet
Social Event
Città Alta tour
IFIP-ICTSS 35th International Conference on Testing Software and Systems

Not scheduled yet
Day opening
Welcome and introductions
IFIP-ICTSS 35th International Conference on Testing Software and Systems

Not scheduled yet
Lunch
Lunch
IFIP-ICTSS 35th International Conference on Testing Software and Systems

Accepted Papers

Title
Applying Pairwise Combinatorial Testing to Large Language Model Testing
IFIP-ICTSS 35th International Conference on Testing Software and Systems
A Rapid Review on Fuzz Security Testing for Software Protocol Implementations
IFIP-ICTSS 35th International Conference on Testing Software and Systems
A Systematic Literature Review on prioritizing software test cases using Markov chains
IFIP-ICTSS 35th International Conference on Testing Software and Systems
Automated Testing of Systems of Systems
IFIP-ICTSS 35th International Conference on Testing Software and Systems
CATANA: Replay Testing for the Ethereum Blockchain
IFIP-ICTSS 35th International Conference on Testing Software and Systems
Complete Property-Oriented Module Testing
IFIP-ICTSS 35th International Conference on Testing Software and Systems
Compositionality in Model-Based Testing
IFIP-ICTSS 35th International Conference on Testing Software and Systems
Empirical Verification of TQED - a New Test Design Heuristic Technique
IFIP-ICTSS 35th International Conference on Testing Software and Systems
Enhancing Synthetic Test Data Generation with Language Models Using a More Expressive Domain-Specific Language
IFIP-ICTSS 35th International Conference on Testing Software and Systems
GResilience: Trading off between the Greenness and the Resilience of Collaborative AI Systems
IFIP-ICTSS 35th International Conference on Testing Software and Systems
How Do Different Types of Testing Goals Affect Test Case Design?
IFIP-ICTSS 35th International Conference on Testing Software and Systems
Pre-print
Multi-device, robust, and integrated Android GUI testing: A conceptual framework
IFIP-ICTSS 35th International Conference on Testing Software and Systems
On the Evaluation of Photometric Stereo Application Testing
IFIP-ICTSS 35th International Conference on Testing Software and Systems
Prioritizing test cases with Markov Chains: a Preliminary Investigation
IFIP-ICTSS 35th International Conference on Testing Software and Systems
Probabilistic approach for minimizing checking sequences for non-deterministic FSMs
IFIP-ICTSS 35th International Conference on Testing Software and Systems
RQCODE: Security Requirements Formalization with Testing
IFIP-ICTSS 35th International Conference on Testing Software and Systems
Seeding Contradiction: a fast method for generating full-coverage test suites
IFIP-ICTSS 35th International Conference on Testing Software and Systems
TBD
IFIP-ICTSS 35th International Conference on Testing Software and Systems

Testing Quality of Training in QoE-aware SFC Orchestration based on DRL Approach
IFIP-ICTSS 35th International Conference on Testing Software and Systems
Understanding Problem Solving in Software Testing: An Exploration of Tester Routines and Behavior
IFIP-ICTSS 35th International Conference on Testing Software and Systems
Pre-print
Who is Afraid of Test Smells? Assessing Technical Debt from Developer Actions
IFIP-ICTSS 35th International Conference on Testing Software and Systems

Call for Papers

IFIP-ICTSS is a well-established conference where researchers, developers, testers, and users from industry get together to present and discuss the most recent innovations, experiences and open challenges related to testing software and systems and measuring software quality.

For more information about the conference series, see https://sites.google.com/site/ictssmain/

Topics of interest include, but are not limited to:

  • Aspects of testing: test derivation, test selection, test generation, test coverage, test concretization, test implementation and execution, test result analysis, test oracle, verdict computation, test management, active testing and passive testing, monitoring and runtime verification.
  • Diversity on testing: diverse generation, selecting diverse test suites, foundations of testing and diversity, applications of entropy and Kolmogorov complexity on test suite diversity.
  • Theoretical approaches: formalisms (such as automata, state machines, process algebra, logics, Markov-chains…), testing frameworks, results for compositionality, refinement, soundness and completeness, addressing complex systems, heterogeneous or hybrid systems.
  • Modelling languages (such as UML, MATLAB, Simulink, Modelica…) and associated tooling for model-based testing: test generation from models, model-based oracles. Scalability, traceability, quantification issues. Automated support of any parts of the testing activities, testing processes, test-driven development, sound metrics and measurements.
  • Testing of quality aspects: Functional, interoperability, unit, integration, performance, load, conformance, non-regression, reliability, robustness.
  • Security Testing: methodologies and techniques for continuous security assessment, security monitoring, security review, penetration testing, verification of certification compliance; automation of security testing processes.
  • Cross domains and combination of techniques: using other techniques such as proof, model-checking, symbolic execution, abstract interpretation, static analysis, simulation, model learning, machine learning, expert systems, neural networks, genetic algorithms… to improve quality and reduce the effort in testing processes.
  • Application aspects and case studies: Communicating systems such as cyberphysical systems, systems of systems, embedded systems, web services systems, smart grids, cloud computing systems, business information systems, real-time systems, distributed and concurrent systems. Case studies and industrial applications involving qualified empirical evaluations.

IFIP-ICTSS invites:

Full papers

The aim of the Full papers submission category is to describe original research contributions with sufficient evidence for the interest of the proposed approach ( 12 to 15 pages , plus at most 2 extra pages for references in the one-column Springer LNCS format).

Short papers or work-in-progress papers

The aim of the Short papers or work-in-progress papers submission category is to describe academic work in progress or tool implementations, as well as testing processes, achievements and feedbacks on testing methods for industrial case studies ( up to 6 pages plus at most 1 extra page for references in the one-column Springer LNCS format).

Journal-First

The aim of the Journal-First (JF) submission category is to further enrich the program of ICTSS, as well as to provide an overall more flexible path to publication and dissemination of original research that is within the scope of ICTSS. A submission in this category must adhere to the following criteria:

  • It should be clearly within the scope of the conference.
  • It should be recent: it should have been accepted and made publicly available in a journal (online or in print) by January 1, 2021 or more recently.
  • It has not been presented at, and is not under consideration for, Journal- First tracks of other conferences or workshops.
  • The submission has to be in the form of a 4-pages extended abstract and has to provide a concise summary of the published journal paper.
  • Journal-First submissions must be marked as such in the submission’s, and must explicitly include full bibliographic details (including a DOI) of the journal publication they are based on. Since the referenced journal papers have already been reviewed and accepted by the corresponding journals, submissions in the JF category will not be reviewed again for technical content. Submissions will be judged on the basis of the above criteria, but also considering how well they would complement the conference’s technical program. Accepted submissions in this category will be part of the proceedings of ICTSS 2023, with the title equal to the original title of the article with the prefix Summary of.

The submission link is https://equinocs.springernature.com/service/ICTSS2023


The papers will be published by Springer in the LNCS volume.

Authors should consult Springer’s Instructions for Authors of Proceedings and use either the LaTeX or the Word templates provided on the authors’ page. Springer’s proceedings LaTeX templates are available in Overleaf.

Authors are encouraged to include their ORCIDs in their papers.


SPECIAL ISSUE

Best papers of the conference will be invited to submit an extended version of their article at a special (topical) issue of the Springer Nature of Computer Science https://www.springer.com/journal/42979. Deadline will be near the end of January 2024 with a tentative publication date for the middle 2024.

Filter
Role Type
Country
Search

Results (131)

A
Aichernig, Bernhard
Graz University of TechnologyAustria
Akat, Özge
Amrani, Moussa
University of NamurBelgium
Arcaini, Paolo
National Institute of Informatics Japan
Ardito, Luca
Politecnico di TorinoItaly
Arisholm, Erik
B
Balera, Juliana
Barboni, Morena
Barbosa, Gerson
Eldorado InstituteBrazil
Barkaoui, Kamel
CEDRIC - CNAM - Paris, FranceFrance
Bazzana, Gualtiero
ITA-STQB
Behjati, Razieh
Berkenbrock, Gian
Bertolino, Antonia
National Research Council, ItalyItaly
Bonfanti, Silvia
University of BergamoItaly
Brosch, Nicole
Brüning, Felix
C
Camilli, Matteo
Politecnico di MilanoItaly
Campos, José
University of Porto, PortugalPortugal
Casola, Valentina
Università di Napoli Federico IIItaly
Cavalli, Ana Rosa
ana.cavalli@it-sudparis.eu
Celic, Berina
Cengiz Türker, Uraz
Lancaster University (UK)United Kingdom
Chen, Zhongyan
The University of ManchesterUnited Kingdom
Clark, David
University College LondonUnited Kingdom
Coppola, Riccardo
Politecnico di TorinoItaly
D
De Angelis, Guglielmo
CNR-IASIItaly
De Benedictis, Alessandra
alessandra.debenedictis@unina.it
Denti, Marco
Gruppo San DonatoItaly
Dziarek, Maciej
ABB
E
Ebersold, Sophie
El-Fakih, Khaled
American University of SharjahUnited Arab Emirates
Embury, Suzanne
Endo, André T.
Federal University of São Carlos, BrazilBrazil
Enoiu, Eduard Paul
Mälardalen UniversitySweden
Esber, Jameel
Escheikh, Mohamed
F
F. Souza, Érica
Federal Technological University of Paraná, Cornélio Procópio - PRBrazil
Feldt, Robert
Chalmers | University of Gothenburg, Blekinge Institute of TechnologySweden
G
Gargantini, Angelo
University of BergamoItaly
Garn, Bernhard
SBA ResearchAustria
Gaston, Christophe
christophe.gaston@cea.fr
Gay, Gregory
Chalmers | University of GothenburgSweden
Gleirscher, Mario
University of BremenGermany
Gomes de Oliveira Neto, Francisco
Chalmers University of Technology, Sweden / University of GothenburgSweden
H
Hierons, Robert
University of SheffieldUnited Kingdom
Hiess, Irene
Higashino, Teruo
Hryszko, Jarosław
Huang, Li
Constructor Institute Schaffhausen
Huang, Wen-ling
I
Istanbuly, Dia
Sweden
J
Jahaj, Ledio
Technische Universitaet Graz
Jmaiel, Mohamed
Ecole Nationale d'Ingénieurs de SfaxTunisia
K
Kaluzny, Rafal
ABB
Kampel, Ludwig
Khendek, Ferhat
Concordia UniversityCanada
Kieseberg, Klaus
Koelbing, Marlene
Kosmatov, Nikolai
CEA ListFrance
Krafczyk, Niklas
Krichen, Moez
Kushik, Natalia
SAMOVAR, Télécom SudParis, Institut Polytechnique de ParisFrance
L
Le Gall, Pascale
CentraleSupelecFrance
Lefticaru, Raluca
University of BradfordUnited Kingdom
Lei, Jeff Yu
University of Texas at ArlingtonUnited States
Leithner, Manuel
SBA ResearchAustria
Liotta, Antonio
Lopez, Jorge
AirbusFrance
Lut, Yana
ABB
M
Maag, Stephane
Mallouli, Wissam
France
Marchetto, Alessandro
Università di TrentoItaly
Mariani, Leonardo
University of Milano-BicoccaItaly
Medina-Bulo, Inmaculada
Universidad de CádizSpain
Menendez, Hector
Middlesex University London
Menendez, Hector
King’s College LondonUnited Kingdom
Menghi, Claudio
University of Bergamo; McMaster UniversityItaly
Merayo, Mercedes G.
Universidad Complutense de MadridSpain
Messe, Nan
IRIT - University of ToulouseFrance
Meyer, Bertrand
Constructor Institute Schaffhausen
Mnich, Michał
Montes de Oca, Edgardo
MontimageFrance
Mora, Davide
ABB
Morichetta, Andrea
Mousavi, Mohammad Reza
King's College LondonUnited Kingdom
N
Nigmatullin, Ildar
Núñez, Manuel
Universidad Complutense de MadridSpain
O
Oriol, Manuel
Constructor Institute Schaffhausen
P
Pecchia, Antonio
Peleska, Jan
Petke, Justyna
University College LondonUnited Kingdom
Pietrantuono, Roberto
Università di Napoli Federico II
Polini, Andrea
Polo, Macario
University of Castilla-La ManchaSpain
R
RAK, Massimiliano
massimiliano.rak@unicampania.it
Rebelo, Luciana
GSSIItaly
Rimawi, Diaeddin
Free University of Bozen-BolzanoItaly
Roman, Adam
Russo, Barbara
Free University of BolzanoItaly
S
Sachtleben, Robert
Sadovykh, Andrey
SofteamFrance
Salvaneschi, Paolo
Salvaneschi & PartnersItaly
Schreiber, Dominik-Philip
MATRIS Research Group, SBA Research
Silva, Marlon
Simos, Dimitris
SBA Research
Sozer, Hasan
Ozyegin UniversityTurkey
Spezia, Daniela
TXT Quence
T
Taktak Yakoub, Wiem
Tan, Chao
Todescato, Marco
Torchiano, Marco
Politecnico di TorinoItaly
Tramontana, Porfirio
Tretmans, Jan
Radboud University Nijmegen, TNO-ESINetherlands
Trubiani, Catia
Gran Sasso Science InstituteItaly
V
van Arragon, Lars
van Cuyck, Gijs
Radboud University NijmegenNetherlands
Vannutelli, Edoardo
UNGUESS
Vigo, Markel
Vijaykumar, Nandamudi
Villano, Umberto
W
Wagner, Michael
Wech, Christoph
Wotawa, Franz
Graz University of TechnologyAustria
Y
Yenigün, Hüsnü
Sabanci University, Turkey
Yevtushenko, Nina
Z
Zaidi, Fatiha
LRI, Université Paris-Sud
Zani, Gianluca
TXT Quence
Zimmer, Max
Zivanovic, Jovan
MATRIS Research Group, SBA Research
Ç
Çulha, Ceren