ICTSS 2025
Wed 17 - Fri 19 September 2025 Limassol, Cyprus
co-located with ECSA 2025
Thu 18 Sep 2025 11:30 - 12:00 at Atrium C - Frameworks and Test Automation Chair(s): Petra van den Bos

We present a family of distributed algorithms for Critical Test Generation (CTG). CTG subsumes the problems of requirement falsification and scenario generation, two important methods for safety validation of cyber-physical systems. In this article, we explore different strategies to parallelize and distribute a CTG algorithm based on generative models for test generation. By leveraging the sampling flexibility of generative models, our designs scale from synchronous to fully asynchronous distribution while maintaining test diversity. To ensure practical deployment across environments, the solution also considers scalability, data security, and compatibility with different systems under test through an implementation-agnostic architecture, in which the PaaS and SaaS layers support seamless migration and hybrid extensions. Experiments across multiple systems and distribution scales show that all distributed CTG variants outperform the sequential baseline in both efficiency and effectiveness. Among them, the fully asynchronous variant delivers the best results, combining fast execution with broad falsification capability. These results highlight the practical and generalizable potential of distributed CTG algorithms for testing complex systems in large-scale settings.

Thu 18 Sep

Displayed time zone: Athens change

11:00 - 12:30
Frameworks and Test AutomationGeneral Track at Atrium C
Chair(s): Petra van den Bos University of Twente, The Netherlands
11:00
30m
Talk
Introducing CreaTest: a framework for test case generation in itemis CREATE
General Track
Andrea Bombarda University of Bergamo, Silvia Bonfanti University of Bergamo, Angelo Gargantini University of Bergamo, Nico Pellegrinelli University of Bergamo
11:30
30m
Talk
Distributed Critical Test Generation for Cyber-Physical Systems
General Track
Ali Kaya Åbo Akademi University, Ivan Porres Åbo Akademi University
12:00
30m
Talk
Automating Performance Testing in CI/CD - Tools Evaluation
General Track
Maxim Pinyagin Innopolis University, Andrey Sadovykh Softeam