ToCaMS 2020
Wed 28 Oct 2020 Porto, Portugal
co-located with ICST 2020

ToCaMS 2020, the first ICST Workshop on Testing of Configurable and Multi-variant Systems, will focus on methods and tools for the automated generation and execution of tests for software-based systems that are highly configurable and customizable. As more and more software-based products and services are available in many different variants, new challenges for the software quality assurance processes arise. In this workshop, both foundational and practical testing problems will be discussed, and possible solutions from an academic and industrial perspective will be presented.

All information about this workshop can be found at the workshop’s official website:

You're viewing the program in a time zone which is different from your device's time zone change time zone

Wed 28 Oct

Displayed time zone: Lisbon change

09:00 - 10:30
Session IToCaMS 2020 at Miragaia
Welcome Session
ToCaMS 2020

Keynote: Product Line Testing with pure::variants and Beyond
ToCaMS 2020
Danilo Beuche Leipzig University
Social Event
World Cafe
ToCaMS 2020

11:00 - 12:30
Session IIToCaMS 2020 at Miragaia
Towards a Deep Learning Model for Vulnerability Detection on Web Application Variants
ToCaMS 2020
Ana Fidalgo LASIGE, Faculdade de Ciências da Universidade de Lisboa, Ibéria Medeiros LaSIGE, Faculdade de Ciências da Universidade de Lisboa, Paulo Antunes LASIGE, Faculdade de Ciências da Universidade de Lisboa, Nuno Neves DI FC UL
Link to publication DOI
Test Design with the Classification Tree Method in Presence of Variants
ToCaMS 2020
Vladimir Schmidt Expleo Germany GmbH, Berlin, Peter M. Kruse Expleo Group
Link to publication DOI
Regression Test Suite Reduction for Cloud Systems
ToCaMS 2020
Oussama Jebbar Gina Cody School of Engineering and Computer Science, Concordia University, Montreal, Mohamed Aymen Saied Concordia University, Ferhat Khendek  Concordia University, Maria Toeroe Ericsson Inc, Montreal
Link to publication DOI

Call for Submissions

Submission Guidelines

All papers must be original and not simultaneously submitted to another journal or conference. The following paper categories are welcome: Research papers describing original research, new results, methods and tools in testing of variable and configurable systems. A page limit of 12 pages applies to research papers. Experience papers describing case studies, applications, experiences, and best practices in testing of variable and configurable systems. A page limit of 4-8 pages applies to experience papers.

All accepted papers will be published in the IEEE ICSTW proceeding.


Due to increasing market diversification and customer demand, more and more software-based products and services are customizable or are designed in the form of many different variants. This brings about new challenges for the software quality assurance processes: How shall the variability be modelled in order to make sure that all features are being tested? Is it better to test selected variants on a concrete level, or can the generic software and baseline be tested abstractly? Can knowledge-based AI techniques be used to identify and prioritize test cases? How can the quality of a generic test suite be assessed? What are appropriate coverage criteria for configurable modules? If it is impossible to test all possible variants, which products and test cases should be selected for test execution? Can security-testing methods be leveraged to an abstract level? In this workshop, these and related questions will be discussed both from a practical and from a foundational viewpoint. It should be interesting for researchers from the software testing community, as well as for testing experts from industry who want to learn about the latest methods and tools in the field. Besides new theoretical results, we also welcome problem statements, case studies, experience reports, tool presentations and survey papers.

Following is a non-exhaustive list of topics to be discussed at the workshop:

  • Test modelling,
  • Test generation,
  • Test priorization,
  • Test selection,
  • Test execution,
  • Test evaluation, and
  • Test assessment

for variable and configurable systems.

Submission link:

Questions? Use the ToCaMS contact form.