ICST 2023
Sun 16 - Thu 20 April 2023 Dublin, Ireland

The Demonstrations track seeks to bridge the gap between research and practice, focusing on software testing, verification, and validation. Its main goal is to advance both the state of ​the ​art and the state ​of ​the practice.

The submission details:

  • Demonstrations of testing-related tools and prototypes with an extended abstract (max 2 pages + references) and a demo video of 3-5 mins

Accepted extended abstracts will be published in ICST conference proceedings.

ICST 2023 Demonstrations Track Call for Papers

The Demonstrations track seeks to bridge the gap between research and practice, focusing on software testing, verification, and validation. Its main goal is to advance both the state of ​the ​art and the state ​of ​the practice.

The submission details:

  • Demonstrations of testing-related tools and prototypes with an extended abstract (max 2 pages + references) and a demo video of 3-5 mins

Accepted extended abstracts will be published in ICST conference proceedings.

Demonstrations should show and discuss advances in Verification and Validation Research through running demos. The demonstrations should clearly communicate the following information to the audience:

  • The envisioned users of the tool
  • The software engineering challenge the tool addresses
  • The testing process or testing technique implemented by the tool
  • The implied use case scenario for its users
  • The potential ways that the tool could be extended (by the authors or the community) in the future.

Highlighting scientific contributions through concrete artifacts is an important supplement to the traditional ICST research papers. A demonstration provides the opportunity to communicate how the scientific approach has been implemented or how a specific hypothesis has been assessed, including details such as implementation and usage issues, data models and representations, or APIs for tool and data access. Authors of regular research papers are thus also encouraged to submit an accompanying demonstration paper.

The tool itself should be made available, if not already, for researchers or practitioners to use. At minimum, the tool should be accessible (either free to download or for purchase). If possible, the source code of the tool should also be available as well. Exceptions will be made to this rule if a valid reason is provided for why the tool cannot be released (e.g., organizational rules or it was developed for internal use in a company and cannot be made public).

Areas of interest:

The Demonstrations Track invites submissions related, but not limited, to the following areas:

  • Design and development of novel tools for software testing, verification, and validation;
  • Working prototypes for novel research approaches, reporting on the technical challenges and early feedback obtained from practitioners;
  • Strategies and challenges for tool adoption as well as lessons learned from technology transfer of academic approaches into open source or commercial tools;
  • Case studies and/or experiments involving tools in particular contexts, reporting on lessons learned and negative results (if any).

Evaluation:

Each submission will be evaluated based on:

  • The relevance and significance of the addressed problem.
  • The innovation element of the approach.
  • The availability, maturity, and adoption of the tool.
  • The presence of lessons learned from developing or using the tool.
  • The quality of the presentation.

Accepted extended abstracts will appear in the conference or companion proceedings and the IEEE digital library.

Relationship to Testing Tools Track:

Authors of tool papers will be asked to give a demonstration of the tool, in the same way as the authors of demonstration papers (extended abstracts). The extra page space for tool papers compared to demonstration papers is to provide more insight about the tool and how it can be used (e.g., about the Software Engineering challenges and lessons learned behind building such tools). Therefore, authors of tool papers are not allowed to submit a demonstration paper for the same tool. In the case in which the insights provided by a tool paper are not considered of sufficient scientific and engineering quality, the paper could still be accepted as a (shorter) Demonstrations abstract instead (if the authors agree).

Submission​:

Submissions will be handled via Easychair (ICST2023 / Demonstrations Track):

The Demonstrations Track of ICST 2022 uses ​single-anonymous reviewing,​ which means that authors and tools do not have to be anonymized​. All submitted papers must conform to the two ​column IEEE conference publication format. Templates for Latex and Word are available at: http://www.ieee.org/conferences_events/conferences/publishing/templates.html;​

  • It must conform to the IEEE Conference Proceedings Formatting Guidelines (please use the letter format template and conference option).
  • Extended abstracts must be submitted as PDF.
  • Extended abstracts of demonstrations must not exceed 2 pages, including all text, figures, tables, and appendices; one additional page containing only references is permitted.
  • Demo submissions must have a demo video with length of 3 - 5 minutes, and the submission must have a link to an online location that allows reviewers to watch it.

The submission must also comply with the ACM plagiarism policy and procedures. In particular, the same content must not have been published elsewhere and must not be under review elsewhere while under review for ICST. The submission must also comply with the IEEE Policy on Authorship.