Call for Contributions

Reusable, stable research artifacts greatly benefit the research community. This is why the Artifact Evaluation track invites authors of accepted ISSTA papers to submit their artifacts (data sets, scripts, tools, …) for evaluation by a dedicated Artifact Evaluation Committee. Authors of successfully evaluated artifacts enjoy the following benefits:

  • Award plaque on the paper
  • Mentioned on conference website
  • An extra page in the proceedings to describe the artifact
  • Invitation to demo the artifact in an open demo session

To be positively evaluated, submitted artifacts should provide replicability (different team, same experimental setup): The measurement can be obtained with stated precision by a different team using the same measurement procedure, the same measuring system, under the same operating conditions, in the same or a different location on multiple trials. For computational experiments, this means that an independent group can obtain the same result using the author’s own artifacts.