Thu 7 Sep 2023 15:45 - 16:15 at f128 - Experimentation & Evaluation Chair(s): Travis Breaux

Recent approaches have investigated assisting users in making early trade-off decisions when the future evolution of project elements is uncertain. These approaches have demonstrated promise in their analytical capabilities; yet, stakeholders have expressed concerns about the readability of the models and resulting analysis, which builds upon Tropos. Tropos is based on formal semantics enabling automated analysis; however, this creates a problem of interpreting evidence pairs. The aim of our broader research project is to improve the process of model comprehension and decision making by improving how analysts interpret and make decisions. We extend and evaluate a prior approach, called EVO, which uses color to visualize evidence pairs. In this scientific evaluation paper, we explore the effectiveness and usability of EVO. We conduct an experiment (n=32) to measure any effect of using colors to represent evidence pairs. We find that with minimal training, untrained modelers were able to use the color visualization for decision making. The visualization significantly improves the speed of model comprehension and users found it helpful.

Thu 7 Sep

Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

15:45 - 17:15
Experimentation & EvaluationResearch Papers / RE@Next! Papers at f128
Chair(s): Travis Breaux Carnegie Mellon University
An Experiment on the Effects of using Color to Visualize Requirements Analysis TasksArtifact ReusableArtifact Available
Research Papers
A: Yesugen Baatartogtokh University of Massachusetts Amherst, A: Irene Foster Smith College, A: Alicia M. Grubb Smith College
Can Videos be Used to Communicate Non-functional Requirements? An Early Empirical Investigation
RE@Next! Papers
A: Sylwia Kopczyńska Poznan University of Technology, A: Jianwei Shi Leibniz University Hannover
A Comparative Evaluation of Requirement Template SystemsArtifact Available
Research Papers
A: Katharina Großer University of Koblenz, A: Marina Rukavitsyna University of Koblenz, A: Jan Jürjens University of Koblenz-Landau
DOI Pre-print File Attached