ICSSP 2023
Sun 14 - Mon 15 May 2023 Melbourne, Australia
co-located with ICSE 2023
Sun 14 May 2023 13:45 - 14:05 at Meeting Room 104 - Paper Session 2 (Process Improvement)

In software projects, stakeholders can give valuable feedback on software demonstrations. Demonstrating software early and responding to feedback is crucial in agile development. However, it is difficult for stakeholders who are not on-site customers but end users, marketing people, or designers, etc. to give feedback in an agile development environment. Successful Graphical User Interface (GUI) tests, which show the working GUI with expected software behaviors, can be documented and then demonstrated for feedback.

In our new concept, GUI tests are recorded, extended, and demonstrated as videos. A GUI test is divided into several GUI unit tests, which are specified in Gherkin, a semi-structured natural language. For each GUI unit test, a video is generated during test execution. Test steps specified in Gherkin are traced and highlighted in the video. Stakeholders review these generated videos and provide feedback, e.g., on misunderstandings of requirements or on inconsistencies. To evaluate the impact of videos in identifying inconsistencies, we asked 22 participants to identify inconsistencies between (1) given requirements in regular sentences and (2) demonstrated behaviors from videos with Gherkin specifications or from Gherkin specifications alone.

Our results show that participants tend to identify more inconsistencies from demonstrated behaviors which are not in accordance with given requirements. They tend to recognize inconsistencies more easily through videos than through Gherkin specifications alone. We conclude that GUI test videos can help stakeholders give feedback more effectively. By obtaining early feedback, inconsistencies can be resolved, thus contributing to higher stakeholder satisfaction.

Sun 14 May

Displayed time zone: Hobart change

13:45 - 15:15
Paper Session 2 (Process Improvement)ICSSP 2023 at Meeting Room 104
13:45
20m
Full-paper
Using GUI Test Videos to Obtain Stakeholders’ Feedback
ICSSP 2023
Jianwei Shi Leibniz University Hannover, Jonas Mönnich Leibniz University Hannover, Jil Klünder Leibniz Universität Hannover, Kurt Schneider Leibniz Universität Hannover, Software Engineering Group
14:05
20m
Full-paper
Measuring the Benefits of CI/CD Practices for Database Application Development
ICSSP 2023
Jasmin Fluri Schaltstelle GmbH, Fabrizio Fornari University of Camerino, Italy, Ela Pustulka FHNW
14:25
20m
Full-paper
On Preparing and Assessing Data for Simulation Process Modeling: An Industrial Report
ICSSP 2023
Liming Dong Nanjing University, He Zhang Nanjing University, Yue Li , Bohan Liu Nanjing University, Zhiluo Weng Nanjing University
14:45
20m
Full-paper
Adding Generic Role- and Process-based Behaviors to Smart Contracts using Dynamic Condition Response Graphs
ICSSP 2023
Yibin Xu University of Copenhagen, Tijs Slaats University of Copenhagen, Boris Düdder University of Copenhagen, Thomas T. Hildebrandt University of Copenhagen