Write a Blog >>
RE2021
Mon 20 - Fri 24 September 2021
Tue 21 Sep 2021 09:50 - 10:10 - Workshop: CrowdRE

Vision videos are established for soliciting feedback and stimulating discussions in requirements engineering (RE) practices such as focus groups. Different researchers motivated the transfer of these benefits into crowd-based RE (CrowdRE) by using vision videos on social media platforms. So far, however, little research explored the potential of using vision videos for CrowdRE in detail. In this paper, we analyze and assess this potential, in particular, focusing on video comments as a source of feedback. In a case study, we analyzed 4505 comments on a vision video from YouTube. We found that the video solicited 2770 comments from 2660 viewers in four days. This is more than 50% of all comments the video received in four years. Even though only a certain fraction of these comments are relevant to RE, the relevant comments address typical intentions and topics of user feedback, such as feature request or problem report. Besides the typical user feedback categories, we found more than 300 comments that address the topic safety, which has not appeared in previous analyses of user feedback. In an automated analysis, we compared the performance of three machine learning algorithms on classifying the video comments. Despite certain differences, the algorithms classified the video comments well. Based on these findings, we conclude that the use of vision videos for CrowdRE has a large potential. Despite the preliminary nature of the case study, we are optimistic that vision videos can motivate stakeholders to actively participate in a crowd and solicit numerous video comments as a valuable source of feedback.

Tue 21 Sep

Displayed time zone: Eastern Time (US & Canada) change

08:00 - 15:00
08:00
15m
Day opening
Welcome & CrowdRE’21 overview
Workshops

08:15
60m
Keynote
Keynote: “On the Value of CrowdRE in Research and Practice”
Workshops
Fabiano Dalpiaz Utrecht University
File Attached
09:15
15m
Break
Short Break
Workshops

09:30
20m
Talk
The Use of Sub-forums in Software Product Forums
Workshops
Hechen Wang University of Auckland, Peter Devine University of Auckland, James Tizard University of Auckland, Seyed Reza Shahamiri , Kelly Blincoe University of Auckland
09:50
20m
Talk
The Potential of Using Vision Videos for CrowdRE: Video Comments as a Source of Feedback
Workshops
Oliver Karras TIB - Leibniz Information Centre for Science and Technology, Eklekta Kristo Leibniz University Hannover, Jil Klünder Leibniz Universität Hannover
Pre-print Media Attached
10:10
20m
Talk
Viewing Vision Videos Online: Opportunities for Distributed Stakeholders
Workshops
Lukas Nagel Leibniz University Hannover, Jianwei Shi , Melanie Busch Leibniz University Hannover
10:30
30m
Break
Long Break
Workshops

11:00
20m
Talk
When the Developers Become the (Micro) Crowd: An Educational Case Study on Multidisciplinary Requirements Engineering
Workshops
Meira Levy Shenkar College of Engineering, Design and Art, Irit Hadar University of Haifa, Assaf Krebs Shenkar College of Engineering, Design and Art, Idit Barak Shenkar College of Engineering, Design and Art
11:20
20m
Talk
Researcher or Crowd Member? Why not both! The Open Research Knowledge Graph for Applying and Communicating CrowdRE Research
Workshops
Oliver Karras TIB - Leibniz Information Centre for Science and Technology, Eduard C. Groen Fraunhofer IESE, Javed Ali Khan University of Science and Technology Bannu, Sören Auer TIB - Leibniz Information Centre for Science and Technology
Pre-print Media Attached
11:40
20m
Talk
Voice of the Users: A study of software feedback differences between Germany and China
Workshops
James Tizard University of Auckland, Tim Rietz Karlsruhe Institute of Technology (KIT), Xuanhui Liu Zhejiang University, Kelly Blincoe University of Auckland
12:00
30m
Break
Long Break
Workshops

12:30
20m
Talk
Requirements for Online User Feedback Management in RE Tasks
Workshops
Maurizio Astegher Delta Informatica SpA, Paolo Busetta Delta Informatica SpA, Anna Perini Fondazione Bruno Kessler, Angelo Susi Fondazione Bruno Kessler
12:50
20m
Talk
Towards Trust in Complex Cloud-based ERP Systems by Informing Users about the System Status
Workshops
Markus Noebauer insideAx GmbH, Norbert Seyff FHNW & University of Zurich
13:10
20m
Talk
Applying Transfer Learning to Sentiment Analysis in Social Media
Workshops
Ariadna de Arriba Universitat Politècnica de Catalunya, Marc Oriol Universitat Politècnica de Catalunya, Xavier Franch Universitat Politècnica de Catalunya
13:30
15m
Break
Short Break
Workshops

13:45
60m
Panel
Interactive Session: “Crowdsourcing a Knowledge Graph on CrowdRE Research”
Workshops
Oliver Karras TIB - Leibniz Information Centre for Science and Technology, Eduard C. Groen Fraunhofer IESE
14:45
15m
Day closing
Discussion & Wrap Up
Workshops