ICSE 2024
Fri 12 - Sun 21 April 2024 Lisbon, Portugal

Background. Open science is put forward as a means to improve research accessibility, replicability, and consequently its quality. Empirical software engineering entails both data and artifacts, which may be shared more or less openly, to support transparency. How ever, the trade-offs involved in balancing the openness against integrity and secrecy concerns need methodological guidance. Aim. We aim to derive such advice, based on our own experiences from a research project, in the field of gaze-assisted code reviews – the Gander case. Method. We draw on literature about open data and artifacts in socio-technical research. Next, we describe our case project and derive a conceptual model of steps in research data analysis and artifact development, using our data and artifacts as illustrating examples. Results. The conceptual model contains 1) a categorization of humans involved as participants and their concerns, 2) four steps for data analysis, each resulting in corresponding data and meta-data, and 3) three steps of artifact distribution, matching different levels of openness. We derive a preliminary set of recommendations for open science practices for data and artifacts. Conclusion. The conceptual model has proven useful in summarizing and discussing data and artifacts in the studied case project. We envision that the model and recommendations will provide a foundation for further advancement of open science research practices in empirical, socio-technical software engineering.

Tue 16 Apr

Displayed time zone: Lisbon change

16:00 - 17:30
Session 4 - Presentation and Packaging & Panel & ConclusionsWSESE at Eugénio de Andrade
Chair(s): Sira Vegas Universidad Politecnica de Madrid
16:00
12m
Talk
FAIR enough: a Vision for Research Objects in Empirical Software Engineering Studies
WSESE
Davide Fucci Blekinge Institute of Technology
16:12
18m
Talk
A Conceptual Model and Recommendations for Open Data and Artifacts in Empirical Software Engineering
WSESE
Per Runeson Lund University, Emma Söderberg Lund University, Martin Höst Malmö University
16:30
12m
Talk
Insights Towards Better Case Study Reporting in Software Engineering
WSESE
Sergio Rico Mid Sweden University
Pre-print
16:42
33m
Panel
Fishbowl panel: Future Directions for Emprical Software Engineering
WSESE
Per Runeson Lund University, Marcos Kalinowski Pontifical Catholic University of Rio de Janeiro (PUC-Rio), Jefferson Seide Molléri Kristiania University, Audris Mockus The University of Tennessee, Knoxville / Vilnius University
17:15
15m
Conclusions
WSESE
Sira Vegas Universidad Politecnica de Madrid, Andreas Jedlitschka Fraunhofer IESE