ESEIW 2022
Sun 18 - Fri 23 September 2022 Helsinki, Finland
Thu 22 Sep 2022 16:17 - 16:27 at Sonck - Session 3B - Registered Reports 1 Chair(s): Sérgio Soares

Background/Context: Classifications in meta-research enable researchers to cope with an increasing body of scientific knowledge. They provide a framework for, e.g., distinguishing methods, reports, reproducibility, and evaluation in a knowledge field as well as a common terminology. Likewise, they are important for the development of a research field. Both eases sharing, understanding and evolution of knowledge. In software engineering (SE), there are several classifications that describe the nature of SE research (e.g., classifications of research methods, replication types, types of SE contributions). Regarding the classification and consolidation of the huge body of knowledge in SE research, a generally applicable classification scheme is crucial. However, it is unclear whether existing classification schemes are suitable candidates. Moreover, the commonalities and differences among different classification schemes have rarely been studied. Due to the fact that classifications are documented textual, it is hard to catalog, reuse, and compare them. To the best of our knowledge, there is no research work so far that addresses documentation and systematic investigation of classifications in SE meta-research.

Objective/Aim: In this research work, we investigate provenance of SE research classifications and construct a unified, generally applicable classification scheme for SE meta-research by collecting and documenting a set of existing classification schemes and unifying their classes and categories. To validate the generality (i.e., whether it is both – general and specific enough) and appropriateness (i.e., whether it fully and correctly covers all relevant aspects of collected classifications), we compare our unified classification scheme with a set of collected classification employing existing metrics. Likewise, we evaluate the applicability of our scheme in a user study.

Method: Our research process is divided into three phases: construction, validation, and evaluation phase. For the construction phase, we perform a systematic literature review to identify, collect, and analyze a set of established SE research classifications. In the validation phase, we analyze individual categories and classes of selected and included papers. We use quantitative metrics from literature to conduct and assess the unification process to build a generally applicable classification scheme for SE research. Lastly, we investigate the applicability of the unified classification scheme in the evaluation phase. Therefore, we perform a workshop session followed by user studies w.r.t. investigations about reliability, correctness of classification tasks according to the unified scheme and user satisfaction (i.e., ease of use). The findings form the basis for further empirical studies that address the applicability of the unified scheme to real-world systems.

Thu 22 Sep

Displayed time zone: Athens change

15:45 - 17:00
Session 3B - Registered Reports 1ESEM Registered Reports at Sonck
Chair(s): Sérgio Soares Universidade Federal de Pernambuco
The Relevance of Model Transformation Language Features on Qualitative Properties of MTLs: A Study Protocol
ESEM Registered Reports
Stefan Höppner Ulm University, Matthias Tichy Ulm University, Germany
On the acceptance by code reviewers of candidate security patches suggested by Automated Program Repair tools
ESEM Registered Reports
Aurora Papotti Vrije Universiteit Amsterdam, Ranindya Paramitha University of Trento, Fabio Massacci University of Trento; Vrije Universiteit Amsterdam
DOI Pre-print
Does Road Diversity Really Matter in Testing Automated Driving Systems? A Registered Report
ESEM Registered Reports
Stefan Klikovits , Vincenzo Riccio USI Lugano, Ezequiel Castellano National Institute of Informatics, Ahmet Cetinkaya Shibaura Institute of Technology, Alessio Gambi IMC University of Applied Sciences Krems, Paolo Arcaini National Institute of Informatics
Link to publication
A Unified and Holistic Classification Scheme for Software Engineering Research
ESEM Registered Reports
Angelika Kaplan Karlsruhe Institute of Technology, Thomas Kühn Karlsruhe Institute of Technology, Ralf Reussner Karlsruhe Institute of Technology (KIT) and FZI - Research Center for Information Technology (FZI)
Studying the explanations for the automated prediction of bug and non-bug issues using LIME and SHAP
ESEM Registered Reports
Benjamin Ledel TU Clausthal, Steffen Herbold TU Clausthal
Team performance and large-scale agile software development
ESEM Registered Reports
Muhammad Ovais Ahmad Karlstad University, Hadi Ghanbari Aalto University, Tomas Gustavsson Karlstad University
Research paper
Comparative analysis of real bugs in open-source Machine Learning projects - A Registered Report
ESEM Registered Reports
Tuan Dung Lai Deakin University, Anj Simmons Deakin University, Scott Barnett Deakin University, Jean-Guy Schneider Deakin University, Rajesh Vasa Deakin University, Australia
Link to publication Pre-print