ICSE 2025
Sat 26 April - Sun 4 May 2025 Ottawa, Ontario, Canada
Sat 3 May 2025 14:50 - 15:02 at 203 - Keynote & Secondary Studies Chair(s): Sira Vegas

Systematic Mapping Studies (SMSs) are a valuable tool in evidence-based software engineering research. SMSs aim to provide an overview of research, identify gaps and trends, and assess the feasibility of conducting a more focused systematic review of the literature. In current guidelines for conducting SMSs, a quality assessment of the included papers is suggested only when the research questions explicitly require a quality assessment of the included papers. We agree with the recommendation that quality assessment is generally non-mandatory. However, SMSs deal with papers ranging from opinion papers to papers reporting highly rigorous empirical studies. Therefore, in this paper, we argue that for almost every intended purpose of an SMS, an analysis of the type of papers is essential. Otherwise, without distinguishing papers based on their types, we risk deriving a less informative or incomplete overview or, at worst, a misleading overview of research. Petersen et al. `encourage’ the classification of papers into six paper types (evaluation research, solution proposal, validation research, philosophical papers, opinion papers, and personal experience papers) as proposed by Wieringa et al. Given the lenient guidelines on assessing the quality of included studies, we recommend a stronger focus on classifying papers by type.

Sat 3 May

Displayed time zone: Eastern Time (US & Canada) change

14:00 - 15:30
Keynote & Secondary StudiesWSESE at 203
Chair(s): Sira Vegas Universidad Politecnica de Madrid
14:00
50m
Keynote
Empirical Software Engineering in the Public Sector
WSESE
14:50
12m
Talk
The Role of Paper-Type in Systematic Mapping Studies in Software Engineering
WSESE
Nauman Ali Blekinge Institute of Technology, Jürgen Börstler Blekinge Institute of Technology
15:02
12m
Talk
On the difficulties of conducting and replicating systematic literature reviews studies using LLMs in software engineering
WSESE
Katia Romero Felizardo NAU RESHAPE LAB, Anderson Deizepe UTFPR-CP, Daniel Coutinho Pontifical Catholic University of Rio de Janeiro (PUC-Rio), Genildo Gomes da Silva Junior , Maria Alcimar Costa Meireles UFAM - Federal University of Amazonas, Marco Gerosa Northern Arizona University, Igor Steinmacher NAU RESHAPE LAB
15:14
16m
Live Q&A
Keynote & Secondary Studies: Discussion
WSESE