ICSE 2024
Fri 12 - Sun 21 April 2024 Lisbon, Portugal

Context: The constant growth of primary evidence and Systematic Literature Reviews (SLRs) publications in the Software Engineering (SE) field leads to the need for SLR Updates. However, searching and selecting evidence for SLR updates demands significant effort from SE researchers. Objective: We present emerging results on an automated approach to support searching and selecting studies for SLR updates in SE. Method: We developed an automated tool prototype to perform the snowballing search technique and to support the selection of relevant studies for SLR updates using Machine Learning (ML) algorithms. We evaluated our automation proposition through a small-scale evaluation with a reliable dataset from an SLR replication and its update. Results: Effectively automating snowballing-based search strategies showed feasibility with minor losses, specifically related to papers without Digital Object Identifier (DOI). The ML algorithm giving the highest performance to select studies for SLR updates was Linear Support Vector Machine with approximately 74% recall and 15% precision. The use of such algorithms with conservative thresholds to minimize the risk of missing papers can already significantly reduce evidence selection efforts. Conclusion: The preliminary results of our evaluation point in promising directions, indicating the potential of automating snowballing search efforts and of reducing the number of papers to be manually analyzed by about 2.5 times when selecting evidence for updating SLRs in SE.

Tue 16 Apr

Displayed time zone: Lisbon change

11:00 - 12:30
Session 2 - Quality of evidence generated & Secondary StudiesWSESE at Eugénio de Andrade
Chair(s): Andreas Jedlitschka Fraunhofer IESE
11:00
12m
Talk
Evidence Tetris in the Pixelated World of Validity Threats
WSESE
Marvin Wyrich Saarland University, Sven Apel Saarland University
Pre-print
11:12
12m
Talk
Revisiting the construct and assessment of industrial relevance in software engineering research
WSESE
Kai Petersen Blekinge Institute of Technology/Ericsson AB, J�rgen B�rstler Blekinge Institute of Technology, Nauman Bin Ali Blekinge Institute of Technology, Emelie Engstrom Lund University
11:24
15m
Talk
Grounded Theory in Software Engineering: Challenges and Lessons Learned from the Trenches
WSESE
Pilar Rodriguez Universidad Politécnica de Madrid
11:39
18m
Talk
A Second Look at the Impact of Passive Voice Requirements on Domain Modeling: Bayesian Reanalysis of an Experiment
WSESE
Julian Frattini Blekinge Institute of Technology, Davide Fucci Blekinge Institute of Technology, Richard Torkar Chalmers and the University of Gothenburg, Daniel Mendez Blekinge Institute of Technology and fortiss
DOI Pre-print
11:57
18m
Talk
Emerging Results on Automated Support for Searching and Selecting Evidence for Systematic Literature Review Updates
WSESE
Bianca Minetto Napoleão Université du Québec à Chicoutimi, Ritika Sarkar Université du Québec à Chicoutimi, Sylvain Hallé Université du Québec à Chicoutimi, Fabio Petrillo École de technologie supérieure (ÉTS), Montréal -- Université du Québec, Marcos Kalinowski Pontifical Catholic University of Rio de Janeiro (PUC-Rio)
12:15
15m
Talk
Apples, Oranges, and Software Engineering: Study Selection Challenges for Secondary Research on Latent Variables
WSESE
Marvin Wyrich Saarland University, Marvin Muñoz Barón University of Stuttgart, Justus Bogner Vrije Universiteit Amsterdam
Pre-print