ICSE 2024
Fri 12 - Sun 21 April 2024 Lisbon, Portugal

The quality of requirements specifications may impact subsequent, dependent software engineering (SE) activities. However, empirical evidence of this impact remains scarce and too often superficial as studies abstract from the phenomena under investigation too much. One of these abstractions is caused by frequentist methods which reduce complex data to binary results. In this study, we aim to contrast frequentist methods with more sophisticated Bayesian methods for causal inference. To this end, we reanalyze the only known controlled experiment investigating the impact of passive voice on the subsequent activity of domain modeling. We follow a framework for statistical causal inference and employ Bayesian data analysis methods to re-investigate the hypotheses of the original study. Our results reveal that the effects observed by the original authors relying on frequentist methods turned out to be much less significant than previously assumed. This study supports the recent call to action in SE research to adopt Bayesian data analysis methods for more sophisticated causal inference.

Tue 16 Apr

Displayed time zone: Lisbon change

11:00 - 12:30
Session 2 - Quality of evidence generated & Secondary StudiesWSESE at Eugénio de Andrade
Chair(s): Andreas Jedlitschka Fraunhofer IESE
11:00
12m
Talk
Evidence Tetris in the Pixelated World of Validity Threats
WSESE
Marvin Wyrich Saarland University, Sven Apel Saarland University
Pre-print
11:12
12m
Talk
Revisiting the construct and assessment of industrial relevance in software engineering research
WSESE
Kai Petersen Blekinge Institute of Technology/Ericsson AB, J�rgen B�rstler Blekinge Institute of Technology, Nauman Bin Ali Blekinge Institute of Technology, Emelie Engstrom Lund University
11:24
15m
Talk
Grounded Theory in Software Engineering: Challenges and Lessons Learned from the Trenches
WSESE
Pilar Rodriguez Universidad Politécnica de Madrid
11:39
18m
Talk
A Second Look at the Impact of Passive Voice Requirements on Domain Modeling: Bayesian Reanalysis of an Experiment
WSESE
Julian Frattini Blekinge Institute of Technology, Davide Fucci Blekinge Institute of Technology, Richard Torkar Chalmers and the University of Gothenburg, Daniel Mendez Blekinge Institute of Technology and fortiss
DOI Pre-print
11:57
18m
Talk
Emerging Results on Automated Support for Searching and Selecting Evidence for Systematic Literature Review Updates
WSESE
Bianca Minetto Napoleão Université du Québec à Chicoutimi, Ritika Sarkar Université du Québec à Chicoutimi, Sylvain Hallé Université du Québec à Chicoutimi, Fabio Petrillo École de technologie supérieure (ÉTS), Montréal -- Université du Québec, Marcos Kalinowski Pontifical Catholic University of Rio de Janeiro (PUC-Rio)
12:15
15m
Talk
Apples, Oranges, and Software Engineering: Study Selection Challenges for Secondary Research on Latent Variables
WSESE
Marvin Wyrich Saarland University, Marvin Muñoz Barón University of Stuttgart, Justus Bogner Vrije Universiteit Amsterdam
Pre-print