Write a Blog >>
EASE 2021
Mon 21 - Thu 24 June 2021
Tue 22 Jun 2021 13:22 - 13:45 at Zoom - Research method and requirements engineering Chair(s): Stefanie Betz

Background: Publication bias is the failure to publish the results of a study based on the direction or strength of the study findings. The existence of publication bias is firmly established in areas like medical research. Recent research suggests the existence of publication bias in Software Engineering. Aims: Finding out whether experiments published in the International Workshop on Empirical Software Engineering and Measurement (ESEM) are affected by publication bias. Method: We review experiments published in ESEM. We also survey with experimental researchers to triangulate our findings. Results: ESEM experiments do not define hypotheses and frequently perform multiple testing. One-tailed tests have a slightly higher rate of achieving statistically significant results. We could not find other practices associated with publication bias. Conclusions: Our results provide a more encouraging perspective of SE research than previous research: (1) ESEM publications do not seem to be strongly affected by biases and (2) we identify some practices that could be associated with p-hacking, but it is more likely that they are related to the conduction of exploratory research.

Tue 22 Jun

Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

13:00 - 14:30
Research method and requirements engineeringEASE 2020 at Zoom
Chair(s): Stefanie Betz Furtwangen University
Reasoning about Uncertainty in Empirical Results
EASE 2020
Neil Walkinshaw University of Sheffield, Martin Shepperd Brunel University London
Publication Bias: A Detailed Analysis of Experiments Published in ESEM
EASE 2020
Rolando Reyes Universidad de las Fuerzas Armadas ESPE, Oscar Dieste Universidad Politécnica de Madrid, Efraín R. Fonseca C. Universidad de las Fuerzas Armadas ESPE, Natalia Juristo Universidad Politecnica de Madrid
DOI Pre-print File Attached
On the Understanding of Experimentation in Lean Startup in a Large-Scale Software Development Context
EASE 2020
Bruna Prauchner Vargas PUCRS, Brazil, Ingrid Signoretti PUCRS, Brazil, Maximilian Zorzetti PUCRS, Brazil, Sabrina Marczak PUCRS, Ricardo Bastos PUCRS, Brazil
Vision and Emerging Results
Formal vs. Case-study-based Approaches for the Identification of Cultural Influences in Requirements Engineering
EASE 2020
Tawfeeq alsanoosy RMIT university, Maria Spichkova RMIT University, Australia, James Harland RMIT university