TCSE logo 
 Sigsoft logo
Sustainability badge
Sat 3 May 2025 16:51 - 17:06 at 203 - Qualitative Aspects Chair(s): Andreas Jedlitschka

Context: The degree of observed software development cost estimation error is sometimes used to make claims about software developers’ estimation skills. The connection between estimation error and estimation skills may, however, be non-trivial. A careful analysis of other elements affecting the observed estimation errors may be needed to make claims about estimation skills and identify proper cost estimation improvements. Goal: This paper aims to model and analyze how observed estimation errors and estimation skills are connected. Method: First, I present a model containing elements affecting the observed cost estimation error. Then, I discuss and illustrate what would be needed for additional information and analyses to derive estimation ability from the observed estimation error. Results: The estimation error-related elements included in the model are, in addition to estimation skill, the elements inherent (irreducible) estimation error, estimation error dynamics, lack of match between error measure and estimation type, selection bias, and measurement error of actual cost. The potential impact of these elements on the observed estimation error and how to analyze them are exemplified. Conclusion: It is challenging to derive estimation ability from the observed cost estimation errors. Despite this, it is important to be aware of how different elements not related to estimation skill affect the observed estimation error. This may not only help avoid a false attribution of high (low) estimation error to low (high) estimation skills but also as a means to examine the reasons behind the observed cost estimation error and identify proper improvement actions.

Sat 3 May

Displayed time zone: Eastern Time (US & Canada) change

16:00 - 17:30
Qualitative AspectsWSESE at 203
Chair(s): Andreas Jedlitschka Fraunhofer IESE
16:00
18m
Talk
Exploring How SE Academic Papers Use Figures
WSESE
Marco Torchiano Politecnico di Torino, Lorenzo Laudadio Politecnico di Torino
DOI Pre-print
16:18
18m
Talk
Integrating Positionality Statements in Empirical Software Engineering Research
WSESE
Breno Felix de Sousa Federal University of Pernambuco, Ronnie de Souza Santos University of Calgary, Kiev Gama Universidade Federal de Pernambuco
16:36
15m
Talk
Methodological and Practical Challenges in Longitudinal, Large Scale, Collaborative Questionnaire Survey Research
WSESE
Miikka Kuutila Dalhousie University, Paul Ralph Dalhousie University
16:51
15m
Talk
Analyzing and interpreting software development cost estimation error
WSESE
Magne Jørgensen Simula Metropolitan Center for Digital Engineering
Pre-print
17:06
19m
Live Q&A
Qualitative Aspects: Discussion
WSESE

17:25
5m
Other
Conclusions
WSESE
Sira Vegas Universidad Politecnica de Madrid, Andreas Jedlitschka Fraunhofer IESE
:
:
:
: