Analyzing and interpreting software development cost estimation error
Context: The degree of observed software development cost estimation error is sometimes used to make claims about software developers’ estimation skills. The connection between estimation error and estimation skills may, however, be non-trivial. A careful analysis of other elements affecting the observed estimation errors may be needed to make claims about estimation skills and identify proper cost estimation improvements. Goal: This paper aims to model and analyze how observed estimation errors and estimation skills are connected. Method: First, I present a model containing elements affecting the observed cost estimation error. Then, I discuss and illustrate what would be needed for additional information and analyses to derive estimation ability from the observed estimation error. Results: The estimation error-related elements included in the model are, in addition to estimation skill, the elements inherent (irreducible) estimation error, estimation error dynamics, lack of match between error measure and estimation type, selection bias, and measurement error of actual cost. The potential impact of these elements on the observed estimation error and how to analyze them are exemplified. Conclusion: It is challenging to derive estimation ability from the observed cost estimation errors. Despite this, it is important to be aware of how different elements not related to estimation skill affect the observed estimation error. This may not only help avoid a false attribution of high (low) estimation error to low (high) estimation skills but also as a means to examine the reasons behind the observed cost estimation error and identify proper improvement actions.
Sat 3 MayDisplayed time zone: Eastern Time (US & Canada) change
16:00 - 17:30 | |||
16:00 18mTalk | Exploring How SE Academic Papers Use Figures WSESE DOI Pre-print | ||
16:18 18mTalk | Integrating Positionality Statements in Empirical Software Engineering Research WSESE Breno Felix de Sousa Federal University of Pernambuco, Ronnie de Souza Santos University of Calgary, Kiev Gama Universidade Federal de Pernambuco | ||
16:36 15mTalk | Methodological and Practical Challenges in Longitudinal, Large Scale, Collaborative Questionnaire Survey Research WSESE | ||
16:51 15mTalk | Analyzing and interpreting software development cost estimation error WSESE Magne Jørgensen Simula Metropolitan Center for Digital Engineering Pre-print | ||
17:06 19mLive Q&A | Qualitative Aspects: Discussion WSESE | ||
17:25 5mOther | Conclusions WSESE |