Benchmarking ongoing development output in real-life software projects
In this case study we use detailed data from four software industry projects with overall 264 months of development and 1.1 million SLoC to compare six different metrics and their suitability for productivity benchmarking on development output level. Code change, absolute growth and number of commits as well as invested effort are measured in consecutive 3-month periods. This allows us to observe alterations in productivity throughout the course of a project as well as inter-project comparisons. We find correlations between effort and the chosen output metrics as well as significant and explainable productivity differences between projects and project phases. We also analyze whether the use of a clone detection algorithm can improve measurement by adjusting for copy & paste additions and renamed or moved code, and find that a small benefit exists. The redundancy-adjusted amount of code tokens added or modified seems to be the best metric among the selected, in particular in ongoing development where an already existing codebase is changed. Number of commits and absolute growth may complement the picture.
Wed 4 DecDisplayed time zone: Athens change
14:00 - 15:30 | PROFES Session 10: Measurement and Smart Contract DevelopmentResearch Papers / Industry Papers / Short Papers and Posters at UT Library - Room 3 (Seminar Room Kodavere) Chair(s): Lidia López Universitat Politècnica de Catalunya, Spain | ||
14:00 18mResearch paper | Towards Generating Measurable Artifact Models from Standards in Regulated Domains Research Papers Mustafa Bülbül Reutlingen University, Philipp Straub Reutlingen University, Jürgen Münch Reutlingen University, Marco Kuhrmann Reutlingen University | ||
14:18 18mIndustry talk | Benchmarking ongoing development output in real-life software projects Industry Papers | ||
14:36 12mShort-paper | Software Engineering Practices in Smart Contract Development: A Systematic Mapping Study Short Papers and Posters Antonios Giatzis University of Macedonia, Elvira-Maria Arvanitou University of Macedonia, Danai Papadopoulou University of Macedonia, Theodoros Maikantis University of Macedonia, Nikolaos Nikolaidis University of Macedonia, Daniel Feitosa University of Groningen, Christos Georgiadis University of Macedonia, Apostolos Ampatzoglou University of Macedonia, Alexander Chatzigeorgiou University of Macedonia, Evdokimos Konstantinidis Aristotle University, Panagiotis Bamidis Aristotle University | ||
14:48 42mTalk | Session 10 Discussion Research Papers |