A Framework for Automating the Measurement of DevOps Research and Assessment (DORA) Metrics
The DevOps Research and Assessment (DORA) metrics have been widely accepted by the software industry as a powerful method to quantify DevOps performance, leading to significant interest in their measurement. Existing proprietary solutions are highly customised, and require specific types of cloud infrastructure, limiting their suitability for projects such as libraries, frameworks, and open source projects. To address this gap, we present a framework which operationalizes the DORA metrics independently of a project’s software development life-cycle or type of deployment. We demonstrate the general applicability of this framework by using it to calculate the throughput and stability of 304 popular open source repositories. We find that the time-series data it produces provides meaningful insights into the trending direction of a project’s recent and retrospective throughput and stability performance, especially when significant changes in metrics are correlated with major events in the project’s history. We conclude with recommendations for augmenting our approach with additional information such as bug criticality when such information is available.
Wed 4 OctDisplayed time zone: Bogota, Lima, Quito, Rio Branco change
13:30 - 15:00 | Mining Software RepositoriesResearch Track / New Ideas and Emerging Results Track / Industry Track at Session 1 Room - RGD 004 Chair(s): Denys Poshyvanyk William & Mary, Esteban Parra Belmont University | ||
13:30 16mTalk | The Future Can’t Help Fix The Past: Assessing Program Repair In The Wild Research Track Vinay Kabadi The University of Melbourne, Dezhen Kong Zhejiang University, Siyu Xie Zhejiang University, Lingfeng Bao , Gede Artha Azriadi Prana Singapore Management University, Tien-Duy B. Le Singapore Management University, Xuan-Bach D. Le University of Melbourne, David Lo Singapore Management University | ||
13:46 16mTalk | Process Mining from Jira Issues at a Large Company Industry Track Bavo Coremans Thermo Fisher Scientific, Arjen Klomp Thermo Fisher Scientific, Satrio Adi Rukmono , Jacob Krüger Eindhoven University of Technology, Dirk Fahland Eindhoven University of Technology, Michel Chaudron Eindhoven University of Technology, The Netherlands | ||
14:02 16mTalk | Software Bill of Materials Adoption: A Mining Study from GitHub Research Track Sabato Nocera University of Salerno, Simone Romano University of Salerno, Massimiliano Di Penta University of Sannio, Italy, Rita Francese University of Salerno, Giuseppe Scanniello University of Salerno | ||
14:18 11mTalk | An Empirical Study on the Use of Snapshot Testing New Ideas and Emerging Results Track Shun Fujita Kyoto University, Yutaro Kashiwa Nara Institute of Science and Technology, Bin Lin Radboud University, Hajimu Iida Nara Institute of Science and Technology | ||
14:29 16mTalk | A Framework for Automating the Measurement of DevOps Research and Assessment (DORA) Metrics Research Track Brennan Wilkes University of Victoria, Alessandra Maciel Paz Milani University of Victoria, Margaret-Anne Storey University of Victoria | ||
14:45 15mLive Q&A | 1:1 Q&A Research Track | ||