This program is tentative and subject to change.
One of the crucial activities in software development is monitoring. It plays a vital role in verifying the proper implementation of processes, the identification of errors, and the discovery of opportunities for improvement. Continuous Integration (CI) encompasses a set of widely adopted practices that enhance software development. However, there are indications that developers may not adequately monitor CI practices. Hence, this paper explores developers’ perceptions regarding monitoring CI practices. To achieve this, we first defined metrics associated with CI practices. Then, we conducted a series of analyses to evaluate how these metrics are perceived in projects or by their developers. As a starting point, we perform a Document Analysis to assess developers’ expressed need for practice monitoring in pull request comments generated by developers during the development process. After that, we conduct a survey of 28 developers from 121 open-source projects to understand the perception of the significance of monitoring seven CI practices in their projects. Finally, we triangulate the emergent themes from our survey by performing a second Document Analysis to understand the extent of monitoring features supported by existing CI services. Our key findings indicate that: 1) the most frequently mentioned CI practice during the development process is Write automated developer tests'', which is associated with the metricCoverage'' (> 80%), while Don't commit broken code'' andFix Broken Builds Immediately’ present notable opportunities for monitoring CI practices; 2) developers do not adequately monitor all CI practices and express interest in monitoring additional practices; and 3) the most popular CI services currently offer limited native support for monitoring CI practices, requiring the use of third-party tools. Our results lead us to conclude that monitoring CI practices is often overlooked by both CI services and developers. Using third-party tools in conjunction with CI services is challenging, they monitor some redundant practices, and they still fall short of fully supporting CI practices monitoring. Therefore, CI services should implement CI practice monitoring, which would facilitate and encourage developers to monitor them.
This program is tentative and subject to change.
Thu 16 AprDisplayed time zone: Brasilia, Distrito Federal, Brazil change
11:00 - 12:30 | Evolution 2SE In Practice (SEIP) / Journal-first Papers at Oceania VIII Chair(s): Timo Kehrer University of Bern | ||
11:00 15mTalk | How do Machine Learning Models Change? Journal-first Papers Joel Castaño Fernández Universitat Politècnica de Catalunya, Rafael Cabañas Department of Mathematics and CDTIME, University of Almería, Antonio Salmerón Department of Mathematics and CDTIME, University of Almería, David Lo Singapore Management University, Silverio Martínez-Fernández UPC-BarcelonaTech | ||
11:15 15mTalk | A Taxonomy of Contextual Factors in Continuous Integration Processes Journal-first Papers Shujun Huang Delft University of Technology (TU Delft), Sebastian Proksch Delft University of Technology | ||
11:30 15mTalk | Understanding the adoption of modern Javascript features: An empirical study on open-source systems Journal-first Papers Walter Lucas Monteiro de Mendonça University of Brasília, Rafael Nunes University of Brasília, Rodrigo Bonifácio Informatics Center - CIn/UFPE and Computer Science Department / University of Brasília, Fausto Carvalho University of Brasília, Ricardo Lima University of Brasília, Michael Silva University of Brasília, Adriano Torres University of Brasília, Paola Accioly Federal University of Pernambuco, Brazil, Eduardo Monteiro University of Brasília, João Saraiva | ||
11:45 15mTalk | Adapting Installation Instructions in Rapidly Evolving Software Ecosystems Journal-first Papers Haoyu Gao The University of Melbourne, Christoph Treude Singapore Management University, Mansooreh Zahedi The Univeristy of Melbourne | ||
12:00 15mTalk | On the Need to Monitor Continuous Integration Practices Journal-first Papers Jadson Santos Universidade Federal do Rio Grande do Norte, Daniel Alencar Da Costa University of Otago, Shane McIntosh University of Waterloo, Uirá Kulesza Federal University of Rio Grande do Norte | ||
12:15 15mTalk | Technical Credit: Industry Views on Benefits and BarriersDistinguished Paper Award SE In Practice (SEIP) Alessio Bucaioni Mälardalen University, Ian Gorton Northeastern University – Seattle, USA, Patrizio Pelliccione Gran Sasso Science Institute, L'Aquila, Italy | ||