Write a Blog >>
ICSE 2022
Sun 8 - Fri 27 May 2022
Thu 12 May 2022 22:15 - 22:20 at ICSE room 2-even hours - Release Engineering and DevOps 2 Chair(s): Xin Peng
Fri 13 May 2022 04:25 - 04:30 at ICSE room 3-even hours - Release Engineering and DevOps 1 Chair(s): Ritu Kapur

Continuous Integration (CI) is a popular practice that enables the rapid pace of modern software development. Cloud-based CI services have made CI ubiquitous by relieving software teams of the hassle of maintaining a CI infrastructure. To improve these CI services, prior research has focused on analyzing historical CI data to help service consumers. However, finding areas of improvement for CI service providers could also improve the experience for service consumers. To search for these opportunities, we conduct an empirical study of 22.2 million builds spanning 7,795 open-source projects that used CircleCI from 2012 to 2020.

First, we quantitatively analyze the builds (i.e., invocations of the CI service) with passing or failing outcomes. We observe that the heavy and typical service consumer groups spend significantly different proportions of time on seven of the nine build actions (e.g., dependency retrieval). On the other hand, the compilation and testing actions consistently consume a large proportion of build time across consumer groups (median 33%). Second, we study builds that terminate prior to generating a pass or fail signal. Through a systematic manual analysis, we find that availability issues, configuration errors, user cancellation, and exceeding time limits are key reasons that lead to premature build termination.

Our observations suggest that (1) heavy service consumers would benefit most from build acceleration approaches that tackle long build durations (e.g., skipping build steps) or high throughput rates (e.g., optimizing CI service job queues), (2) efficiency in CI pipelines can be improved for most CI consumers by focusing on the compilation and testing stages, and (3) avoiding misconfigurations and tackling service availability issues present the largest opportunities for improving the robustness of CI services.

Thu 12 May

Displayed time zone: Eastern Time (US & Canada) change

22:00 - 23:00
22:00
5m
Talk
An Empirical Study on Release Notes Patterns of Popular Apps in the Google Play Store
Journal-First Papers
Aidan Z.H. Yang Carnegie Mellon University, Safwat Hassan Thompson Rivers University, Ying Zou Queen's University, Kingston, Ontario, Ahmed E. Hassan Queen's University
Link to publication DOI Pre-print Media Attached
22:05
5m
Talk
Software Batch Testing to Save Build Test Resources and to Reduce Feedback Time
Journal-First Papers
Mohammad Javad Beheshtian Concordia University, Amir Bavand Concordia University, Peter Rigby Concordia University, Montreal, Canada
Link to publication DOI Media Attached
22:10
5m
Talk
DevOps Education: An Interview Study of Challenges and Recommendations
SEET - Software Engineering Education and Training
Marcelo Fernandes Federal Institute of Rio Grande do Norte, Samuel Ferino Federal University of Rio Grande do Norte, Anny Fernandes Federal University of Rio Grande do Norte, Uirá Kulesza Federal University of Rio Grande do Norte, Eduardo Aranha Federal University of Rio Grande do Norte, Christoph Treude University of Melbourne
Pre-print Media Attached
22:15
5m
Talk
Lessons from Eight Years of Operational Data from a Continuous Integration Service: A Case Study of CircleCINominated for Distinguished Paper
Technical Track
Keheliya Gallaba McGill University, Maxime Lamothe Polytechnique Montréal, Shane McIntosh University of Waterloo
Pre-print Media Attached
22:20
5m
Talk
Towards Language-independent Brown Build Detection
Technical Track
Doriane Olewicki Polytechnique Montréal, Mathieu Nayrolles Ubisoft Montreal, Bram Adams Queen's University, Kingston, Ontario
Link to publication Media Attached

Fri 13 May

Displayed time zone: Eastern Time (US & Canada) change

04:00 - 05:00
Release Engineering and DevOps 1Technical Track / Journal-First Papers / NIER - New Ideas and Emerging Results at ICSE room 3-even hours
Chair(s): Ritu Kapur University of Sannio
04:00
5m
Talk
An Empirical Study on Release Notes Patterns of Popular Apps in the Google Play Store
Journal-First Papers
Aidan Z.H. Yang Carnegie Mellon University, Safwat Hassan Thompson Rivers University, Ying Zou Queen's University, Kingston, Ontario, Ahmed E. Hassan Queen's University
Link to publication DOI Pre-print Media Attached
04:05
5m
Talk
Within-project Defect Prediction of Infrastructure-as-Code Using Product and Process Metrics
Journal-First Papers
Stefano Dalla Palma Tilburg University, Dario Di Nucci University of Salerno, Fabio Palomba University of Salerno, Damian Andrew Tamburri TU/e
Link to publication DOI Authorizer link Pre-print Media Attached
04:10
5m
Talk
Are You Still Working on This? An Empirical Study on Pull Request Abandonment
Journal-First Papers
Zhixing Li College of Computer, National University of Defense Technology, Changsha, China, Yue Yu College of Computer, National University of Defense Technology, Changsha 410073, China, Tao Wang National University of Defense Technology, Gang Yin National University of Defense Technology, Shanshan Li National University of Defense Technology, Huaimin Wang National University of Defense Technology
Link to publication DOI Pre-print File Attached
04:15
5m
Talk
Towards Incremental Build of Software Configurations
NIER - New Ideas and Emerging Results
Georges Aaron RANDRIANAINA Université de Rennes 1, IRISA, Djamel Eddine Khelladi CNRS, France, Olivier Zendra INRIA, Mathieu Acher Univ. Rennes 1, Inria, IRISA, Institut Universitaire de France (IUF)
Pre-print Media Attached
04:20
5m
Talk
Change Is the Only Constant: Dynamic Updates for WorkflowsBest Artifact Award
Technical Track
Daniel Sokolowski University of St. Gallen, Pascal Weisenburger University of St. Gallen, Guido Salvaneschi University of St. Gallen
DOI Pre-print Media Attached
04:25
5m
Talk
Lessons from Eight Years of Operational Data from a Continuous Integration Service: A Case Study of CircleCINominated for Distinguished Paper
Technical Track
Keheliya Gallaba McGill University, Maxime Lamothe Polytechnique Montréal, Shane McIntosh University of Waterloo
Pre-print Media Attached

Information for Participants
Thu 12 May 2022 22:00 - 23:00 at ICSE room 2-even hours - Release Engineering and DevOps 2 Chair(s): Xin Peng
Info for room ICSE room 2-even hours:

Click here to go to the room on Midspace

Fri 13 May 2022 04:00 - 05:00 at ICSE room 3-even hours - Release Engineering and DevOps 1 Chair(s): Ritu Kapur
Info for room ICSE room 3-even hours:

Click here to go to the room on Midspace