ICSE 2024
Fri 12 - Sun 21 April 2024 Lisbon, Portugal
Wed 17 Apr 2024 16:30 - 16:45 at Sophia de Mello Breyner Andresen - Analytics 2 Chair(s): Grace Lewis

Continuous integration and continuous delivery (CI/CD) has become a prevalent practice in software development. GitHub Actions is emerging as a popular platform for implementing CI/CD pipelines, called workflows, especially because the platform offers 2,000 minutes of computation for free to public repositories each month. To understand what these resources are used for and whether CI/CD could be more efficient, this paper presents the first comprehensive empirical study of resource usage and optimization opportunities of GitHub Action workflows. Our findings show that CI/CD imposes significant costs, e.g., $504 per year for an average paid-tier repository. The majority of the used resources is consumed by testing and building (91.2%), which is triggered by commits (30.9%), pull requests (50.7%), and regularly scheduled workflows (15.5%). While existing optimizations, such as caching (adopted by 32.9% of paid-tier repositories), demonstrate a positive impact, they overall remain underutilized. This result underscores the need for enhanced documentation and tools to guide developers toward more resource-efficient workflows. Moreover, we show that relatively simple changes in the platform, such as deactivating scheduled workflows when repositories are inactive, could result in reductions of execution time between 1.1% and 31.6% over the impacted workflows. Overall, we hope that our findings help improve the resource efficiency of CI/CD pipelines.

Wed 17 Apr

Displayed time zone: Lisbon change

16:00 - 17:30
Analytics 2Research Track / Journal-first Papers / Demonstrations at Sophia de Mello Breyner Andresen
Chair(s): Grace Lewis Carnegie Mellon Software Engineering Institute
16:00
15m
Talk
LogShrink: Effective Log Compression by Leveraging Commonality and Variability of Log Data
Research Track
Xiaoyun Li Sun Yat-sen University, Hongyu Zhang Chongqing University, Van-Hoang Le The University of Newcastle, Pengfei Chen Sun Yat-sen University
Pre-print
16:15
15m
Talk
Demystifying Compiler Unstable Feature Usage and Impacts in the Rust Ecosystem
Research Track
Chenghao Li Zhejiang University, Yifei Wu Zhejiang University, Wenbo Shen Zhejiang University, China, Zichen Zhao Zhejiang University, Rui Chang Zhejiang University, Chengwei Liu Nanyang Technological University, Yang Liu Nanyang Technological University, Kui Ren Zhejiang University
DOI Pre-print Media Attached
16:30
15m
Talk
Resource Usage and Optimization Opportunities in Workflows of GitHub Actions
Research Track
Islem BOUZENIA University of Stuttgart, Michael Pradel University of Stuttgart
Pre-print
16:45
15m
Talk
Revealing Hidden Threats: An Empirical Study of Library Misuse in Smart Contracts
Research Track
Mingyuan Huang Sun Yat-Sen University, Jiachi Chen Sun Yat-sen University, Zigui Jiang Sun Yat-sen University, Zibin Zheng Sun Yat-sen University
17:00
7m
Talk
A Grounded Theory of Cross-community SECOs: Feedback Diversity vs. Synchronization
Journal-first Papers
Armstrong Foundjem Queens University, Ellis E. Eghan University of Cape Coast, Ghana, Bram Adams Queen's University
17:07
7m
Talk
Studying the Characteristics of AIOps Projects on GitHub
Journal-first Papers
Roozbeh Aghili Polytechnique Montréal, Heng Li Polytechnique Montréal, Foutse Khomh École Polytechnique de Montréal
17:14
7m
Talk
A First Look at Dark Mode in Real-World Android App
Journal-first Papers
Suyu Ma Monash University, Chunyang Chen Technical University of Munich (TUM), Hourieh Khalajzadeh Deakin University, Australia, John Grundy Monash University
Link to publication DOI Pre-print
17:21
7m
Talk
GitBug-Actions: Building Reproducible Bug-Fix Benchmarks with GitHub Actions
Demonstrations
Nuno Saavedra INESC-ID and IST, University of Lisbon, André Silva KTH Royal Institute of Technology, Martin Monperrus KTH Royal Institute of Technology