A Preliminary Investigation of MLOps Practices in GitHub
The rapid and growing popularity of machine learning (ML) applications has led to an increasing interest in MLOps, that is, the practice of continuous integration and deployment (CI/CD) of ML-enabled systems. Since changes may affect not only the code but also the ML model parameters and the data themselves, the automation of traditional CI/CD needs to be extended to manage model retraining in production. In this paper, we present an initial investigation of the MLOps practices implemented in a set of ML-enabled systems retrieved from GitHub, focusing on GitHub Actions and CML, two solutions to automate the development workflow. Our preliminary results suggest that the adoption of MLOps workflows in open-source GitHub projects is currently rather limited. Issues are also identified, which can guide future research work.
Fri 23 SepDisplayed time zone: Athens change
11:00 - 12:30 | Session 4A - DevOps & Development ApproachesESEM Emerging Results and Vision Papers / ESEM Technical Papers at Bysa Chair(s): Marcela Fabiana Genero Bocco University of Castilla-La Mancha | ||
11:00 20mFull-paper | Characterizing the Usage of CI Tools in ML Projects ESEM Technical Papers Dhia Elhaq Rzig University of Michigan - Dearborn, Foyzul Hassan University of Michigan - Dearborn, Chetan Bansal Microsoft Research, Nachiappan Nagappan Microsoft Research | ||
11:20 20mFull-paper | Investigating the Impact of Continuous Integration Practices on the Productivity and Quality of Open-Source Projects ESEM Technical Papers Jadson Santos Universidade Federal do Rio Grande do Norte, Daniel Alencar Da Costa University of Otago, Uirá Kulesza Federal University of Rio Grande do Norte | ||
11:40 20mFull-paper | Identifying Source Code File Experts ESEM Technical Papers Otávio Cury da Costa Castro Federal University of Piaui, Guilherme Amaral Avelino Federal University of Piaui, Pedro A. Santos Neto LOST/UFPI, Ricardo Britto Ericsson / Blekinge Institute of Technology, Marco Tulio Valente Federal University of Minas Gerais, Brazil Pre-print | ||
12:00 15mVision and Emerging Results | DevOps Practitioners’ Perceptions of the Low-code Trend ESEM Emerging Results and Vision Papers Saima Rafi University of Murcia, Muhammad Azeem Akbar LUT University, Mary Sánchez-Gordón Østfold University College, Ricardo Colomo-Palacios Østfold University College | ||
12:15 15mVision and Emerging Results | A Preliminary Investigation of MLOps Practices in GitHub ESEM Emerging Results and Vision Papers Fabio Calefato University of Bari, Filippo Lanubile University of Bari, Luigi Quaranta University of Bari, Italy |