In recent years, many industries have utilized machine learning (ML) models in their systems. Ideally, ML models should be trained on and applied to data from the same distributions. However, the data evolves over time in many applications, leading to concept drift, which in turn causes the ML model performance to degrade. Therefore, maintaining up-to-date ML models plays a critical role in the MLOps pipeline. Existing ML model maintenance approaches are often computationally resource-intensive, costly, time-consuming, and model-dependent. Thus, we propose an improved MLOps pipeline, a new model maintenance approach and a Similarity-Based Model Reuse tool to address the challenges of ML model maintenance. We identify seasonal and recurrent data distribution patterns in time series datasets. Recurrent data distribution patterns enable us to reuse previously trained models for similar distributions in the future, thus avoiding unnecessary retrainings. Then, we integrate the model reuse approach into the MLOps pipeline and propose our improved MLOps pipeline. Furthermore, we develop a tool that stores and reuses models for inference on future data with similar distributions. Experiments on five datasets show that our model reuse approach preserves performance while cutting maintenance costs by 87.5%, offering a cost-effective solution for maintaining ML model performance in deployment.
Thu 16 AprDisplayed time zone: Brasilia, Distrito Federal, Brazil change
16:00 - 17:30 | Software Engineering for AI 6Journal-first Papers / Demonstrations / Research Track / New Ideas and Emerging Results (NIER) at Oceania VII Chair(s): Henry Muccini University of L'Aquila, Italy | ||
16:00 15mTalk | TenderChat with Dynamic RAG: A Prompt-Adaptive RAG Framework for Australian Government Tender Analysis Demonstrations Hayden Fowler University of Technology Sydney, Ruihan Xie University of Technology Sydney, Morteza Saberi University of Technology Sydney, Ali Braytee University of Technology Sydney | ||
16:15 15mTalk | PreServe: Intelligent Management for LMaaS Systems via Hierarchical PredictionDistinguished Paper Award Research Track Zhihan Jiang The Chinese University of Hong Kong, Yujie Huang The Chinese University of Hong Kong, Guangba Yu The Chinese University of Hong Kong, Junjie Huang The Chinese University of Hong Kong, Jiazhen Gu Chinese University of Hong Kong, Michael Lyu The Chinese University of Hong Kong | ||
16:30 15mTalk | From Tea Leaves to System Maps: Context-awareness in Monitoring Operational Machine Learning Models Journal-first Papers Joran Leest Vrije Universiteit Amsterdam, Claudia Raibulet Vrije Universiteit Amsterdam, Patricia Lago Vrije Universiteit Amsterdam, Ilias Gerostathopoulos Vrije Universiteit Amsterdam | ||
16:45 15mTalk | Specification and Detection of LLM Code Smells New Ideas and Emerging Results (NIER) Brahim Mahmoudi École de technologie supérieure, Zacharie Chenail-Larcher École de technologie supérieure (ÉTS), Naouel Moha École de Technologie Supérieure (ETS), Quentin Stiévenart Université du Québec à Montréal, Florent AVELLANEDA Université du Québec à Montréal | ||
17:00 15mTalk | A First Look at Model Supply Chain: From the Risk Perspective Research Track Ziqian Chen Fudan University, Zekai Chen Fudan University, Susheng Wu Fudan University, Bihuan Chen Fudan University, Wenyan Song Carnegie Mellon University, Yiheng Huang Fudan University, Zhuotong Zhou Fudan University, Yiheng Cao Fudan University, Xin Peng Fudan University Media Attached | ||
17:15 15mTalk | An Efficient Model Maintenance Approach for MLOps Journal-first Papers Forough Majidi Polytechnique Montreal, Foutse Khomh Polytechnique Montréal, Heng Li Polytechnique Montréal, Amin Nikanjam Huawei Canada | ||