SWITCH: An Exemplar for Evaluating Self-Adaptive ML-Enabled SystemsARTIFACT
Addressing runtime uncertainties in Machine Learning-Enabled Systems (MLS) is crucial for maintaining Quality of Service (QoS). The Machine Learning Model Balancer is a concept that addresses these uncertainties by facilitating dynamic ML model switching, showing promise in improving QoS in MLS. Leveraging this concept, this paper introduces SWITCH, an exemplar developed to enhance self-adaptive capabilities in such systems through dynamic model switching in runtime. SWITCH is designed as a comprehensive web service catering to a broad range of ML scenarios, with its implementation demonstrated through an object detection use case. SWITCH provides researchers with a flexible platform to apply and evaluate their ML model switching strategies, aiming to enhance QoS in MLS. SWITCH features advanced input handling, real-time data processing, and logging for adaptation metrics supplemented with an interactive real-time dashboard for enhancing system observability. This paper details SWITCH’s architecture, self-adaptation strategies through ML model switching, and its empirical validation through a case study, illustrating its potential to improve QoS in MLS. By enabling a hands-on approach to explore adaptive behaviors in ML systems, SWITCH contributes a valuable tool to the SEAMS community for research into self-adaptive mechanisms for MLS and their practical applications.
Tue 16 AprDisplayed time zone: Lisbon change
11:00 - 12:30 | Session 6: Self-Recovery & Evaluation Research Track / Artifact Track at Luis de Freitas Branco Chair(s): Dalal Alrajeh Imperial College London | ||
11:00 25mTalk | Raft Protocol for Fault Tolerance and Self-Recovery in Federated LearningFULL Research Track | ||
11:25 25mTalk | Integrating Graceful Degradation and Recovery through Requirement-driven AdaptationFULL Research Track Simon Chu Carnegie Mellon University, Justin Koe The Cooper Union, David Garlan Carnegie Mellon University, Eunsuk Kang Carnegie Mellon University | ||
11:50 25mTalk | Learning Recovery Strategies for Dynamic Self-healing in Reactive SystemsFULL Research Track Mateo Sanabria Universidad de los Andes, Ivana Dusparic Trinity College Dublin, Ireland, Nicolás Cardozo Universidad de los Andes Pre-print | ||
12:15 15mTalk | SWITCH: An Exemplar for Evaluating Self-Adaptive ML-Enabled SystemsARTIFACT Artifact Track Pre-print Media Attached |