ICSA 2025
Mon 31 March - Fri 4 April 2025 Odense, Denmark

In the domain of Industry 4.0 Cyber-Physical Production Systems (CPPSs), Reinforcement Learning (RL) has gained momentum as an effective strategy for training intelligent agents in digital twins. Whilst the practice of Machine Learning Operations (MLOps) has become established as a holistic approach to automating workflows in supervised and unsupervised Machine Learning (ML), the extent to which MLOps practices are applicable to RL, particularly due to major differences between ML and RL concerning model deployment and model training, are not currently well-understood. The literature on RLOps as a paradigm is scarce. We tackle this open question by conducting an exploratory, qualitative, deductive-inductive industry case study on a CPPS, performing content analysis of CPPS artefacts, such as architectural schematics and source code, and understanding their relation to 22 known Architectural Design Decisions and 86 associated decision options through classification into four distinct emergent categories. Our findings help bridge the gap between MLOps and RLOps architectures, contributing novel insights into understanding the application of MLOps to RL and providing practical insights and inspiration for further research.

Thu 3 Apr

Displayed time zone: Brussels, Copenhagen, Madrid, Paris change

16:00 - 17:00
Software Development Practices and Technical Debt IIResearch Papers / New and Emerging Ideas at Main Hall (O100)
Chair(s): Patrizio Pelliccione Gran Sasso Science Institute, L'Aquila, Italy
16:00
15m
Research paper
Evaluation of MQTT Bridge Architectures in a Cross-Organizational Context
Research Papers
Keila Lima Western Norway University of Applied Sciences, Tosin Daniel Oyetoyan Western Norway University of Applied Sciences, Rogardt Heldal Western Norway University of Applied Science, Wilhelm Hasselbring Kiel University
Pre-print
16:15
15m
Research paper
A Map of Cloud-Native Practices and Tools to Address Desirable System Qualities
Research Papers
Haoran Wei University of Western Ontario, Nazim Madhavji Western University, John Steinbacher IBM
16:30
15m
Paper
Toward Organizational Decoupling in Microservices Through Key Developer Allocation
New and Emerging Ideas
Xiaozhou Li Free University of Bozen-Bolzano, Noman Ahmad University of Oulu, Tomas Cerny University of Arizona, Andrea Janes Free University of Bozen-Bolzano, Valentina Lenarduzzi University of Oulu, Davide Taibi University of Oulu
16:45
15m
Research paper
Bridging the Gap Between MLOps and RLOps: An Industry 4.0 Case Study on Architectural Design Decisions in Practice
Research Papers
Stephen John Warnett University of Vienna, Uwe Zdun University of Vienna
Link to publication Pre-print
:
:
:
: