From Load Tests to Live Streams: Graph Embedding-Based Anomaly Detection in Microservice Architectures
Prime Video regularly conducts load tests to simulate the viewer traffic spikes seen during live events such as Thursday Night Football as well as video-on-demand (VOD) events such as Rings of Power. While these stress tests validate system capacity, they can sometimes miss service behaviors unique to real event traffic. We present a graph-based anomaly detection system that identifies under-represented services using unsupervised node-level graph embeddings. Built on a GCN-GAE, our approach learns structural representations from directed, weighted service graphs at minute-level resolution and flags anomalies based on cosine similarity between load test and event embeddings. The system identifies incident-related services that are documented and demonstrates early detection capability. We also introduce a preliminary synthetic anomaly injection framework for controlled evaluation that show promising precision (96%) and low false positive rate (0.08%), though recall (58%) remains limited under conservative propagation assumptions. This framework demonstrates practical utility within Prime Video while also surfacing methodological lessons and directions, providing a foundation for broader application across microservice ecosystems.
Wed 8 JulDisplayed time zone: Eastern Time (US & Canada) change
14:00 - 15:30 | Anomaly and failure 1Journal-First Paper / Industry Papers / Research Papers at MB 5.215 Chair(s): Mohamed Aymen Saied Concordia University | ||
14:00 20mTalk | EventADL: Open-Box Anomaly Detection and Localization Framework for Events in Cloud-Based Service Systems Research Papers Luan Pham University of New South Wales, Australia, Victor Nicolet Amazon, Joey Dodds Amazon, Inc., Hui Guan Amazon Web Services, USA, Daniel Kroening Amazon Pre-print | ||
14:20 20mTalk | A Comprehensive Study of Machine Learning Techniques for Log-Based Anomaly Detection Journal-First Paper Shan Ali University of Ottawa, Chaima Boufaied University of Calgary, Domenico Bianculli University of Luxembourg, Paula Branco University of Ottawa, Lionel Briand University of Ottawa, Canada; Lero centre, University of Limerick, Ireland | ||
14:40 10mTalk | From Load Tests to Live Streams: Graph Embedding-Based Anomaly Detection in Microservice Architectures Industry Papers Srinidhi Madabhushi Amazon Prime Video, Pranesh Vyas Amazon Prime Video, Swathi Vaidyanathan Amazon Prime Video, Mayur Premkumar Kurup Amazon.com, Elliott Nash Amazon Prime Video, Yegor Silyutin Amazon Prime Video | ||
14:50 20mTalk | Holmes: Multimodal Agentic Diagnosis for Mixed-Language Mobile Crashes at Industrial Scale Industry Papers Jia Li The Chinese University of Hong Kong, Wenyuan Ma Tencent Inc., Ting Peng Tencent Inc., Haibing Zheng Tencent, Yuetang Deng Tencent | ||
15:10 20mTalk | E2E-REME: Towards End-to-End Microservices Auto-Remediation via Experience-Simulation Reinforcement Fine-Tuning Industry Papers Lingzhe Zhang Peking University, China, Yunpeng Zhai Alibaba Group, Tong Jia Institute for Artificial Intelligence, Peking University, Beijing, China, Minghua He Peking University, Chiming Duan Peking University, Zhaoyang Liu Alibaba Group, Bolin Ding Alibaba Group, Ying Li School of Software and Microelectronics, Peking University, Beijing, China | ||