KRCA: An Efficient Root Cause Analysis System in Hyper-scale Microservice Systems via Agentic AI
Hyper-scale microservice systems have become the standard infrastructure for large-scale Internet companies. These systems consist of numerous loosely coupled microservices that evolve independently through continuous development and deployment. Such complexity makes failures unavoidable, necessitating efficient Root Cause Analysis (RCA) to help Site Reliability Engineers (SREs) quickly localize root cause services and classify failure types. However, existing RCA methods often struggle to adapt to the extreme dynamism and massive scale of these systems. In this paper, we present KRCA, an end-to-end RCA system designed for hyper-scale microservice systems. To manage the vast search space, KRCA employs a multi-stage pipeline that begins with an API-level drilldown to isolate suspicious services. It then instantiates a skeleton-based causal graph from anomalous metrics to serve as a high-recall structural prior, before utilizing a memory-augmented multi-agent framework to verify causality and generate the final failure report. By combining structured causal constraints with multi-agent reasoning, KRCA balances diagnostic accuracy with the efficiency requirements of real-time production use. Experimental results show that KRCA achieves AC@1 scores of 0.88 and 0.79 for root cause service localization and failure type classification, outperforming the strongest baseline by at least 31% in absolute gains. KRCA has been deployed in Kuaishou's production environment for over six months, reducing the average diagnosis time by 77.3%.
Wed 14 OctDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
14:00 - 16:00 | Security and Other Non-Functional Properties: Reliability and Availability 3Research Papers / Journal First / Industry Showcase at Forum 15 | ||
14:00 15mTalk | HERO: Hypothesis-Centered Root-Cause Analysis for Microservice Incidents Research Papers Jiewei Lyu Sun Yat-sen University, Junquan Yi Sun Yat-sen University, Shu Liang Tencent, Pengfei Chen Sun Yat-sen University, Long Pan Tencent | ||
14:15 15mTalk | Observability of web applications: an industrial case study Journal First Anas Shatnawi Berger-Levrault, Bachar Rima Université de Montpellier, LIRMM, France, Zakarea AL SHARA Associate Professor, Software Engineering Department, Jordan University of Science and Technology , Gabriel Darbord Berger-Levrault, Abdelhak-Djamel Seriai University of Montpellier, France, Christophe Bortolaso Berger-Levault, France DOI | ||
14:30 15mTalk | Enhancing Trace-Based Root Cause Analysis for Microservice Systems via Code Change Understanding Research Papers Min Zhang Fudan University, Chenxi Zhang Xidian University, Senyu Xie Fudan University, Shihong Chen McDonald's, Lei Wu McDonald's China, Xin Peng Fudan University | ||
14:45 15mTalk | Bifrost: Empowering Pretrained Language Model with Fallibility Representation for Log-Based Fault Diagnosis Research Papers Minghua He Peking University, Tong Jia Institute for Artificial Intelligence, Peking University, Beijing, China, Lingzhe Zhang Peking University, China, Chiming Duan Peking University, Xinlong Zhao Peking University, Leyi Pan Tsinghua University, Cheng Wang Alibaba Group, Kangjin Wang Alibaba Group, Yinghao Yu Alibaba Group, Liping Zhang Alibaba Group, Yifan Wu Peking University, Ying Li School of Software and Microelectronics, Peking University, Beijing, China | ||
15:00 15mTalk | LLM-Assisted Joint Ticket and Log Analysis for Incident Triage in Intelligent and Connected Vehicles Industry Showcase Ruowei Fu Nankai University, Shenglin Zhang Nankai University, Wenwei Gu Nankai University, Weiguo Li Huawei, Yongqian Sun Nankai University, Dan Pei Tsinghua University, China | ||
15:15 15mTalk | AlarmClaw: Context-Enriched Alarm Management with Category-/Severity-Aware Incident Graphs Industry Showcase Siyu Yu The Chinese University of Hong Kong, Shenzhen (CUHK-Shenzhen), Meizhen Li ByteDance, Jiacheng Yang ByteDance, Yifan Wu Peking University, Ning Wang Bytedance, Zhaoxing Chen Bytedance, Ming Liu Bytedance, Xinchi Ren ByteDance, Xincheng Ren ByteDance, Chan Li Bytedance, Tong Jia Institute for Artificial Intelligence, Peking University, Beijing, China, Xiang Zhang Bytedance, Ying Li School of Software and Microelectronics, Peking University, Beijing, China | ||
15:30 15mTalk | Smart Brain: Semantic Anomaly Detection for Operational Time Series in Large Scale Service Systems Research Papers Hang Cui University of Chinese Academy of Sciences; Computer Network Information Center at Chinese Academy of Sciences, Zexin Wang Computer Network Information Center at Chinese Academy of Sciences, Jingjing Li Computer Network Information Center at Chinese Academy of Sciences; University of Chinese Academy of Sciences, Juncheng Hu Jilin University, Haotian Si Independent Researcher, Cenjie Hu Shenyang Institute of Automation at Chinese Academy of Sciences; University of Chinese Academy of Sciences, Quan Zhou Computer Network Information Center at Chinese Academy of Sciences, Yongchang Hu Huawei Technologies, Lei Han Huawei Technologies, Dan Pei Tsinghua University, China, Changhua Pei Computer Network Information Center at Chinese Academy of Sciences, Gaogang Xie Computer Network Information Center at Chinese Academy of Sciences | ||
15:45 15mTalk | KRCA: An Efficient Root Cause Analysis System in Hyper-scale Microservice Systems via Agentic AI Industry Showcase Jiamin Jiang Nankai University, Jingfei Feng Nankai University, Yu Luo Nankai University, Qingliang Zhang Nankai University, Yongqian Sun Nankai University, Wenwei Gu Nankai University, Shenglin Zhang Nankai University, Tianyu Cui Kuaishou Technology, Yao Wu Kuaishou Technology, Jielong Huang Kuaishou Technology, Nan Qi Kuaishou Technology, Dan Pei Tsinghua University, China | ||