TSGuard: Automated User-Centric Incident Diagnosis for AI Workloads in the Cloud
AI workloads incur frequent failures and incidents from the underlying infrastructure. The current incident management workflow follows a provider-centric paradigm, where users report incidents to the infrastructure provider who then conducts troubleshooting. Due to the large number of incidents and the manual nature of the troubleshooting process, the provider often takes several days to resolve an incident, resulting in operational delays and productivity loss.
To address these challenges, we present TSGuard, a user-centric multi-agent system that delivers immediate incident diagnosis to users who deploy the workloads. The core innovation of TSGuard is twofold: (1) constructing domain-specific knowledge bases by mining historical on-call experiences in the offline phase, and (2) mimicking human expert diagnosis via structured reasoning and iterative trial-and-error in the online phase. Evaluation using production incident records from public cloud A demonstrates that TSGuard significantly outperforms state-of-the-art baselines, improving diagnostic accuracy by 19.8%. Furthermore, TSGuard reduces the average verification time by 63.4% compared to sequential benchmark execution baseline.
Wed 8 JulDisplayed time zone: Eastern Time (US & Canada) change
10:30 - 12:30 | CloudIndustry Papers / Research Papers / Journal-First Paper at MB 2.435 Chair(s): Mariam El Mezouar Royal Military College | ||
10:30 20mTalk | Aloha: Localizing Batch Failures in Large-scale Cloud Systems via Contrast Analysis and Human-in-the-Loop Agent Industry Papers Shenglin Zhang Nankai University, Yujia Wu Nankai University, Jinghuan Ren Nankai University, College of Software, Yongqian Sun Nankai University, Wenwei Gu Nankai University, Chaoyun Zhang Microsoft, Liqun Li Microsoft Research, Qingwei Lin Microsoft, Dongmei Zhang Microsoft, Saravanakumar Rajmohan Microsoft 365, Chetan Bansal Microsoft Research, Minghua Ma Microsoft | ||
10:50 20mTalk | Attention Enhanced Entity Recommendation for Intelligent Monitoring in Cloud Systems Industry Papers Fiza Husain Independent, Anson Bastos Microsoft, Anjaly Parayil Microsoft, Ayush Choure Independent, Chetan Bansal Microsoft Research, Rujia Wang Microsoft, Saravanakumar Rajmohan Microsoft 365 | ||
11:10 20mTalk | An Agentic Framework for Triaging Incidents in Production Cloud Infrastructure Industry Papers Yuhan Yao Microsoft, Yuxuan Jiang University of Michigan Ann-Arbor, Minghua Ma Microsoft, Madhura Vaidya Microsoft, Jieren Deng Microsoft, Yigong Hu Boston University, Chetan Bansal Microsoft Research, Ze Li Microsoft Azure, Murali Chintalapati Microsoft Azure | ||
11:30 20mTalk | TSGuard: Automated User-Centric Incident Diagnosis for AI Workloads in the Cloud Research Papers Yitao Yang The Chinese University of Hong Kong, Yangtao Deng The Chinese University of Hong Kong, Yifan Xiong Microsoft Research, Baochun Li University of Toronto, Hong Xu The Chinese University of Hong Kong, Peng Cheng Microsoft Research Asia Pre-print | ||
11:50 20mTalk | Exploring the impact of cloud computing on software architecture for sustainability: A practitioners' perspective Journal-First Paper | ||
12:10 20mTalk | AccessRefinery: Fast Mining Concise Access Control Intents on Public Cloud Research Papers Ning Kang Xi'an Jiaotong University, Peng Zhang Xi'an Jiaotong University, Jianyuan Zhang Xi'an Jiaotong University, Hao Li Xi'an Jiaotong University, Dan Wang Xi'an Jiaotong University, Zhenrong Gu Xi'an Jiaotong University, Weibo Lin Huawei Cloud, Shibiao Jiang Huawei Cloud, Zhu He Huawei Cloud, Xu Du Huawei Cloud, Longfei Chen Huawei Cloud, Jun Li Huawei, Xiaohong Guan Xi'an Jiaotong University DOI Pre-print | ||