Maintaining up-to-date troubleshooting guides (TSGs) is critical for the reliability of cloud systems, yet manual maintenance often leads to inefficiencies and outdated documentation. This paper proposes TSGen, an automated pipeline for generating high-quality, structured TSGs from historical incident reports using large language models (LLMs). Our approach consists of three stages: (1) filtering and classifying incident data into diagnostically relevant categories, (2) distilling core incidents to ensure diversity and generalizability, and (3) organizing the distilled knowledge into a directed acyclic graph (DAG) that captures root causes and resolutions in a structured manner. By leveraging real-world incident discussions, TSGen produces dynamic and reusable guides tailored for live troubleshooting. Experiments on real-world incidents from Microsoft demonstrate that TSGen achieves 54.8% incident coverage and approximately 3$\times$ higher retrieval accuracy compared to baselines. Furthermore, the system supports iterative updates, allowing guides to evolve alongside dynamic cloud environments. Human evaluation shows that on-call engineers rate these generated TSGs significantly higher than human-crafted ones.
Thu 9 JulDisplayed time zone: Eastern Time (US & Canada) change
10:30 - 12:30 | |||
10:30 20mTalk | Natural Language-Focused Software Engineering via Code-Documentation Equivalence Research Papers Aryaz Eghbali CISPA Helmholtz Center for Information Security, Germany, Zhongxin Liu Zhejiang University, Michael Pradel CISPA Helmholtz Center for Information Security Pre-print | ||
10:50 20mTalk | Industrial Deployment of an AI Multi-Agent System for Requirements-Driven Code Verification Industry Papers Paul Baker JP Morgan - Chase, Blanca Manu JPMorganChase, Rebecca Moussa University College London, Federica Sarro University College London | ||
11:10 20mTalk | Leveraging LLMs for Alert Summarization and Mitigation Plan Generation Industry Papers Komal Sarda York University, Honggeun Ji York University, Amr M. Zaki York University, Marin Litoiu York University, Canada, Ian Watts IBM Canada, Larisa Shwartz IBM T.J. Watson Research | ||
11:30 20mTalk | TSGen: Automated Troubleshooting Guide Generation Industry Papers Yi Xiao Chongqing University, Hongyu Zhang Chongqing University, Daniel Genkin Microsoft, Chaoyun Zhang Microsoft, Rujia Wang Microsoft, Chetan Bansal Microsoft Research, Bhala Ranganathan Microsoft, Saravanakumar Rajmohan Microsoft 365, Minghua Ma Microsoft | ||
11:50 20mTalk | Topic-wise Summarization of Support Ticket Dialogue via LLM Industry Papers XiaoLei Chen Fudan University, Fengrui Liu ByteDance, Xiao He Bytedance, Tieying Zhang ByteDance, Peng Wang Fudan University, Wei Wang Fudan University | ||