Towards Using LLMs for Distributed Trace Comparison (Abstract)
Troubleshooting issues in modern cloud systems is a time-consuming and tedious task. Distributed Tracing captures relevant information such as the graphical structure as well as the temporal execution information to make it easier for operators to investigate and triage issues. To investigate incidents, operators often need to compare the structural and temporal properties of a trace representing an error execution with a reference trace representing a successful execution. Pair-wise comparison of traces is challenging as the traces are large and multi-dimensional.
In this abstract, we propose a novel way of comparing distributed traces by leveraging the generative powers of LLMs. We present an initial design of our system, Parallax, which uses two different types of LLM agents - Summarizer and Comparer. Summarizer generates independent summaries of the two traces and feeds them as input into the Comparer which highlights the differences between the two summarized executions.
Sat 3 MayDisplayed time zone: Eastern Time (US & Canada) change
11:00 - 12:30 | |||
11:00 30mTalk | Invited Talk2: Scaling Intelligence: AIOps for Complex Systems AIOps Andriy Miranskyy Toronto Metropolitan University (formerly Ryerson University) | ||
11:30 20mTalk | Towards Using LLMs for Distributed Trace Comparison (Abstract) AIOps Vaastav Anand , Pedro Las-Casas Microsoft, Rodrigo Fonseca Microsoft Research, Antoine Kaufmann MPI-SWS | ||
11:50 20mTalk | Automated Bug Discovery in Cloud Infrastructure-as-Code Updates with LLM Agents AIOps Yiming Xiang University of Michigan, Zhenning Yang University of Michigan, Jingjia Peng University of Michigan, Hermann Bauer University of Michigan, Patrick Tser Jern Kon University of Michigan, Yiming Qiu University of Michigan, Ang Chen University of Michigan | ||
12:10 20mTalk | Breaking the Cycle of Recurring Failures: Applying Generative AI to Root Cause Analysis in Legacy Banking Systems AIOps Siyuan Jin Hong Kong University of Science and Technology, Zhendong Bei HSBC, Bichao Chen HSBC, Yong Xia HSBC |