From Logs to Lessons: An Exploration of LLM-based Log Summarization for Debugging Automotive Software
This program is tentative and subject to change.
Identifying where faults occur is an essential part of debugging, yet examining extensive system logs can be slow and mentally demanding, especially in complex software environments. One emerging strategy to enhance log analysis is to employ large language models (LLMs) to distill log information into more manageable summaries that can guide human reasoning during diagnosis. We report on a case study carried out in an automotive setting, where engineers investigated actual failures with and without support from an LLM-based summarization tool. During fault localization sessions where participants analyzed real failure logs, we collected cognitive load measurements, observed their reasoning processes, and gathered feedback on both the LLM-based summarization and the workflow through post-session interviews. Our results indicate that although the use of summaries raised certain cognitive demands, particularly related to mental effort and time pressure, participants experienced less frustration overall and considered the support helpful in focusing their attention. They also expressed a clear interest in being able to shape and refine summaries as their understanding evolved. These findings offer insights into how LLM-generated summaries influence practitioners’ diagnostic work and point toward the need for more adaptive, interactive, and workflow-aware support.
This program is tentative and subject to change.
Tue 14 AprDisplayed time zone: Brasilia, Distrito Federal, Brazil change
16:00 - 17:30 | |||
16:00 30mTalk | ACT: Automated CPS Testing for Open-Source Robotic Platforms AST 2026 Aditya A. Krishnan Arizona State University, Donghoon Kim Arkansas State University, Hokeun Kim Arizona State University | ||
16:30 30mTalk | From Logs to Lessons: An Exploration of LLM-based Log Summarization for Debugging Automotive Software AST 2026 Anton Ekström Chalmers University of Technology, Hampus Rhedin Stam Chalmers University of Technology, Francisco Gomes de Oliveira Neto Chalmers | University of Gothenburg, Gregory Gay Chalmers University of Technology and University of Gothenburg, Sabina Edenlund Volvo Cars AB | ||
17:00 30mTalk | Separating Valid from Invalid Inputs for a Digital Aircraft Design Tool AST 2026 Malte Christian Struck German Aerospace Center (DLR), Institute of Software Technology, Andreas Schuster German Aerospace Center (DLR), Institute of Lightweight Systems, Alexander Weinert German Aerospace Center (DLR) Institute for Software Technology, Michael Felderer German Aerospace Center (DLR) & University of Cologne | ||