FSE 2026
Sun 5 - Thu 9 July 2026 Montreal, Canada
Thu 9 Jul 2026 14:40 - 15:00 at MB 2.435 - Failures Chair(s): Christoph Treude

In principle, Continuous Integration (CI) pipeline failures provide valuable feedback to developers on code-related errors. In practice, however, pipeline jobs often fail intermittently due to non-deterministic tests, network outages, infrastructure failures, resource exhaustion, and other reliability issues. These intermittent (flaky) job failures lead to substantial inefficiencies: wasted computational resources from repeated reruns and significant diagnosis time that distracts developers from core activities and often requires intervention from specialized teams. Prior studies have proposed machine learning techniques to detect intermittent failures, but the subsequent diagnosis remains underexplored. To fill this gap, we introduce FlaXifyer, a few-shot learning approach for predicting intermittent job failure categories using pre-trained language models. FlaXifyer requires only job execution logs and achieves 84.3% Macro F1 and 92.0% Top-2 accuracy with just 12 labeled examples per category. We also propose LogSift, an interpretability technique that identifies influential log statements in under one second, reducing review effort by 74.4% while surfacing relevant failure information in 87% of cases. Evaluated on 2,458 job failures from TELUS, FlaXifyer and LogSift enable practitioners to automate triage and accelerate the diagnosis of intermittent job failures.

Thu 9 Jul

Displayed time zone: Eastern Time (US & Canada) change

14:00 - 15:30
FailuresTool Demonstrations / Research Papers / Industry Papers / Journal-First Paper at MB 2.435
Chair(s): Christoph Treude Singapore Management University
14:00
20m
Talk
GREClue: Failure Indexing with Graph-based Failure Representation and Entropy-based Deep Clustering
Research Papers
Zhenyu Yang Shandong University, Zhongxing Yu Shandong University
14:20
20m
Talk
Failure-Based Testing for Deep Reinforcement Learning Agents
Research Papers
Weibin Lin , Jiangtao Meng Beihang University, Zheng Zheng Beihang University
DOI Pre-print
14:40
20m
Talk
Predicting Intermittent Job Failure Categories for Diagnosis Using Few-Shot Fine-Tuned Language Models
Industry Papers
Henri Aïdasso École de technologie supérieure (ÉTS), Francis Bordeleau École de Technologie Supérieure (ETS), Ali Tizghadam TELUS
15:00
20m
Talk
How Execution Features Relate to Failures: An Empirical Study and Diagnosis Approach
Journal-First Paper
Marius Smytzek CISPA Helmholtz Center for Information Security, Martin Eberlein Humboldt-Universtität zu Berlin, Lars Grunske Humboldt-Universität zu Berlin, Andreas Zeller CISPA Helmholtz Center for Information Security
Link to publication DOI
15:20
10m
Talk
TRACE: Topology-aware Reconstruction of Accidents in CARLA for AV Evaluation
Tool Demonstrations
Nahian Salsabil University of Virginia, Sebastian Elbaum University of Virginia