ICST 2026
Mon 18 - Fri 22 May 2026 Daejeon, South Korea

This program is tentative and subject to change.

Tue 19 May 2026 11:50 - 12:15 at Room 103 - Deep Learning Model Verification Chair(s): Hamid Parsazadeh

With the increased popularity of Deep Neural Networks (DNNs), increases also the need for tools to assist developers in the DNN implementation, testing and debugging process. Several approaches have been proposed that automatically analyse and localise potential faults in DNNs under test. In this work, we evaluate and compare existing state-of-the-art fault localisation techniques, which operate based on both dynamic and static analysis of the DNN. The evaluation is performed on a benchmark consisting of both real faults obtained from bug reporting platforms and faulty models produced by a mutation tool. Our findings indicate that the usage of a single, specific ground truth (e.g. the human-defined one) for the evaluation of DNN fault localisation tools results in pretty low performance (maximum average recall of 0.33 and precision of 0.21). However, such figures increase when considering alternative, equivalent patches that exist for a given faulty DNN. The results indicate that DeepFD is the most effective tool, achieving an average recall of 0.55 and a precision of 0.37 on our benchmark.

This program is tentative and subject to change.

Tue 19 May

Displayed time zone: Seoul change

11:00 - 12:30
Deep Learning Model VerificationJournal-First Papers / Research Papers / Education at Room 103
Chair(s): Hamid Parsazadeh University of Toronto
11:00
25m
Talk
DeepNaqqal: Human-Aligned Automated Validation of Test Inputs for Deep Learning
Research Papers
Maryam Maryam Lero, University of Limerick, Matteo Biagiola University of St. Gallen and Università della Svizzera italiana, Paolo Tonella USI Lugano, Vincenzo Riccio University of Udine
11:25
25m
Talk
How Effective Is Coverage-Guided Fuzzing to Test Deep Learning Library APIs?Artifact ReviewedArtifact Available
Research Papers
Feiran Qin North Carolina State University, M M Abid Naziri North Carolina State University, Hengyu Ai ShanghaiTech University, Saikat Dutta Cornell University, Marcelo d'Amorim North Carolina State University
Pre-print
11:50
25m
Talk
An Empirical Study of Fault Localisation Techniques for Deep Neural Networks
Journal-First Papers
Nargiz Humbatova Università della Svizzera italiana, Jinhan Kim Università della Svizzera italiana, Gunel Jahangirova King's College London, Shin Yoo KAIST, Paolo Tonella USI Lugano
DOI
12:05
25m
Talk
Testing Literacy for the Era of Self-Software Systems: Rethinking Software Testing Education for AI-Mediated Development
Education
Nuno Pombo University of Beira Interior & Instituto de Telecomunicaçōes, Covilhã, Portugal
Hide past events