ICST 2026
Mon 18 - Fri 22 May 2026 Daejeon, South Korea
Tue 19 May 2026 16:00 - 16:15 at Room 105 - Tool and Data Showcase 2 Chair(s): Jinhan Kim

In recent years, machine learning (ML) based software systems are increasingly deployed in several critical applications, yet systematic testing of their behavior remains challenging due to complex model architectures, large input spaces, and evolving deployment environments. Existing testing approaches often rely on generating test cases based on given requirements, which often fail to reveal critical bugs of modern ML models due to their complex nature. Most importantly, such approaches, although they can be used to detect the presence of specific failures in the ML software, they hardly provide any message as to how to fix such errors. To tackle this, in this paper, we present DeepFix, a tool for automated testing of the entire ML pipeline using an agentic AI framework. Our testing approach first leverages Deepchecks to test the ML software for any potential bugs, and thereafter, uses an agentic AI-based approach to generate a detailed bug report. This includes a ranking, based on the severity of the found bugs, along with their explanations, which can be interpreted easily by any nondata science experts and most importantly, also provides possible ways to fix these bugs. Additionally, DeepFix supports several types of ML software systems and can be integrated easily to any ML workflow, enabling continuous testing throughout the development lifecycle. We discuss our already validated cases as well as some planned validations designed to demonstrate how the agentic testing process can reveal hidden failure modes that remain undetected by conventional testing methods. A 5-minute screencast demonstrating the tool’s core functionality is available at https://youtu.be/WfwZmFcQgBQ.

Tue 19 May

Displayed time zone: Seoul change

16:00 - 17:30
Tool and Data Showcase 2Testing Tools and Data Showcase at Room 105
Chair(s): Jinhan Kim Università della Svizzera italiana
16:00
15m
Talk
DeepFix: Debugging and Fixing Machine Learning Workflow using Agentic AI
Testing Tools and Data Showcase
Fadel Mamar Seydou Technical University of Munich, Arnab Sharma University of Paderborn
16:15
15m
Talk
Ising-based Test Optimization and Benchmarking
Testing Tools and Data Showcase
Yige Yang Beihang University, Beijing, China, Man Zhang Beihang University, China, Tao Yue Beihang University
16:30
15m
Talk
TopoMap: Automated Topographical Mapping of the Deep Learning Input Space
Testing Tools and Data Showcase
Gianmarco De Vita Università della Svizzera italiana, Nargiz Humbatova Università della Svizzera italiana, Paolo Tonella USI Lugano