SSBSE 2025
Sun 16 Nov 2025 Seoul, South Korea
co-located with ASE 2025

This program is tentative and subject to change.

Sun 16 Nov 2025 09:00 - 09:20 at Grand Hall 4 - Research 1

Machine learning (ML) libraries such as PyTorch and TensorFlow are essential for a wide range of modern applications. Ensuring the correctness of ML libraries through testing is crucial. However, ML APIs often impose strict input constraints involving complex data structures such as tensors. Automated test generation tools such as Pynguin are not aware of these constraints and often create invalid inputs. This leads to early test failures and limited code coverage. Prior work has investigated extracting constraints from official API documentation. In this paper, we present PynguinML, an approach that improves the Pynguin test generator to leverage these constraints to generate valid inputs for ML APIs, enabling more thorough testing and higher code coverage. Our evaluation is based on 165 modules from PyTorch and TensorFlow, comparing PynguinML against Pynguin. The results show that PynguinML significantly improves test effectiveness, achieving up to 63.9 % higher code coverage.

This program is tentative and subject to change.

Sun 16 Nov

Displayed time zone: Seoul change

08:30 - 10:00
08:30
10m
Talk
Opening
Keynote
Shin Hong Chungbuk National University
08:40
20m
Talk
Search-based Hyperparameter Tuning for Python Unit Test Generation
Research Papers
Stephan Lukasczyk JetBrains Research, Gordon Fraser University of Passau
Pre-print
09:00
20m
Talk
Constraint-Guided Unit Test Generation for Machine Learning Libraries
Research Papers
Lukas Krodinger University of Passau, Altin Hajdari University of Passau, Stephan Lukasczyk JetBrains Research, Gordon Fraser University of Passau
Pre-print
09:20
20m
Talk
LLM-Guided Fuzzing for Pathological Input Generation
Research Papers
Didier Ishimwe George Mason University, ThanhVu Nguyen George Mason University
09:40
20m
Talk
The Pursuit of Diversity: Multi-Objective Testing of Deep Reinforcement Learning Agents
Research Papers
Antony Bartlett TU Delft, The Netherlands, Cynthia C. S. Liem Delft University of Technology, Annibale Panichella Delft University of Technology