Data-aware Static Analysis: Improving Semantic Fault Detection in Machine Learning Code Using Data Characteristics
Semantic faults specific to the use of machine learning models are a common problem for machine learning developers, causing suboptimal predictions, high computational cost, or incorrect outputs. For example, one may erroneously use unscaled data to train a scale-sensitive model. Machine learning developers detect these faults after training their models and manually analyzing the results, making it an inefficient process. We propose a novel data-aware static analysis approach to detect semantic faults in machine learning code, allowing developers to reveal these bugs while writing code instead of after training the model. Our approach uses combined data and control flow analysis, and API contracts, enabling data-aware reasoning about machine learning code at a high level of abstraction. We highlight the potential of our solution by analyzing a sample of real-world machine learning notebooks, finding that we can detect faults that require a data-aware approach.
| Slides (icse-nier-2026-presentation.pdf) | 1.31MiB |
Thu 16 AprDisplayed time zone: Brasilia, Distrito Federal, Brazil change
16:00 - 17:30 | Testing and Analysis 13New Ideas and Emerging Results (NIER) / Software Engineering Education and Training (SEET) / Journal-first Papers at Oceania II Chair(s): Lei Zhang University of Maryland Baltimore County | ||
16:00 15mTalk | How to Save My Gas Fees: Understanding and Detecting Real-World Gas Issues in Solidity Programs Journal-first Papers Mengting He The Pennsylvania State University, Shihao Xia The Pennsylvania State University, Boqin Qin China Telecom Cloud Computing Corporation, Nobuko Yoshida University of Oxford, Tingting Yu University of Connecticut, Yiying Zhang University of California San Diego, Linhai Song The Pennsylvania State University | ||
16:15 15mTalk | Reasoning About Bugs in Learners’ Scratch Programs Using Large Language Models Software Engineering Education and Training (SEET) Benedikt Fein University of Passau, Patric Feldmeier University of Passau, Florian Obermueller University of Passau, Gordon Fraser University of Passau DOI Pre-print | ||
16:30 15mTalk | Characterizing and Refactoring Table-Driven Tests in Go New Ideas and Emerging Results (NIER) Max Green Stevens Institute of Technology, Lu Xiao Stevens Institute of Technology, Zhongpeng Lin Uber Technologies Inc. | ||
16:45 15mTalk | Data-aware Static Analysis: Improving Semantic Fault Detection in Machine Learning Code Using Data Characteristics New Ideas and Emerging Results (NIER) Willem Meijer Linköping University, Kristian Sandahl Linköping University, Daniel Varro Linköping University / McGill University File Attached | ||
17:00 15mTalk | Towards Automatically Inferring Constraints to Identify Implicit Assumptions in Data Analysis New Ideas and Emerging Results (NIER) Florian Sihler Ulm University, Lars Pfrenger Ulm University, Oliver Gerstl Ulm University, Matthias Tichy Ulm University DOI File Attached | ||
17:15 15mTalk | QSolver: A Quantum Constraint Solver New Ideas and Emerging Results (NIER) | ||