ASE 2025 (series) / Tool Demonstration Track /
BASHIRI: Learning Failure Oracles from Execution Features
Program fixes must preserve passing tests while fixing failing ones. Validating these properties requires test oracles that distinguish passing from failing runs.
We introduce BASHIRI, an approach that learns failure oracles from test suites with labeled outcomes using execution features. BASHIRI leverages execution-feature-driven debugging to collect program execution features and trains interpretable models as testing oracles.
Our evaluation shows that BASHIRI predicts test outcomes with 95% accuracy, effectively identifying failing runs.
BASHIRI is available as an open-source tool at https://github.com/smythi93/bashiri
A demonstration video is available at https://youtu.be/D2mJkCtSXtM