Write a Blog >>
ISSTA 2020
Sat 18 - Wed 22 July 2020
Tue 21 Jul 2020 11:10 - 11:30 at Zoom - MACHINE LEARNING II Chair(s): Baishakhi Ray

Today, machine learning (ML) models are increasingly applied in decision making. This induces an urgent need for quality assurance of ML models with respect to (often domain-dependent) requirements. Monotonicity is one such requirement. It specifies a software as “learned” by an ML algorithm to give an increasing prediction with the increase of some attribute values. While there exist multiple ML algorithms for ensuring monotonicity of the generated model, approaches for checking monotonicity, in particular of black-box models, are largely lacking. In this work, we propose verification-based testing of monotonicity, i.e., the formal computation of test inputs on a white-box model via verification technology, and the automatic inference of this approximating white-box model from the black-box model under test. On the white-box model, the space of test inputs can be systematically explored by a directed computation of test cases. The empirical evaluation on 90 black-box models shows verification-based testing can outperform adaptive random testing as well as property-based techniques with respect to effectiveness and efficiency.

Tue 21 Jul

Displayed time zone: Tijuana, Baja California change

10:50 - 11:50
MACHINE LEARNING IITechnical Papers at Zoom
Chair(s): Baishakhi Ray Columbia University, New York

Public Live Stream/Recording. Registered participants should join via the Zoom link distributed in Slack.

10:50
20m
Talk
Detecting and Understanding Real-World Differential Performance Bugs in Machine Learning LibrariesArtifacts AvailableArtifacts Evaluated – Functional
Technical Papers
Saeid Tizpaz-Niari CU Boulder/UT El Paso, Pavol Cerny TU Wien, Ashutosh Trivedi
Link to publication DOI Pre-print Media Attached
11:10
20m
Talk
Higher Income, Larger Loan? Monotonicity Testing of Machine Learning Models
Technical Papers
Arnab Sharma University of Paderborn, Heike Wehrheim Paderborn University
DOI Media Attached
11:30
20m
Talk
Detecting Flaky Tests in Probabilistic and Machine Learning Applications
Technical Papers
Saikat Dutta University of Illinois at Urbana-Champaign, USA, August Shi The University of Texas at Austin, Rutvik Choudhary , Zhekun Zhang , Aryaman Jain , Sasa Misailovic University of Illinois at Urbana-Champaign
DOI Media Attached