DeepTest 2021
Tue 1 Jun 2021
co-located with ICSE 2021
Tue 1 Jun 2021 14:20 - 14:40 at DeepTest Room - Session 2 Chair(s): Vincenzo Riccio

Detecting drift in Machine Learning (ML) models is an acknowledged challenge. For ML models to become an integral part of business applications it is essential to detect when an ML model drifts away from acceptable operation. However, it is often the case that actual labels are difficult and expensive to get, for example, because they require expert judgment. Therefore, there is a need for methods that detect likely degradation in ML operation without labels. We propose a method that utilizes feature space rules, called data slices, for drift detection. We provide experimental indications that our method is likely to find ML model drift.

Tue 1 Jun

Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

13:00 - 15:00
Session 2deeptest2021 at DeepTest Room
Chair(s): Vincenzo Riccio USI Lugano, Switzerland
13:00
60m
Keynote
Testing Facebook's WW Simulation System, a Cyber-Cyber Digital Twin of the Facebook WWW Platform
deeptest2021
Mark Harman Facebook, Inc., Natalija Gucevska Facebook
14:00
20m
Short-paper
TF-DM: Tool for Studying ML Model Resilience to Data Faults
deeptest2021
Niranjhana Narayanan The University of British Columbia, Karthik Pattabiraman University of British Columbia
14:20
20m
Full-paper
Machine Learning Model Drift Detection Via Weak Data Slices
deeptest2021
Orna Raz IBM Research, Samuel Ackerman IBM Corporation, Israel, Parijat Dube IBM, USA, Eitan Farchi IBM Haifa Research Lab, Marcel Zalmanovici
14:40
20m
Live Q&A
Open Discussion & Q/A
deeptest2021


Information for Participants
Tue 1 Jun 2021 13:00 - 15:00 at DeepTest Room - Session 2 Chair(s): Vincenzo Riccio
Info for room DeepTest Room:

Go directly to this room on Clowdr