VL/HCC 2022
Mon 12 - Fri 16 September 2022 Rome, Italy

The success of data scientists in developing machine learning models is contingent on an iterative development process for detecting patterns in data, finding and extracting useful features, and maximizing their model’s performance. However, it is often the case that they struggle during model development and become stuck and unable to make significant progress. We collected qualitative and quantitative data from the workflow of data scientists that allow us to learn from and examine such moments of stuckness. We used this data to develop a model for predicting stuckness based on real-time indicators, such as code artifacts, and then used the model to develop an innovative algorithm that determines precisely when a potential stuckness intervention should occur: as close as possible to the beginning of actual stuckness. Our algorithm’s performance indicates the potential efficacy of predicting data scientist stuckness algorithmically under real-world circumstances and for real-world needs.

Tue 13 Sep

Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

14:00 - 15:30
Session on Human-centric ML & VisualizationsResearch Papers at San Francesco Room
Chair(s): Sandeep Kuttal The University of Tulsa
14:00
30m
Talk
The Role of Expertise on Insight Generation from Visualization SequencesFull paper
Research Papers
Stephanie Rosenthal Carnegie Mellon University, Tingting Chung College of William & Mary
DOI
14:30
15m
Talk
Predicting Data Scientist Stuckness During the Development of Machine Learning ClassifiersShort paper
Research Papers
Moshe Mash CMU, Shoshana Oryol CMU, Reid Simmons CMU, Stephanie Rosenthal Carnegie Mellon University
DOI
14:45
15m
Talk
A Crowdsourced Study of Visual Strategies for Mitigating Confirmation BiasShort paper
Research Papers
Tee Chuanromanee University of Notre Dame, Ronald Metoyer University of Notre Dame
DOI
15:00
15m
Talk
ML Blocks: A Block-Based, Graphical User Interface for Creating TinyML ModelsShort paper
Research Papers
Randi Williams Massachusetts Institute of Technology, Michał Moskal Microsoft Research, Peli de Halleux Microsoft Research
DOI
15:15
15m
Talk
Human-Centric Machine Learning for Temporal Knowledge Graphs: Towards Understanding the European Alternative Fuels MarketShort paper
Research Papers
Robert Jungnickel RWTH Aachen University - Information Management in Mechanical Engineering, Aymen Gannouni RWTH Aachen University - Information Management in Mechanical Engineering, Anas Abdelrazeq RWTH Aachen University - Information Management in Mechanical Engineering, Ingrid Isenhardt RWTH Aachen University - Information Management in Mechanical Engineering
DOI