Write a Blog >>
ICSE 2023
Sun 14 - Sat 20 May 2023 Melbourne, Australia
Wed 17 May 2023 14:30 - 14:45 at Meeting Room 109 - Developers' behaviors Chair(s): Brittany Johnson

Although machine learning (ML)-enabled software systems seem to be a success story considering their rise in economic power, there are consistent reports from companies and practitioners struggling to bring ML models into production. Many papers have focused on specific, and purely technical aspects, such as testing and pipelines, but only few on socio-technical aspects.

Driven by numerous anecdotes and reports from practitioners, our goal is to collect and analyze socio-technical challenges of productionizing ML models centered around and within teams. To this end, we conducted the largest qualitative empirical study in this area, involving the manual analysis of 66 hours of talks that have been recorded by the MLOps community.

By analyzing talks from practitioners for practitioners of a community with over 11,000 members in their Slack workspace, we found 17 anti-patterns, often rooted in organizational or management problems. We further list recommendations to overcome these problems, ranging from technical solutions over guidelines to organizational restructuring. Finally, we contextualize our findings with previous research, confirming existing results, validating our own, and highlighting new insights.

Wed 17 May

Displayed time zone: Hobart change

13:45 - 15:15
13:45
15m
Talk
Is It Enough to Recommend Tasks to Newcomers? Understanding Mentoring on Good First Issues
Technical Track
Xin Tan Beihang University,, Yiran Chen Beihang University, Haohua Wu Beihang University, Minghui Zhou Peking University, Li Zhang Beihang University
Pre-print
14:00
15m
Talk
From Organizations to Individuals: Psychoactive Substance Use By Professional Programmers
Technical Track
Kaia Newman University of Michigan, Madeline Endres University of Michigan, Westley Weimer University of Michigan, Brittany Johnson George Mason University
Pre-print
14:15
15m
Talk
On the Self-Governance and Episodic Changes in Apache Incubator Projects: An Empirical Study
Technical Track
Likang Yin University of California at Davis, Xiyu Zhang University of California Davis, Vladimir Filkov University of California at Davis, USA
14:30
15m
Talk
Socio-Technical Anti-Patterns in Building ML-Enabled Software: Insights from Leaders on the Forefront
Technical Track
Alina Mailach Leipzig University, Norbert Siegmund Leipzig University
Pre-print
14:45
15m
Talk
Moving on from the software engineers' gambit: an approach to support the defense of software effort estimates
Technical Track
Patricia Matsubara Federal University of Mato Grosso do Sul (UFMS), Igor Steinmacher Northern Arizona University, Bruno Gadelha UFAM, Tayana Conte Universidade Federal do Amazonas
Pre-print
15:00
7m
Talk
iTrace-Toolkit: A Pipeline for Analyzing Eye-Tracking Data of Software Engineering Studies
DEMO - Demonstrations
Joshua Behler Kent State University, Praxis Weston Kent State University, Drew Guarnera College of Wooster, Bonita Sharif University of Nebraska-Lincoln, USA, Jonathan I. Maletic Kent State University
15:07
7m
Talk
Under the Bridge: Trolling and the Challenges of Recruiting Software Developers for Empirical Research Studies
NIER - New Ideas and Emerging Results
Ella Kokinda Clemson University, Makayla Moster Clemson University, James Dominic Clemson University, Paige Rodeghero Clemson University
Pre-print