"Project smells" — Experiences in Analysing the Software Quality of ML Projects with mllint
Thu 12 May 2022 05:20 - 05:25 at ICSE room 5-odd hours - Tools and Environments 1 Chair(s): Timo Kehrer
Fri 27 May 2022 09:15 - 09:20 at Room 306+307 - Papers 18: Recommender Systems, tools and environments Chair(s): Christian Bird
Fri 27 May 2022 13:30 - 15:00 at Ballroom Gallery - Posters 3
Machine Learning (ML) projects incur novel challenges in their development and productionisation over traditional software applications, though established principles and best practices in ensuring the project’s software quality still apply. While using static analysis to catch code smells has been shown to improve software quality attributes, it is only a small piece of the software quality puzzle, especially in the case of ML projects given their additional challenges and lower degree of Software Engineering (SE) experience in the data scientists that develop them. We introduce the novel concept of project smells which consider deficits in project management as a more holistic perspective on software quality in ML projects. An open-source static analysis tool, mllint, was also implemented to help detect and mitigate these. Our research evaluates this novel concept of project smells in the industrial context of ING, a global bank and large software- and data-intensive organisation. We also investigate the perceived importance of these project smells for proof-of-concept versus production-ready ML projects, as well as the perceived obstructions and benefits to using static analysis tools such as mllint. Our findings indicate a need for context-aware static analysis tools, that fit the needs of the project at its current stage of development, while requiring minimal configuration effort from the user.
Tue 10 MayDisplayed time zone: Eastern Time (US & Canada) change
11:00 - 12:00 | Tools and Environments 4NIER - New Ideas and Emerging Results / Technical Track / SEIP - Software Engineering in Practice at ICSE room 5-odd hours Chair(s): Guido Salvaneschi University of St. Gallen | ||
11:00 5mTalk | Towards Property-Based Tests in Natural Language NIER - New Ideas and Emerging Results Colin Gordon Drexel University Pre-print Media Attached | ||
11:05 5mTalk | Using a Semantic Knowledge Base to Improve the Managementof Security Reports in Industrial DevOps Projects SEIP - Software Engineering in Practice Pre-print Media Attached | ||
11:10 5mTalk | What's bothering developers in code review? SEIP - Software Engineering in Practice Emma Söderberg Lund University, Luke Church University of Cambridge | Lund University | Lark Systems, Jürgen Börstler Blekinge Institute of Technology, Diederick Niehorster Lund University, Christofer Rydenfält Lund University Pre-print Media Attached | ||
11:15 5mTalk | "Project smells" — Experiences in Analysing the Software Quality of ML Projects with mllint SEIP - Software Engineering in Practice Bart van Oort Delft University of Technology, Luís Cruz Deflt University of Technology, Babak Loni ING Bank N.V., Arie van Deursen Delft University of Technology, Netherlands Pre-print Media Attached | ||
11:20 5mTalk | Discovering Repetitive Code Changes in Python ML Systems Technical Track Malinda Dilhara University of Colorado Boulder, USA, Ameya Ketkar Oregon State University, USA, Nikhith Sannidhi University of Colorado Boulder, Danny Dig University of Colorado Boulder, USA DOI Pre-print Media Attached | ||
11:25 5mTalk | OJXPerf: Featherlight Object Replica Detection for Java Programs Technical Track Bolun Li North Carolina State University, Hao Xu College of William and Mary, Qidong Zhao North Carolina State University, Pengfei Su University of California, Merced, Milind Chabbi Scalable Machines Research, Shuyin Jiao North Carolina State University, Xu Liu North Carolina State University, Oak Ridge National Laboratory, USA DOI Pre-print Media Attached |
Thu 12 MayDisplayed time zone: Eastern Time (US & Canada) change
05:00 - 06:00 | Tools and Environments 1Technical Track / SEIP - Software Engineering in Practice / NIER - New Ideas and Emerging Results at ICSE room 5-odd hours Chair(s): Timo Kehrer University of Bern | ||
05:00 5mTalk | MLSmellHound: A Context-Aware Code Analysis Tool NIER - New Ideas and Emerging Results Jai Kannan Deakin University, Scott Barnett Deakin University, Anj Simmons Deakin University, Luís Cruz Deflt University of Technology, Akash Agarwal Deakin University DOI Pre-print | ||
05:05 5mTalk | A Unified Code Review Automation for Large-scale Industry with Diverse Development Environments SEIP - Software Engineering in Practice Hyungjin Kim Samsung Research, Samsung Electronics, Yonghwi Kwon Samsung Research, Samsung Electronics, Hyukin Kwon Samsung Research, Samsung Electronics, Yeonhee Ryou Samsung Research, Samsung Electronics, Sangwoo Joh Samsung Research, Samsung Electronics, Taeksu Kim Samsung Research, Samsung Electronics, Chul-Joo Kim Samsung Research, Samsung Electronics DOI Pre-print Media Attached | ||
05:10 5mTalk | Using a Semantic Knowledge Base to Improve the Managementof Security Reports in Industrial DevOps Projects SEIP - Software Engineering in Practice Pre-print Media Attached | ||
05:15 5mTalk | What's bothering developers in code review? SEIP - Software Engineering in Practice Emma Söderberg Lund University, Luke Church University of Cambridge | Lund University | Lark Systems, Jürgen Börstler Blekinge Institute of Technology, Diederick Niehorster Lund University, Christofer Rydenfält Lund University Pre-print Media Attached | ||
05:20 5mTalk | "Project smells" — Experiences in Analysing the Software Quality of ML Projects with mllint SEIP - Software Engineering in Practice Bart van Oort Delft University of Technology, Luís Cruz Deflt University of Technology, Babak Loni ING Bank N.V., Arie van Deursen Delft University of Technology, Netherlands Pre-print Media Attached | ||
05:25 5mTalk | FlakiMe: Laboratory-Controlled Test Flakiness Impact Assessment Technical Track Maxime Cordy University of Luxembourg, Luxembourg, Renaud Rwemalika University of Luxembourg, Adriano Franci University of Luxembourg, Mike Papadakis University of Luxembourg, Luxembourg, Mark Harman University College London Pre-print Media Attached |
Fri 27 MayDisplayed time zone: Eastern Time (US & Canada) change
09:00 - 10:30 | Papers 18: Recommender Systems, tools and environmentsTechnical Track / Journal-First Papers / NIER - New Ideas and Emerging Results / SEIP - Software Engineering in Practice at Room 306+307 Chair(s): Christian Bird Microsoft Research | ||
09:00 5mTalk | Predicting the Objective and Priority of Issue Reports in Software Repositories Journal-First Papers Maliheh Izadi Sharif University of Technology, Kiana Akbari Sharif University of technology, Abbas Heydarnoori Sharif University of Technology Link to publication DOI Pre-print Media Attached | ||
09:05 5mTalk | Using Deep Learning to Generate Complete Log Statements Technical Track Antonio Mastropaolo Università della Svizzera italiana, Luca Pascarella Università della Svizzera italiana (USI), Gabriele Bavota Software Institute, USI Università della Svizzera italiana Pre-print Media Attached | ||
09:10 5mTalk | Better Modeling the Programming World with Code Concept Graphs-augmented Multi-modal Learning NIER - New Ideas and Emerging Results Martin Weyssow DIRO, Université de Montréal, Houari Sahraoui Université de Montréal, Bang Liu DIRO & Mila, Université de Montréal Pre-print Media Attached | ||
09:15 5mTalk | "Project smells" — Experiences in Analysing the Software Quality of ML Projects with mllint SEIP - Software Engineering in Practice Bart van Oort Delft University of Technology, Luís Cruz Deflt University of Technology, Babak Loni ING Bank N.V., Arie van Deursen Delft University of Technology, Netherlands Pre-print Media Attached | ||
09:20 5mTalk | Discovering Repetitive Code Changes in Python ML Systems Technical Track Malinda Dilhara University of Colorado Boulder, USA, Ameya Ketkar Oregon State University, USA, Nikhith Sannidhi University of Colorado Boulder, Danny Dig University of Colorado Boulder, USA DOI Pre-print Media Attached | ||
09:25 5mTalk | FlakiMe: Laboratory-Controlled Test Flakiness Impact Assessment Technical Track Maxime Cordy University of Luxembourg, Luxembourg, Renaud Rwemalika University of Luxembourg, Adriano Franci University of Luxembourg, Mike Papadakis University of Luxembourg, Luxembourg, Mark Harman University College London Pre-print Media Attached | ||
09:30 5mTalk | Semantic Image Fuzzing of AI Perception Systems Technical Track Trey Woodlief University of Virginia, Sebastian Elbaum University of Virginia, Kevin Sullivan University of Virginia DOI Pre-print Media Attached | ||
09:35 5mTalk | Understanding and improving artifact sharing in software engineering research Journal-First Papers Christopher Steven Timperley Carnegie Mellon University, Lauren Herckis Carnegie Mellon University, Claire Le Goues Carnegie Mellon University, Michael Hilton Carnegie Mellon University, USA Link to publication DOI Pre-print Media Attached | ||
09:40 5mTalk | ARCLIN: Automated API Mention Resolution for Unformatted Texts Technical Track Yintong Huo The Chinese University of Hong Kong, Yuxin Su Sun Yat-sen University, Hongming Zhang The Hong Kong University of Science and Technology, Michael Lyu The Chinese University of Hong Kong DOI Pre-print Media Attached |
13:30 - 15:00 | |||
13:30 90mTalk | Investigating User Perceptions of Conversational Agents for Software-related Exploratory Web Search NIER - New Ideas and Emerging Results Matthew Frazier University of Delaware, Shaayal Kumar University of Delaware, Kostadin Damevski Virginia Commonwealth University, Lori Pollock University of Delaware DOI Pre-print Media Attached | ||
13:30 90mTalk | Bots for Pull Requests: The Good, the Bad, and the Promising Technical Track Mairieli Wessel Delft University of Technology, Ahmad Abdellatif Concordia University, Igor Wiese Federal University of Technology - Paraná (UTFPR), Tayana Conte Universidade Federal do Amazonas, Emad Shihab Concordia University, Marco Gerosa Northern Arizona University, USA, Igor Steinmacher Federal University of Technology - Paraná / Northern Arizona University Pre-print | ||
13:30 90mTalk | Post2Vec: Learning Distributed Representations of Stack Overflow Posts Journal-First Papers Bowen Xu Singapore Management University, Thong Hoang Singapore Management University, Singapore, Abhishek Sharma Veracode, Inc., Yang Chengran Singapore Management University, Xin Xia Huawei Software Engineering Application Technology Lab, David Lo Singapore Management University Link to publication DOI Pre-print | ||
13:30 90mTalk | Detecting Interpersonal Conflict in Issues and Code Review: Cross Pollinating Open- and Closed-Source Approaches SEIS - Software Engineering in Society Huilian Sophie Qiu Carnegie Mellon University, USA, Bogdan Vasilescu Carnegie Mellon University, USA, Christian Kästner Carnegie Mellon University, Carolyn Egelman Google, Ciera Jaspan , Emerson Murphy-Hill Google Pre-print Media Attached | ||
13:30 90mPoster | Poster: Comprehensive Comparisons of Embedding Approaches for Cryptographic API Completion Posters Ya Xiao Virginia Tech, Salman Ahmed Virginia Polytechnic Institute and State University, Xinyang Ge Microsoft Research, Bimal Viswanath Virginia Tech, Na Meng Virginia Tech, Daphne Yao Virginia Tech | ||
13:30 90mTalk | Semantic Image Fuzzing of AI Perception Systems Technical Track Trey Woodlief University of Virginia, Sebastian Elbaum University of Virginia, Kevin Sullivan University of Virginia DOI Pre-print Media Attached | ||
13:30 90m | To Disengage or Not to Disengage: A Look at Contributor Disengagement in Open Source Software SRC - ACM Student Research Competition Philip Gray New College of Florida | ||
13:30 90mTalk | Hashing It Out: A Survey of Programmers’ Cannabis Usage, Perception, and Motivation Technical Track Madeline Endres University of Michigan, Kevin Boehnke University of Michigan, Westley Weimer University of Michigan DOI Pre-print Media Attached | ||
13:30 90mTalk | Bus Factor In Practice SEIP - Software Engineering in Practice Elgun Jabrayilzade Bilkent University, Mikhail Evtikhiev JetBrains Research, Eray Tüzün Bilkent University, Vladimir Kovalenko JetBrains Research Pre-print Media Attached | ||
13:30 90mTalk | Garbage Collection Makes Rust Easier to Use: A Randomized Controlled Trial of the Bronze Garbage CollectorNominated for Distinguished Paper Technical Track Michael Coblenz University of Maryland at College Park, Michelle Mazurek University of Maryland, Michael Hicks University of Maryland at College Park DOI Pre-print Media Attached | ||
13:30 90mTalk | Learning and Programming Challenges of Rust: A Mixed-Methods Study Technical Track Shuofei Zhu The Pennsylvania State University, Ziyi Zhang University of Wisconsin–Madison, Boqin Qin China Telecom Cloud Computing Corporation, Aiping Xiong The Pennsylvania State University, Linhai Song Pennsylvania State University, USA DOI Pre-print Media Attached | ||
13:30 90mTalk | Better Modeling the Programming World with Code Concept Graphs-augmented Multi-modal Learning NIER - New Ideas and Emerging Results Martin Weyssow DIRO, Université de Montréal, Houari Sahraoui Université de Montréal, Bang Liu DIRO & Mila, Université de Montréal Pre-print Media Attached | ||
13:30 90mTalk | Defect Reduction Planning (using TimeLIME) Journal-First Papers Authorizer link Pre-print Media Attached | ||
13:30 90mDemonstration | Gamekins: Gamifying Software Testing in Jenkins DEMO - Demonstrations DOI Pre-print Media Attached | ||
13:30 90mTalk | How Do I Refactor This? An Empirical Study on Refactoring Trends and Topics in Stack Overflow Journal-First Papers Anthony Peruma Rochester Institute of Technology, Steven Simmons Rochester Institute of Technology, Eman Abdullah AlOmar Stevens Institute of Technology, Christian D. Newman Rochester Institute of Technology, Mohamed Wiem Mkaouer Rochester Institute of Technology, Ali Ouni ETS Montreal, University of Quebec Link to publication DOI Pre-print Media Attached | ||
13:30 90mTalk | Lessons Learnt on Reproducibility in Machine Learning Based Android Malware Detection Journal-First Papers Nadia Daoudi SnT, University of Luxembourg, Kevin Allix University of Luxembourg, Tegawendé F. Bissyandé SnT, University of Luxembourg, Jacques Klein University of Luxembourg Link to publication Pre-print Media Attached | ||
13:30 90m | Mu2: Using Mutation Analysis to Guide Mutation-Based Fuzzing SRC - ACM Student Research Competition Isabella Laybourn Carnegie Mellon Silicon Valley | ||
13:30 90mTalk | Emotions and Perceived Productivity of Software Developers at the Workplace Journal-First Papers Daniela Girardi University of Bari, Filippo Lanubile University of Bari, Nicole Novielli University of Bari, Alexander Serebrenik Eindhoven University of Technology Link to publication DOI Pre-print Media Attached | ||
13:30 90mPoster | CRustS: A Transpiler from Unsafe C to Safer Rust Posters Michael Ling Huawei Technologies Canada, Yijun Yu The Open University, UK, Haitao Wu Huawei Technologies Canada, Yuan Wang Huawei Sweden Research Center, James R. Cordy Queen's University, Ahmed E. Hassan Queen's University | ||
13:30 90mTalk | Multilingual training for Software Engineering Technical Track Toufique Ahmed University of California at Davis, Prem Devanbu Department of Computer Science, University of California, Davis DOI Pre-print Media Attached | ||
13:30 90mTalk | An Empirical Investigation on the Challenges Faced by Women in the Software Industry: A Case StudySEIS-track Award SEIS - Software Engineering in Society Bianca Trinkenreich Northern of Arizona Univeristy, Ricardo Britto Ericsson / Blekinge Institute of Technology, Marco Gerosa Northern Arizona University, USA, Igor Steinmacher Federal University of Technology - Paraná / Northern Arizona University Pre-print Media Attached | ||
13:30 90mTalk | Using Deep Learning to Generate Complete Log Statements Technical Track Antonio Mastropaolo Università della Svizzera italiana, Luca Pascarella Università della Svizzera italiana (USI), Gabriele Bavota Software Institute, USI Università della Svizzera italiana Pre-print Media Attached | ||
13:30 90mTalk | Collaboration Challenges in Building ML-Enabled Systems: Communication, Documentation, Engineering, and ProcessDistinguished Paper Award Technical Track Nadia Nahar Carnegie Mellon University, Shurui Zhou University of Toronto, Grace Lewis Carnegie Mellon Software Engineering Institute, Christian Kästner Carnegie Mellon University Pre-print Media Attached | ||
13:30 90mTalk | Discovering Repetitive Code Changes in Python ML Systems Technical Track Malinda Dilhara University of Colorado Boulder, USA, Ameya Ketkar Oregon State University, USA, Nikhith Sannidhi University of Colorado Boulder, Danny Dig University of Colorado Boulder, USA DOI Pre-print Media Attached | ||
13:30 90mTalk | Towards Mining OSS Skills from GitHub Activity NIER - New Ideas and Emerging Results Jenny T. Liang University of Washington, Thomas Zimmermann Microsoft Research, Denae Ford Microsoft Research DOI Pre-print Media Attached | ||
13:30 90mTalk | EREBA: Black-box Energy Testing of Adaptive Neural Networks Technical Track Mirazul Haque UT Dallas, Yaswanth Yadlapalli University of Texas at Dallas, Wei Yang University of Texas at Dallas, Cong Liu University of Texas at Dallas, USA Pre-print Media Attached | ||
13:30 90mTalk | "Project smells" — Experiences in Analysing the Software Quality of ML Projects with mllint SEIP - Software Engineering in Practice Bart van Oort Delft University of Technology, Luís Cruz Deflt University of Technology, Babak Loni ING Bank N.V., Arie van Deursen Delft University of Technology, Netherlands Pre-print Media Attached | ||
13:30 90mPoster | Improving Responsiveness of Android Activity Navigation via Genetic Improvement Posters |