A Meta-Summary of Challenges in Building Products with ML Components -- Collecting Experiences from 4758+ PractitionersDistinguished paper Award Candidate
Sat 20 May 2023 13:30 - 13:38 at Meeting Room 105 - Realizing the Promise of AI: Challenges and Visions Chair(s): Ipek Ozkaya
Incorporating machine learning (ML) components into software products raises new software-engineering challenges and elevates already existing challenges. Many researchers have invested significant effort into understanding the challenges of industry practitioners working on building products with ML components through interviews and surveys with practitioners. With the intention to aggregate and present their collective findings, we conduct a meta-summary study: We collect 50 relevant papers that together interacted with over 4758 practitioners using guidelines for systematic literature reviews and subsequently group and organize the over 500 mentions of challenges within those papers. We highlight the most commonly reported challenges and how this meta-summary will be a useful resource for the research community to prioritize research and education in this field.
Preprint (Preprint.pdf) | 1.4MiB |
Tue 16 MayDisplayed time zone: Hobart change
Sat 20 MayDisplayed time zone: Hobart change
13:30 - 15:00 | Realizing the Promise of AI: Challenges and Visions Papers at Meeting Room 105 Chair(s): Ipek Ozkaya Carnegie Mellon University | ||
13:30 8mLong-paper | A Meta-Summary of Challenges in Building Products with ML Components -- Collecting Experiences from 4758+ PractitionersDistinguished paper Award Candidate Papers Nadia Nahar Carnegie Mellon University, Haoran Zhang Carnegie Mellon University, USA, Grace Lewis Carnegie Mellon Software Engineering Institute, Shurui Zhou University of Toronto, Canada, Christian Kästner Carnegie Mellon University Pre-print File Attached | ||
13:38 8mShort-paper | Dataflow graphs as complete causal graphs Papers Andrei Paleyes Department of Computer Science and Technology, Univesity of Cambridge, Siyuan Guo Max Planck Institute for Intelligent Systems, Bernhard Schölkopf MPI Tuebingen, Neil D. Lawrence Department of Computer Science and Technology, Univesity of Cambridge Pre-print | ||
13:46 8mShort-paper | Prevalence of Code Smells in Reinforcement Learning Projects Papers Nicolás Cardozo Universidad de los Andes, Ivana Dusparic Trinity College Dublin, Ireland, Christian Cabrera Department of Computer Science and Technology, Univesity of Cambridge Pre-print Media Attached | ||
13:54 8mShort-paper | Towards Code Generation from BDD Test Case Specifications: A vision Papers Leon Chemnitz TU Darmstadt, David Reichenbach TU Darmstadt, Germany, Hani Aldebes TU Darmstadt, Mariam Naveed TU Darmstadt, Krishna Narasimhan TU Darmstadt, Mira Mezini TU Darmstadt Pre-print | ||
14:02 8mLong-paper | Towards Concrete and Connected AI Risk Assessment (C2AIRA): A Systematic Mapping Study Papers Boming Xia CSIRO's Data61 & University of New South Wales, Qinghua Lu CSIRO’s Data61, Harsha Perera CSIRO's Data61 & University of New South Wales, Liming Zhu The University of New South Wales, Zhenchang Xing , Yue Liu CSIRO's Data61 & University of New South Wales, Jon Whittle CSIRO's Data61 and Monash University Pre-print | ||
14:10 50mPanel | Panel Discussion - Onsite Papers |