To maintain and evolve a software system, developers need to gain new or recover lost knowledge about that system. Thus, program comprehension is a crucial activity in software development and maintenance processes. We know from previous work that developers prioritize what information they want to remember about a system based on the perceived importance of that information. However, AI-based software systems as a special case are not developed by software developers alone, but also by data scientists who deal with other concepts and have a different educational background than most developers. In this paper, we study what information data scientists (aim to) recall about their systems. For this purpose, we replicated our previous work by interviewing 11 data scientists, investigating the knowledge they consider important to remember, and whether they can remember parts of their systems correctly. Our results suggest that data scientists consider knowledge about the AI-project settings to be the most important to remember and that they perform best when remembering knowledge they consider important. Contrary to software developers, data scientists’ self-assessments increase when reflecting on their systems. Our findings indicate similarities and differences between developers and data scientists that are important for managing the processes surrounding a system.
Tue 12 DecDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
14:00 - 15:00 | Machine Learning and Data ScienceResearch Papers / Organization / Short Papers and Posters / Industry Papers at W211 Chair(s): Xiaozhou Li University of Oulu | ||
14:00 10mShort-paper | Operationalizing Assurance Cases for Data Scientists: A Showcase of Concepts and Tooling in the Context of Test Data Quality for Machine Learning Short Papers and Posters Lisa Jöckel Fraunhofer, Michael Klaes Fraunhofer IESE; Konstanz University of Applied Sciences, Janek Groß Fraunhofer IESE, Pascal Gerber Fraunhofer Institute for Experimental Software Engineering, Markus Scholz NovelSense, Jonathan Eberle TRUMPF, Marc Teschner TRUMPF, Daniel Seifert Fraunhofer IESE, Richard Hawkins University of York, John Molloy University of York, Jens Ottnad TRUMPF | ||
14:10 10mResearch paper | Status Quo and Problems of Requirements Engineering for Machine Learning: Results from an International Survey Research Papers Antonio Pedro Santos Alves Pontifical Catholic University of Rio de Janeiro, Marcos Kalinowski Pontifical Catholic University of Rio de Janeiro (PUC-Rio), Görkem Giray Independent Researcher, Daniel Mendez Blekinge Institute of Technology, Niklas Lavesson Blekinge Institute of Technology, Kelly Azevedo Pontifical Catholic University of Rio de Janeiro, Hugo Villamizar Pontifical Catholic University of Rio de Janeiro (PUC-Rio), Tatiana Escovedo Pontifical Catholic University of Rio de Janeiro, Helio Côrtes Vieira Lopes PUC-Rio, Stefan Biffl Vienna University of Technology, Juergen Musil , Michael Felderer German Aerospace Center (DLR) & University of Cologne, Stefan Wagner University of Stuttgart, Maria Teresa Baldassarre Department of Computer Science, University of Bari , Tony Gorschek Blekinge Institute of Technology / DocEngineering | ||
14:20 10mShort-paper | A Stochastic Approach Based on Rational Decision-Making for Analyzing Software Engineering Project Status Short Papers and Posters Hannes Salin Dalarna University | ||
14:30 10mResearch paper | CAIS-DMA: A Decision-Making Assistant for Collaborative AI Systems Research Papers | ||
14:40 10mShort-paper | Comparing machine learning algorithms for medical time-series data Short Papers and Posters Aliasgar Shereef Chalmers University of Technology, Alex Helmersson Chalmers University of Technology, Faton Hoti Chalmers University of Technology, Sebastian Levander Gothenburg University, Emil Svensson Chalmers University of Technology, Ali El-Merhi Sahlgrenska University Hospital, Richard Vithal Sahlgrenska University Hospital, Jaquette Liljenqrantz Sahlgrenska University Hospital, Linda Block Sahlgrenska University Hospital , Helena Odenstedt Sahlgrenska University Hospital, Miroslaw Staron Chalmers University of Technology | ||
14:50 10mResearch paper | What Data Scientists (Care to) Recall Research Papers Samar Saeed University of Gothenburg, Shahrzad Sheikholeslami University of Gothenburg, Jacob Krüger Eindhoven University of Technology, Regina Hebig University of Rostock | ||