CAIN 2024
Sun 14 - Mon 15 April 2024 Lisbon, Portugal
co-located with ICSE 2024

Artificial Intelligence (AI) systems are gaining popularity, reshaping various domains ranging from customer services to software engineering. The effectiveness of AI systems is intricately linked to the quality of their training data. Therefore, practitioners invest substantial time experimenting with different data, parameters, and models to guarantee the quality of the end system. Prior work highlights unique challenges of developing AI systems, particularly concerning versioning data and model. Recently, various tools such as DVC and MLFlow have emerged to aid developers in the storage and tracking of data. Despite gaining popularity, very little is known about their usage patterns and impact on open-source software (OSS) systems. To address this gap, we conducted an empirical study on 56 GitHub OSS projects that use DVC to understand the DVC usage pattern and the impact of using DVC on the software development process. We found that Versioning and tracking is the most adopted DVC feature, being utilized by all 56 projects and being the only adopted feature in 85.7% of them. Furthermore, we find that DVC has a significant impact on the software development process indicators (e.g., number of created PRs, number of bug-fix commits), causing a significant shift in the trend of the most studied indicators.

Sun 14 Apr

Displayed time zone: Lisbon change

14:00 - 15:30
Data Engineering and Management for AI-Enabled SystemsResearch and Experience Papers / Industry Talks at Pequeno Auditório
Chair(s): Marc Zeller Siemens AG
14:00
15m
Talk
What About the Data? A Mapping Study on Data Engineering for AI Systems
Research and Experience Papers
Petra Heck Fontys University of Applied Sciences
Pre-print
14:15
15m
Talk
Unmasking Data Secrets: An Empirical Investigation into Data Smells and Their Impact on Data Quality
Research and Experience Papers
Gilberto Recupito University of Salerno, Raimondo Rapacciuolo University of Salerno, Dario Di Nucci University of Salerno, Fabio Palomba University of Salerno
14:30
15m
Talk
An Exploratory Study of Dataset and Model Management in Open Source Machine Learning ApplicationsDistinguished paper Award Candidate
Research and Experience Papers
Tajkia Rahman Toma University of Alberta, Cor-Paul Bezemer University of Alberta
14:45
10m
Talk
DVC in Open Source AI-development: The Action and the Reaction
Research and Experience Papers
Lorena Barreto Simedo Pacheco Concordia University, Musfiqur Rahman Concordia University, Fazle Rabbi Concordia University, Pouya Fathollahzadeh Queen’s University, Ahmad Abdellatif University of Calgary, Emad Shihab Concordia University, Tse-Hsun (Peter) Chen Concordia University, Jinqiu Yang Concordia University, Ying Zou Queen's University, Kingston, Ontario
14:55
10m
Industry talk
Structuring the world of unstructured text data – Balancing business requirements, training data availability, and model performance.
Industry Talks
15:05
10m
Industry talk
Invited: Artificial Intelligence Projects, a quest between meaningful use cases, data, and unfulfilled desires.
Industry Talks
A: Andreas Jedlitschka Fraunhofer IESE
15:15
15m
Live Q&A
Data : Q&A Session
Research and Experience Papers