FSE 2025
Mon 23 - Fri 27 June 2025 Trondheim, Norway
Mon 23 Jun 2025 16:00 - 16:10 at Cosmos Hall - SE and AI 1 Chair(s): Yuchao Jiang

Machine learning (ML) developers frequently use interactive computational notebooks, such as Jupyter notebooks, to host code for data processing and model training. Notebooks provide a convenient tool for writing ML pipelines and interactively observing outputs. However, maintaining notebooks, e.g., to add new features or fix bugs, can be challenging due to the length and complexity of the ML pipeline code. Moreover, there is no existing benchmark related to developer edits on notebooks. In this paper, we present early results of the first study on learning for learning to edit ML pipeline code in notebooks using large language models (LLMs). We collect the first dataset of 48,398 notebook edits derived from 20,095 revisions of 792 ML-related repositories on GitHub. Our dataset captures granular details of cell-level and line-level modifications, offering a foundation for understanding real-world maintenance patterns in ML pipelines. We observe that the edits on notebooks are highly localized, with changes averaging only 166 lines of code in repositories. Although LLMs have been shown to be effective on general-purpose code generation and editing, our results reveal that the same LLMs, even after finetuning, have low accuracy on notebook editing, demonstrating the complexity of real-world ML pipeline maintenance tasks. Our findings emphasize the critical role of contextual information in improving model performance and point toward promising avenues for advancing LLMs’ capabilities in engineering ML code.

Mon 23 Jun

Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

16:00 - 18:00
16:00
10m
Talk
Learning to Edit Interactive Machine Learning Notebooks
Ideas, Visions and Reflections
Bihui Jin University of Waterloo, Jiayue Wang University of Waterloo, Pengyu Nie University of Waterloo
16:10
20m
Talk
Automatically Detecting Numerical Instability in Machine Learning Applications via Soft Assertions
Research Papers
Shaila Sharmin Iowa State University, Anwar Hossain Zahid Iowa State University, Subhankar Bhattacharjee Iowa State University, Chiamaka Igwilo Iowa State University, Miryung Kim UCLA and Amazon Web Services, Wei Le Iowa State University
DOI
16:30
20m
Talk
Mitigating Regression Faults Induced by Feature Evolution in Deep Learning Systems
Journal First
Hanmo You Tianjin University, Zan Wang Tianjin University, Xuyang Chen College of Intelligence and Computing, Tianjin University, Junjie Chen Tianjin University, Jun Sun Singapore Management University, Shuang Liu Renmin University of China, Zishuo Dong College of Intelligence and Computing, Tianjin University
16:50
10m
Talk
ClusterXplain: a Clustering-based Tool for DNN components Debugging
Demonstrations
Mohammed Attaoui University of Luxembourg, Fabrizio Pastore University of Luxembourg
17:00
10m
Talk
Capturing Semantic Flow of ML-based Systems
Ideas, Visions and Reflections
Shin Yoo KAIST, Robert Feldt Chalmers | University of Gothenburg, Somin Kim Korea Advanced Institute of Science and Technology, Naryeong Kim Korea Advanced Institute of Science and Technology
17:10
20m
Talk
Has My Code Been Stolen for Model Training? A Naturalness Based Approach to Code Contamination Detection
Research Papers
Haris Ali Khan Beijing Institute of Technology, Yanjie Jiang Peking University, Qasim Umer Information and Computer Science Department, King Fahd University of Petroleum & Minerals (KFUPM), Dhahran 31261, Saudi Arabia, Yuxia Zhang Beijing Institute of Technology, Waseem Akram Beijing Institute of Technology, Hui Liu Beijing Institute of Technology
DOI
17:30
20m
Talk
AlphaTrans: A Neuro-Symbolic Compositional Approach for Repository-Level Code Translation and Validation
Research Papers
Ali Reza Ibrahimzada University of Illinois Urbana-Champaign, Kaiyao Ke University of Illinois Urbana-Champaign, Mrigank Pawagi Indian Institute of Science, Bengaluru, Muhammad Salman Abid Cornell University, Rangeet Pan IBM Research, Saurabh Sinha IBM Research, Reyhaneh Jabbarvand University of Illinois at Urbana-Champaign
DOI Pre-print Media Attached
17:50
10m
Talk
Can Hessian-Based Insights Support Fault Diagnosis in Attention-based Models?
Ideas, Visions and Reflections
Sigma Jahan Dalhousie University, Masud Rahman Dalhousie University

Information for Participants
Mon 23 Jun 2025 16:00 - 18:00 at Cosmos Hall - SE and AI 1 Chair(s): Yuchao Jiang
Info for room Cosmos Hall:

This is the main event hall of Clarion Hotel, which will be used to host keynote talks and other plenary sessions. The FSE and ISSTA banquets will also happen in this room.

The room is just in front of the registration desk, on the other side of the main conference area. The large doors with numbers “1” and “2” provide access to the Cosmos Hall.