ICSME 2025
Sun 7 - Fri 12 September 2025 Auckland, New Zealand

This program is tentative and subject to change.

Fri 12 Sep 2025 11:00 - 11:10 at Room TBD2 - Session 14 - Human Factors 2

Understanding how developers interact with code generation tools (CGTs) requires detailed, real-time data on programming behavior which is often difficult to collect without disrupting workflow. We present CodeWatcher, a lightweight, unobtrusive client-server system designed to capture fine-grained interaction events from within the Visual Studio Code (VS Code) editor. CodeWatcher logs semantically meaningful events such as insertions made by CGTs, deletions, copy-paste actions, and focus shifts, enabling continuous monitoring of developer activity without modifying user workflows. The system comprises a VS Code plugin, a Python-based RESTful API, and a MongoDB backend, all containerized for scalability and ease of deployment. By structuring and timestamping each event, CodeWatcher enables post-hoc reconstruction of coding sessions and facilitates rich behavioral analyses, including how and when CGTs are used during development. This infrastructure is crucial for supporting research on responsible AI, developer productivity, and the human-centered evaluation of CGTs. Please find the demo and code here.

This program is tentative and subject to change.

Fri 12 Sep

Displayed time zone: Auckland, Wellington change

10:30 - 12:00
10:30
15m
Software Fairness Testing in Practice
Research Papers Track
10:45
15m
Refactoring Deep Learning Code: A Study of Practices and Unsatisfied Tool Needs
Research Papers Track
Siqi Wang Zhejiang University, Xing Hu Zhejiang University, Bei Wang Zhejiang University, China, Wenxin Yao Zhejiang University, Xin Xia Zhejiang University, Xinyu Wang Zhejiang University
11:00
10m
CodeWatcher: IDE Telemetry Data Extraction Tool for Understanding Coding Interactions with LLMs
Tool Demonstration Track
Manaal Ramadan Basha The University of British Columbia, Aimee M. Ribeiro Federal University of Para, Jeena Javahar The University of British Columbia, Gema Rodriguez-Perez The University of British Columbia, Cleidson de Souza Federal University of Pará, Brazil
11:10
15m
Understanding Practitioners’ Perspectives on Monitoring Machine Learning Systems
Industry Track
Hira Naveed Monash University, John Grundy Monash University, Chetan Arora Monash University, Hourieh Khalajzadeh Deakin University, Australia, Omar Haggag Monash University, Australia
11:25
15m
Using AI-based Coding Assistants in Practice: State of Affairs, Perceptions, and Ways Forward
Journal First Track
Agnia Sergeyuk JetBrains Research, Yaroslav Golubev JetBrains Research, Timofey Bryksin JetBrains Research, Iftekhar Ahmed University of California at Irvine
11:40
10m
An Empirical Study of GenAI Adoption in Open-Source Game Development: Tools, Tasks, and Developer Challenges
Registered Reports
Xiang Chen University of Waterloo, Wenhan Zhu Huawei Canada, Guoshuai Shi University of Waterloo, Michael W. Godfrey University of Waterloo, Canada
11:50
10m
Evaluating the Comprehension of the Stackage ecosystem: A Comparison Between VR and 2D Visualizations
Registered Reports
David Moreno-Lumbreras Universidad Rey Juan Carlos, Paul Leger Universidad Católica del Norte, Chile, Sergio Montes-León Universidad Rey Juan Carlos, Jesus M. Gonzalez-Barahona Universidad Rey Juan Carlos, Gregorio Robles Universidad Rey Juan Carlos
:
:
:
: