ICSME 2025
Sun 7 - Fri 12 September 2025 Auckland, New Zealand

This program is tentative and subject to change.

Fri 12 Sep 2025 11:25 - 11:40 at Case Room 260-057 - Session 14 - Human Factors 2 Chair(s): Valeria Pontillo

Context. The last several years saw the emergence of AI assistants for code - multi-purpose AI-based helpers in software engineering. As they become omnipresent in all aspects of software development, it becomes critical to understand their usage patterns.

Objective. We aim to better understand how specifically developers are using AI assistants, why they are not using them in certain parts of their development workflow, and what needs to be improved in the future.

Methods. In this work, we carried out a large-scale survey aimed at how AI assistants are used, focusing on specific software development activities and stages. We collected opinions of 481 programmers on five broad activities: (a) implementing new features, (b) writing tests, (c) bug triaging, (d) refactoring, and (e) writing natural-language artifacts, as well as their individual stages.

Results. Our results provide a novel comparison of different stages where AI assistants are used that is both comprehensive and detailed. It highlights specific activities that developers find less enjoyable and want to delegate to an AI assistant, e.g., writing tests and natural-language artifacts. We also determine more granular stages where AI assistants are used, such as generating tests and generating docstrings, as well as less studied parts of the workflow, such as generating test data. Among the reasons for not using assistants, there are general aspects like trust and company policies, as well as more concrete issues like the lack of project-size context, which can be the focus of the future research.

Conclusion. The provided analysis highlights stages of software development that developers want to delegate and that are already popular for using AI assistants, which can be a good focus for features aimed to help developers right now. The main reasons for not using AI assistants can serve as a guideline for future work.

This program is tentative and subject to change.

Fri 12 Sep

Displayed time zone: Auckland, Wellington change

10:30 - 12:00
10:30
15m
Software Fairness Testing in Practice
Research Papers Track
10:45
15m
Refactoring Deep Learning Code: A Study of Practices and Unsatisfied Tool Needs
Research Papers Track
Siqi Wang Zhejiang University, Xing Hu Zhejiang University, Bei Wang Zhejiang University, China, Wenxin Yao Zhejiang University, Xin Xia Zhejiang University, Xinyu Wang Zhejiang University
11:00
10m
CodeWatcher: IDE Telemetry Data Extraction Tool for Understanding Coding Interactions with LLMs
Tool Demonstration Track
Manaal Ramadan Basha The University of British Columbia, Aimee M. Ribeiro Federal University of Para, Jeena Javahar The University of British Columbia, Gema Rodriguez-Perez The University of British Columbia, Cleidson de Souza Federal University of Pará, Brazil
11:10
15m
Understanding Practitioners’ Perspectives on Monitoring Machine Learning Systems
Industry Track
Hira Naveed Monash University, John Grundy Monash University, Chetan Arora Monash University, Hourieh Khalajzadeh Deakin University, Australia, Omar Haggag Monash University, Australia
11:25
15m
Using AI-based Coding Assistants in Practice: State of Affairs, Perceptions, and Ways Forward
Journal First Track
Agnia Sergeyuk JetBrains Research, Yaroslav Golubev JetBrains Research, Timofey Bryksin JetBrains Research, Iftekhar Ahmed University of California at Irvine
11:40
10m
An Empirical Study of GenAI Adoption in Open-Source Game Development: Tools, Tasks, and Developer Challenges
Registered Reports
Xiang Chen University of Waterloo, Wenhan Zhu Huawei Canada, Guoshuai Shi University of Waterloo, Michael W. Godfrey University of Waterloo, Canada
11:50
10m
Evaluating the Comprehension of the Stackage ecosystem: A Comparison Between VR and 2D Visualizations
Registered Reports
David Moreno-Lumbreras Universidad Rey Juan Carlos, Paul Leger Universidad Católica del Norte, Chile, Sergio Montes-León Universidad Rey Juan Carlos, Jesus M. Gonzalez-Barahona Universidad Rey Juan Carlos, Gregorio Robles Universidad Rey Juan Carlos