ICSE 2026
Sun 12 - Sat 18 April 2026 Rio de Janeiro, Brazil
Wed 15 Apr 2026 16:00 - 16:15 at Oceania V - Human and Social Aspects 4 Chair(s): Yang Yue

Measuring developer productivity is a topic that has attracted attention from both academic research and industrial practice. In the age of AI coding assistants, it has become even more important for both academia and industry to understand how to measure their impact on developer productivity, and to reconsider whether earlier measures and frameworks still apply. This study analyzes the validity of different approaches to evaluating the productivity impacts of AI coding assistants by leveraging mixed-method research. At BNY Mellon, we conduct a survey with 2989 developer responses and 11 in-depth interviews. Our findings demonstrate that a multifaceted approach is needed to measure AI productivity impacts: survey results expose conflicting perspectives on AI tool usefulness, while interviews elicit six distinct factors that capture both short-term and long-term dimensions of productivity. In contrast to prior work, our factors highlight the importance of long-term metrics like technical expertise and ownership of work. We hope this work encourages future research to incorporate a broader range of human-centered factors, and supports industry in adopting more holistic approaches to evaluating developer productivity.

Wed 15 Apr

Displayed time zone: Brasilia, Distrito Federal, Brazil change

16:00 - 17:30
Human and Social Aspects 4SE In Practice (SEIP) / SE in Society (SEIS) at Oceania V
Chair(s): Yang Yue California State University San Marcos
16:00
15m
Talk
Beyond the Commit: Developer Perspectives on Productivity with AI Coding AssistantsVirtual Attendance
SE In Practice (SEIP)
Valerie Chen Carnegie Mellon University, Jasmyn He BNY Mellon, Behnjamin Williams BNY Mellon, Jason Valentino BNY Mellon, Ameet Talwalkar Carnegie Mellon University
Pre-print Media Attached
16:15
15m
Talk
Vibe Coding in Practice: Motivations, Challenges, and a Future Outlook – a Grey Literature Review
SE In Practice (SEIP)
Ahmed Fawzy Massey University, Amjed Tahir Massey University, Kelly Blincoe University of Auckland
16:30
15m
Talk
Developer Needs and Feasible Features for AI Assistants in IDEs
SE In Practice (SEIP)
Agnia Sergeyuk JetBrains Research, Ekaterina Koshchenko JetBrains Research, Ilya Zakharov JetBrains Research, Timofey Bryksin JetBrains Research, Mali Izadi TU Delft
16:45
15m
Talk
Developers’ Experience with Generative AI - First Insights from an Empirical Mixed-Methods Field Study
SE In Practice (SEIP)
Charlotte Brandebusemeyer Hasso Plattner Institute, University of Potsdam, Tobias Schimmer SAP Labs, Bert Arnrich Hasso Plattner Institute, University of Potsdam
Pre-print
17:00
15m
Talk
AI Where It Matters: Where, Why, and How Developers Want AI Support in Daily Work
SE In Practice (SEIP)
Rudrajit Choudhuri Oregon State University, Carmen Badea Microsoft Research, Christian Bird Microsoft Research, Jenna L. Butler Microsoft Research, Robert DeLine Microsoft Research, Brian Houck Microsoft Research
Pre-print
17:15
15m
Talk
Perspective Coach: Exploring LLMs for Developer Reflection
SE in Society (SEIS)
Lauren Olson Vrije Universiteit Amsterdam, Emitzá Guzmán Vrije Universiteit Amsterdam, Florian Kunneman Utrecht University
Pre-print