ICSE 2026
Sun 12 - Sat 18 April 2026 Rio de Janeiro, Brazil
Wed 15 Apr 2026 16:45 - 17:00 at Oceania V - Human and Social Aspects 4 Chair(s): Yang Yue

With the rise of AI-powered coding assistants, firms and programmers are exploring how to optimize their interaction with them. Research has so far mainly focused on evaluating output quality and productivity gains, leaving aside the developers’ experience during the interaction. In this study, we take a multimodal, developer-centered approach to gain insights into how professional developers experience the interaction with Generative AI (GenAI) in their natural work environment in a firm. The aim of this paper is (1) to demonstrate a feasible mixed-method study design with controlled and uncontrolled study periods within a firm setting, (2) to give first insights from complementary behavioral and subjective experience data on developers’ interaction with GitHub Copilot and (3) to compare the impact of interaction types (no Copilot use, in-code suggestions, chat prompts or both in-code suggestions and chat prompts) on efficiency, accuracy and perceived workload whilst working on different task categories. Results of the controlled sessions in this study indicate that moderate use of either in-code suggestions or chat prompts improves efficiency (task duration) and reduces perceived workload compared to not using Copilot, while excessive or combined use lessens these benefits. Accuracy (task completion) profits from chat interaction. In general, subjective perception of workload aligns with objective behavioral data in this study. This study motivates the use of comparable study designs, in e.g. workshop or hackathon settings, to evaluate GenAI tools holistically and realistically with a focus on the developers’ experience.

Wed 15 Apr

Displayed time zone: Brasilia, Distrito Federal, Brazil change

16:00 - 17:30
Human and Social Aspects 4SE In Practice (SEIP) / SE in Society (SEIS) at Oceania V
Chair(s): Yang Yue California State University San Marcos
16:00
15m
Talk
Beyond the Commit: Developer Perspectives on Productivity with AI Coding AssistantsVirtual Attendance
SE In Practice (SEIP)
Valerie Chen Carnegie Mellon University, Jasmyn He BNY Mellon, Behnjamin Williams BNY Mellon, Jason Valentino BNY Mellon, Ameet Talwalkar Carnegie Mellon University
Pre-print Media Attached
16:15
15m
Talk
Vibe Coding in Practice: Motivations, Challenges, and a Future Outlook – a Grey Literature Review
SE In Practice (SEIP)
Ahmed Fawzy Massey University, Amjed Tahir Massey University, Kelly Blincoe University of Auckland
16:30
15m
Talk
Developer Needs and Feasible Features for AI Assistants in IDEs
SE In Practice (SEIP)
Agnia Sergeyuk JetBrains Research, Ekaterina Koshchenko JetBrains Research, Ilya Zakharov JetBrains Research, Timofey Bryksin JetBrains Research, Mali Izadi TU Delft
16:45
15m
Talk
Developers’ Experience with Generative AI - First Insights from an Empirical Mixed-Methods Field Study
SE In Practice (SEIP)
Charlotte Brandebusemeyer Hasso Plattner Institute, University of Potsdam, Tobias Schimmer SAP Labs, Bert Arnrich Hasso Plattner Institute, University of Potsdam
Pre-print
17:00
15m
Talk
AI Where It Matters: Where, Why, and How Developers Want AI Support in Daily Work
SE In Practice (SEIP)
Rudrajit Choudhuri Oregon State University, Carmen Badea Microsoft Research, Christian Bird Microsoft Research, Jenna L. Butler Microsoft Research, Robert DeLine Microsoft Research, Brian Houck Microsoft Research
Pre-print
17:15
15m
Talk
Perspective Coach: Exploring LLMs for Developer Reflection
SE in Society (SEIS)
Lauren Olson Vrije Universiteit Amsterdam, Emitzá Guzmán Vrije Universiteit Amsterdam, Florian Kunneman Utrecht University
Pre-print