Breaking the Alphabet: Rethinking File Ordering in Code Review
Effective code review is central to maintaining software quality, yet little is known about how the ordering of changed files in Pull Requests (PRs) influences review effectiveness. Most popular code review tools default to alphabetical ordering, favoring predictability over contextual relevance. While prior studies examined how file position shapes reviewer attention, it remains unclear how such ordering influences cognitive load and perceived thoroughness, which can potentially introduce usability barriers, overlooked defects, and review inefficiencies that ultimately undermine software reliability. This study presents the first large-scale survey of 1,355 professional developers across 182 widely used open-source projects to investigate how file ordering impacts review behavior, comprehension, and perceived effectiveness. Our mixed-methods analysis reveals that only 10.2% of reviewers consider alphabetical ordering optimal, underscoring its cognitive misalignment with how they interpret code changes. Although some developers appreciate its predictability, more than half (57.6%) note that it increases context switching, disrupts logical reasoning, and contributes to review fatigue, with 63.9% expressing concern that the default ordering may cause them to miss bugs. We further identify key challenges in multi-file reviews and elicit developers’ expectations for improved tooling, including dependency-aware grouping and customizable file ordering (requested by 66% of reviewers). These findings highlight the need for reviewer-centric interface designs that better align tool behavior with human cognition.
Thu 16 AprDisplayed time zone: Brasilia, Distrito Federal, Brazil change
16:00 - 17:30 | Human and Social Aspects 9SE In Practice (SEIP) / Research Track at Oceania V Chair(s): Liliana Pasquale University College Dublin & Lero | ||
16:00 15mTalk | Breaking the Alphabet: Rethinking File Ordering in Code Review Research Track Md Shamimur Rahman University of Saskatchewan, Zadia Codabux University of Saskatchewan, Chanchal K. Roy University of Saskatchewan | ||
16:15 15mTalk | “Still in the Loop”: Coping with Technostress in DevOps Teams and the Impact of GenAI SE In Practice (SEIP) Dharneeka Jeyam Bern University of Applied Sciences, Anna Wiedemann Bern University of Applied Sciences, Gerhard Schwabe University of Zurich, Kadircan Güney Zurich University of Applied Sciences | ||
16:30 15mTalk | Opportunities and Barriers for AI-Supported Quality Planning in the Automotive Domain: An Interview Survey at Volkswagen SE In Practice (SEIP) Henrik Waschke Volkswagen AG & Harz University, Jacob Krüger Eindhoven University of Technology, Thomas Leich Harz University of Applied Sciences, Germany | ||
16:45 15mTalk | Product Manager Practices for Delegating Work to Generative AI: ``Accountability must not be delegated to non-human actors'' SE In Practice (SEIP) Mara Ulloa Northwestern University, Jenna L. Butler Microsoft Research, Sankeerti Haniyur Microsoft Corporation, Courtney Miller Carnegie Mellon University, Barrett Amos Microsoft Research, Advait Sarkar Microsoft Research and University of Cambridge, Margaret-Anne Storey University of Victoria Pre-print | ||
17:00 15mTalk | Understanding Task Enjoyment in Software Development: A Mixed-Methods Study on Practitioners From Poland and Brazil SE In Practice (SEIP) Klara Borowa Warsaw University of Technology, Bartłomiej Rasztabiga Warsaw University of Technology, Institute of Control and Computation Engineering, Hubert Soroka Warsaw University of Technology, Institute of Control and Computation Engineering, Maciej Tymoftyjewicz Warsaw University of Technology, Institute of Control and Computation Engineering, Rodrigo Rebouças de Almeida Federal University of Paraiba | ||
17:15 15mTalk | Group versus Individual Review Requests: Tradeoffs in Speed and Quality at Mozilla Firefox SE In Practice (SEIP) Matej Kučera None, Marco Castelluccio Mozilla, Daniel Feitosa University of Groningen, Ayushi Rastogi University of Groningen, The Netherlands | ||