Code Review as Decision-Making - Building a Cognitive Model from the Questions Asked During Code Review
This program is tentative and subject to change.
DOI: https://doi.org/10.1007/s10664-025-10791-2
Accepted: December 15, 2025
Journal: Empirical Software Engineering, Volume 31, 2026
Software developers spend an estimated 10% - 20% of their time on code review. With the rapid adoption of generative agents, the amount of code that needs to be reviewed is increasing at a faster rate than ever. Yet the tools for code review are still remarkably similar to the first tool, ICICLE, that was introduced over 30 years ago. There are significant misalignments between the tools used and the goals and actions of software developers, which reduces efficiency and adds frustration. The code review process is also challenging for many teams with a range of common antipatterns. Improving code review tools and processes has substantial potential benefits for the software engineering community.
In our paper, “Code Review as Decision-Making - Building a Cognitive Model from the Questions Asked During Code Review”, we present an ethnographic study involving 10 participants and 34 code reviews. The study builds a theoretical model of cognitive processes in code review, grounded in interviews and observations. Previously, code review has been understood primarily as a code comprehension activity. Developers reviewed the code to understand it, and once understood, writing comments and accepting or rejecting the patch came automatically. Current tools mirror this by focusing on a textual diff view seeking to isolate and explain the changes. However, through the data in our study, the similarities between the cognitive process in code review and decision-making processes, especially recognition-primed decision-making, become apparent. The Code Review as Decision-Making (CRDM) cognitive model shows how the developers move through two phases during the code review; first an orientation phase to establish context and rationale and then an analytical phase to understand, assess, and plan the rest of the review. Throughout the process several decisions must be taken, on writing comments, finding more information, voting, running the code locally, verifying continuous integration results, and so on.
Our work is novel and relevant for the ESEM research community because it provides a framework for understanding code review through a decision-making lens, rather than as a code comprehension activity. This can support development of better code review tools, with or without AI, that are inspired by tool advancements in decision-making support systems. It can also inform improvements to the code review process itself, by pointing to where and when developers would benefit from support and what kind of support would be helpful.
This program is tentative and subject to change.
Fri 9 OctDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
14:00 - 15:30 | Trust, Review and Evaluation of AI-Generated CodeESEM - Journal First Track / ESEM - Registered Reports Track / ESEM - Technical Track / ESEM - Software Engineering in Practice Track / ESEM - Emerging Results, Vision, and Reflection Papers Track at Terra | ||
14:00 12mTalk | AI-to-AI Code Review of GitHub Pull Requests ESEM - Emerging Results, Vision, and Reflection Papers Track | ||
14:12 12mTalk | How Developers Use Relation Chains in Code Review: An Empirical Study Across Three Open-Source Ecosystems ESEM - Technical Track Ahmed Belhouchette ENSI, Mannouba University, Moataz Chouchen Concordia University, Marouene Chaieb National School of Computer Science, Mohammad Hamdaqa Polytechnique Montreal, Abdelwahab Hamou-Lhadj Concordia University, Montreal, Canada | ||
14:25 12mTalk | How Do Software Professionals Evaluate AI-Generated Code? (Registered Report) ESEM - Registered Reports Track Samuli Määttä University of Oulu, Hera Arif Dalhousie University, Burak Turhan University of Oulu, Paul Ralph Dalhousie University, Markus Kelanti University of Oulu Pre-print | ||
14:38 12mTalk | CWEFT: CWE-aware Evaluation of Free-text vs. Typed Prompts ESEM - Emerging Results, Vision, and Reflection Papers Track | ||
14:51 12mTalk | Trust-Calibrated Code Review: A Participatory Design Study of Review Workflows for LLM-Generated Multi-File Changes ESEM - Software Engineering in Practice Track Lo Heander Lund University, Agnia Sergeyuk JetBrains Research, Ilya Zakharov JetBrains Research, Emma Söderberg Lund University, Nikita Mukhortov JetBrains | ||
15:04 12mTalk | Code Review as Decision-Making - Building a Cognitive Model from the Questions Asked During Code Review ESEM - Journal First Track | ||
15:17 12mTalk | How Reliable Is LLM-as-Judge for Patch Correctness Assessment? An Empirical Study ESEM - Technical Track Shanggui Zhan School of Computer Science and Technology, Hangzhou Dianzi University; Zhejiang Key Laboratory of New Industrial Internet Control Technology, Xingqi Wang School of Computer Science and Technology, Hangzhou Dianzi University; Zhejiang Key Laboratory of New Industrial Internet Control Technology, Dan Wei School of Computer Science and Technology, Hangzhou Dianzi University; Zhejiang Key Laboratory of New Industrial Internet Control Technology, Xin Xiang chool of Computer Science and Technology, Hangzhou Dianzi University | ||