Don’t Rush to Critique: Cultivating an Analysis-First Habit in Code Review Models
In scenarios where GPU resources are constrained or code privacy requirements are stringent, fine-tuning models with fewer parameters to achieve performance comparable to large-scale models remains a common and effective approach. In the field of Au- tomated Code Review (ACR), existing fine-tuning methods have shown promising results by constructing a Chain-of-Thought (CoT) to simulate the general process used by human reviewers. However, although the performance gain of a CoT-based ACR has been evidently supported by current studies, a “Code Analysis” phase—where human experts establish an overview understanding of the code prior to the actual review—has not been explicitly reflected in existing ACR CoT frameworks. To address this issue, we propose CoRe, which explicitly incorporates a “Code Analysis” phase at the beginning of the CoT. This phase includes summarizing the code, analyzing core flows, and examining the content of diff changes. We then employ a sequential fine-tuning strategy to train CoRe, i.e, the model is first trained to perform code analysis and subsequently trained to generate review comments. Empirical evaluations on the public CodeReviewer dataset and our curated CoRe dataset demon-strate that a 14B parameter model fine-tuned with the CoRe method outperforms state-of-the-art large models—such as DeepSeek-R1 and GPT-5—despite their parameter scales being several orders of magnitude larger. This highlights a significant efficiency advantage. Ablation experiments further verify that explicitly incorporating this preliminary analysis into the ACR-oriented CoT is the fundamental driver of this performance improvement.
| (Internetware_SummaryReview.pdf) | 1.36MiB |
Sun 19 JulDisplayed time zone: Brisbane change
15:30 - 16:40 | Session 11: Software Analytics and Code ReviewResearch Track at Ballroom Chair(s): Yun Peng The Chinese University of Hong Kong | ||
15:30 17mTalk | KA-DA: Aligning LLMs with Expert Knowledge for Fine-Grained Software Defect Analysis Research Track Xuwen Wang National University of Defense Technology China, Jiaxin Li National University of Defense Technology China, Ruibo Wang National University of Defense Technology, Lin Peng National University of Defense Technology China, Linjin Wei National University of Defense Technology China, Zhen Zhu National University of Defense Technology China, Haodi Lu National University of Defense Technology China | ||
15:47 17mTalk | AgentGraph: Knowledge-Graph Augmented Agent Framework for Multi-Step Association Analysis Research Track houyuxuan East China Normal University, Junyuan Guo East China Normal University, Qiyuan Wang East China Normal University, Dongyi Ouyang East China Normal University, Junjie YAO | ||
16:05 17mTalk | MERC-Annot: Automated Annotation of Modification-Eliciting Code Review Comments with Large Language Models Research Track YongdaYu Nanjing University, Lei Zhang Nanjing University, Guoping Rong Nanjing University, Haifeng Shen Southern Cross University, Jiahao Zhang Nanjing University, Haoxiang Yan Nanjing University, Guohao Shi Nanjing University, Dong Shao Nanjing University, He Zhang Nanjing University File Attached | ||
16:22 17mTalk | Don’t Rush to Critique: Cultivating an Analysis-First Habit in Code Review Models Research Track YongdaYu Nanjing University, Guohao Shi Nanjing University, Long Xianjun China Telecom Research Institute, Guoping Rong Nanjing University, Haifeng Shen Southern Cross University, XueMing Gu University of Waterloo File Attached | ||