FSE 2026
Sun 5 - Thu 9 July 2026 Montreal, Canada
Thu 9 Jul 2026 14:00 - 14:20 at MB 2.210 - Code review 2 Chair(s): Binhang Qi

Code review is a widespread practice in software engineering during which developers examine each other’s source code changes to identify potential issues and improve code quality. Among the automated techniques proposed by researchers to reduce the manual workload of code review, Automated Code Revision (ACR) aims to automatically address reviewers’ feedback by producing a revised version of the code. Transformer-based language models have demonstrated state-of-the-art results in ACR. The performance of these models, however, is significantly influenced by the quality and preparation of the training and evaluation data. We present several systematic analyses of prevalent preprocessing steps, examined both cumulatively and in isolation, across three established preprocessing pipelines and two dataset splitting strategies (time-level vs. project-level). Our study spans across models of different scales: OpenNMT (small), T5 and CodeReviewer (mid-sized), LoRA-tuned CodeLLaMA-7B (large), and GPT-3.5-Turbo (large, black-box). Using datasets up to 496k training records, we evaluate and statistically compare models’ performance using exact match ratio (EXM), CodeBLEU, and Levenshtein ratio. Our findings show that preprocessing may be a significant component in the success of the different techniques: OpenNMT relies on heavy preprocessing; T5 benefits from light filtering (selective removal of records); CodeReviewer performs best when trained on larger, less aggressively filtered data; CodeLLaMA-7B and ChatGPT-3.5 Turbo are largely indifferent to preprocessing. Overall, the effectiveness of ACR tools depends on aligning preprocessing with model scale and training setup. In general, small models need abstraction, mid-sized ones benefit from light filtering, and large-scale models perform best when trained on the original, unprocessed form of the code.

Thu 9 Jul

Displayed time zone: Eastern Time (US & Canada) change

14:00 - 15:30
Code review 2Industry Papers / Journal-First Paper / Research Papers / Tool Demonstrations at MB 2.210
Chair(s): Binhang Qi National University of Singapore
14:00
20m
Talk
The Price of Precision: The Cost of Preprocessing for Automated Code Revision in Code Review
Journal-First Paper
Shirin Pirouzkhah University of Zurich, Pooja Rani University of Zurich, Francesco Sovrano USI Lugano, Switzerland, Vincent Hellendoorn Google DeepMind, USA, Alberto Bacchelli IfI, University of Zurich
14:20
20m
Talk
Benchmarking LLMs for Fine-Grained Code Review with Enriched Context in Practice
Industry Papers
Ruida Hu Harbin Institute of Technology, Shenzhen, Xinchen Wang Harbin Institute of Technology, Xin-Cheng Wen Harbin Institute of Technology, Zhao Zhang Bytedance Network Technology, Bo Jiang Bytedance Network Technology, Pengfei Gao ByteDance, Chao Peng Tencent, Cuiyun Gao Harbin Institute of Technology, Shenzhen
14:40
20m
Talk
Mitigating the Risk of Defects and Improving Knowledge Distribution with Code Reviewer Recommenders
Research Papers
Mohammadali Sefidi Esfahani Concordia University, Peter Rigby Concordia University; Meta
Pre-print
15:00
20m
Talk
The Interaction of Complexity and Provenance in Code Review Decisions: Evidence from a Controlled Experiment
Research Papers
Neha Singh University of Zurich, Francesco Sovrano USI Lugano, Switzerland, Vincent Hellendoorn Google DeepMind, USA, Alberto Bacchelli IfI, University of Zurich
DOI Pre-print
15:20
10m
Talk
SmartPatchLinker: An Open-Source Tool to Linked Changes Detection for Code Review
Tool Demonstrations
Islem Khemissi Concordia University, Moataz Chouchen Concordia University, Dong Wang Tianjin University, Raula Gaikovina Kula The University of Osaka