SecureReviewer: Enhancing Large Language Models for Secure Code Review through Secure-Aware Fine-Tuning
Identifying and addressing security issues during the early phase of the development lifecycle is critical for mitigating the long-term negative impacts on software systems. Code review serves as an effective practice that enables developers to check their teammates’ code before integration into the codebase. To streamline the generation of review comments, various automated code review approaches have been proposed, where Large Language Model (LLM)-based methods have significantly advanced the capabilities of automated review generation. However, existing models primarily focus on general-purpose code review, their effectiveness in identifying and addressing security-related issues remains underexplored. Moreover, adapting existing code review approaches to target security issues faces substantial challenges, including data scarcity and inadequate evaluation metrics. To address these limitations, we propose SecureReviewer, a novel approach designed for enhancing LLMs’ ability to identify and resolve security-related issues during code review. Specifically, we first construct a dataset tailored for training and evaluating secure code review capabilities. Leveraging this dataset, we fine-tune LLMs to generate code review comments that can effectively identify security issues and provide fix suggestions with our proposed secure-aware fine-tuning strategy. To mitigate hallucination in LLMs and enhance the reliability of their outputs, we integrate the Retrieval-Augmented Generation (RAG) technique, which grounds the generated comments in domain-specific security knowledge. Additionally, we introduce SecureBLEU, a new evaluation metric designed to assess the effectiveness of review comments in addressing security issues. Experimental results demonstrate that SecureReviewer outperforms state-of-the-art baselines in both security issue detection accuracy and the overall quality and practical utility of generated review comments.
Wed 15 AprDisplayed time zone: Brasilia, Distrito Federal, Brazil change
11:00 - 12:30 | AI for Software Engineering 1Research Track / SE In Practice (SEIP) at Asia I Chair(s): Italo Santos University of Hawai‘i at Mānoa | ||
11:00 15mTalk | CREME: Robustness Enhancement of Code LLMs via Layer-Aware Model Editing Research Track Shuhan Liu Zhejiang University, Xing Hu Zhejiang University, Kerui Huang , Xiaohu Yang Zhejiang University, David Lo Singapore Management University, Xin Xia Zhejiang University | ||
11:15 15mTalk | Repairing LLM Executions for Secure Automatic Programming Research Track Ali El Husseini National University of Singapore, Yacine Izza National University of Singapore, Blaise Genest IPAL - CNRS - CNRS@CREATE, Abhik Roychoudhury National University of Singapore | ||
11:30 15mTalk | SecureReviewer: Enhancing Large Language Models for Secure Code Review through Secure-Aware Fine-Tuning Research Track Fang Liu Beihang University, Simiao Liu Beihang University, Yinghao Zhu Beihang University, Xiaoli Lian Beihang University, China, Li Zhang Beihang University Pre-print | ||
11:45 15mTalk | Find My Code Twin: Improving SNIPPET SEARCH Performance Using LLMs in Practice SE In Practice (SEIP) Seokjun Ko Samsung Electronics Co., Eunbi Jang AI Center, Samsung Electronics, Dahyeon Choi AI Center, Samsung Electronics, daeha ryu Innovation Center, Samsung Electronics, jinyoung park Innovation Center, Samsung Electronics, changseo park Innovation Center, Samsung Electronics DOI Media Attached | ||
12:00 15mTalk | Fixing Security Vulnerabilities with Agentic AI in OSS-Fuzz SE In Practice (SEIP) Yuntong Zhang National University of Singapore, Jiawei Wang University of Southern California, Dominic Berzin National University of Singapore, Martin Mirchev SonarSource, Abhik Roychoudhury National University of Singapore | ||
12:15 15mTalk | EvoC2Rust: A Skeleton-guided Framework for Project-Level C-to-Rust Translation SE In Practice (SEIP) Chaofan Wang Shanghai Jiao Tong University, Tingrui Yu Shanghai Jiao Tong University, Chen Xie Shanghai Jiao Tong University, Jie Wang Huawei Technologies Co., Ltd, Dong Chen Huawei Technologies Co., Ltd, Wenrui Zhang Huawei Technologies Co., Ltd, Yuling Shi Shanghai Jiao Tong University, Xiaodong Gu Shanghai Jiao Tong University, Beijun Shen Shanghai Jiao Tong University | ||