Understanding Binary Code Similarity for Real-World Vulnerability Detection: A Large-Scale Empirical Study
Firmware lies at the heart of IoT devices. Its development depends heavily on third-party libraries (TPLs), which greatly accelerate the process but simultaneously introduce associated vulnerabilities. Binary Code Similarity Detection (BCSD) is an effective technique for identifying vulnerabilities in firmware by comparing pairs of code segments. However, existing studies either evaluate their performance only on small-scale datasets or lack diversity in terms of vulnerabilities, TPLs, and firmware. Consequently, a comprehensive understanding of BCSD for real-world vulnerability detection remains absent. To bridge this gap, we conduct a large-scale study of vulnerability detection across 60,000 firmware images from 200 vendors using BCSD. Rather than introducing a novel model, we examine the influence of four key factors—vulnerable function versions, vulnerability search space, function sizes, and compilation toolchains on BCSD performance. Our results reveal that these factors substantially affect performance, often by wide margins. To address this, we propose a build-aware query strategy that derives queries from representative real-world binaries, effectively closing the gap and raising the mean reciprocal rank (MRR) from 0.818 to 0.981. Furthermore, we demonstrate that a TPL-aware, two-stage search process significantly enhances accuracy, improving MRR by 18.5% by limiting the search space.
Tue 7 JulDisplayed time zone: Eastern Time (US & Canada) change
16:00 - 17:20 | Code similarity and searchResearch Papers at MB 3.435 Chair(s): Ying Zou Queen's University, Kingston, Ontario | ||
16:00 20mTalk | Understanding Code Similarity across Instruction Set Architectures: An Empirical Study Research Papers Haonan Yu Institute of Software Chinese Academy of Sciences, Jiaxin Zhu Institute of Software at Chinese Academy of Sciences, Yingying Zheng Institute of Software at Chinese Academy of Sciences, Yuwei Zhang Institute of Software Chinese Academy of Sciences, Wei Wang Institute of Software at Chinese Academy of Sciences, Jun Wei Institute of Software at Chinese Academy of Sciences; University of Chinese Academy of Sciences, Tao Huang Institute of Software at Chinese Academy of Sciences Pre-print | ||
16:20 20mTalk | SBridge: Identifying Source-to-Binary Function Similarity via Cross-Domain Control Block Matching Research Papers Heedong Yang Korea University, Jeongwoo Lee Korea University, Hajin Yun Korea University, Seunghoon Woo Korea University Pre-print | ||
16:40 20mTalk | Understanding Binary Code Similarity for Real-World Vulnerability Detection: A Large-Scale Empirical Study Research Papers Jingdong Guo Institute of Information Engineering, CAS; School of Cyber Security, UCAS, Chaopeng Dong School of Cyberspace, Hangzhou Dianzi University, Yimo Ren Institute of Information Engineering Chinese Academy of Sciences & University of Chinese Academy of Sciences, China, Siyuan Li University of Chinese Academy of Sciences & Institute of Information Engineering Chinese Academy of Sciences, China, Jie Liu Institute of Software, Chinese Academy of Sciences, Hong Li Institute of Information Engineering at Chinese Academy of Sciences, Hongsong Zhu Institute of Information Engineering at Chinese Academy of Sciences; University of Chinese Academy of Sciences Pre-print | ||
17:00 20mTalk | Project-Level C-to-Rust Translation via Pointer Knowledge Graphs Research Papers Zhiqiang Yuan Fudan University, Wenjun Mao Fudan University, Zhou , Xiyue Shang Fudan University, Chong Wang Nanyang Technological University, Yiling Lou University of Illinois at Urbana-Champaign, Xin Peng Fudan University | ||