VULTRITION: Nutrition Labels for Vulnerability Datasets
This program is tentative and subject to change.
Function-level vulnerability detection models are often trained and tested on apparently equivalent datasets that differ in critical aspects such as class imbalance, the presence of duplicate functions, and contamination across splits. Such differences are often ill-documented and hard to verify. This paper introduces VULTRITION, a lightweight tool for analyzing function-level vulnerability datasets and generating compact summaries as “nutrition labels”. These labels report key facts about a dataset, such as its size, vulnerability-type coverage, class imbalance, redundancy, contamination across splits, and structural characteristics of the functions. These facts may help researchers make informed decisions when selecting datasets for vulnerability detection studies. We used VULTRITION to generate 15 nutrition labels for 9 popular function-level vulnerability datasets, revealing differences not readily apparent in the official dataset documentation. VULTRITION is planned to be extended to support other programming language types and vulnerability datasets beyond functions. We publicly release VULTRITION on GITHUB and as a PyPI package to support independent label generation and extensions. A video demo is available at: https://youtu.be/wEaGWKP5Szo.
This program is tentative and subject to change.
Fri 18 SepDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
14:00 - 15:30 | Session 23 - Evidence-Driven AI EngineeringDoctoral Symposium / Research Papers Track / Tool Demonstration and Data Showcase Track at Auditorium Chair(s): Camilo Escobar-Velásquez Universidad de los Andes, Colombia Theme: Empirical Software Engineering | ||
14:00 20mPaper | Understanding and Enhancing Bills of Materials for Software and Artificial Intelligence Supply Chains Doctoral Symposium Sabato Nocera University of Salerno | ||
14:20 20mPaper | Sentinel: Field-Sensitive Taint Analysis for Detecting Java Deserialization Gadget Chains Research Papers Track Yanrong Lu Civil aviation of university of china, Dongsheng Li Civil Aviation University of China, Siqi Ma the University of Queensland, Wencheng Yang University of Southern Queensland} \ Queensland Media Attached | ||
14:40 20mPaper | Unveiling the Ownership: An Empirical Study of Android App Associations via SDK IDs Research Papers Track Qinsheng Hou Shanghai Jiao Tong University, Wenrui Diao Shandong University, Chaoshun Zuo Ohio State University, Qingchuan Zhao City University of Hong Kong, Lingyun Ying QI-ANXIN Technology Research Institute, Yacong Gu Tsinghua University-QI-ANXIN Group JCN, Libo Chen Shanghai Jiao Tong University, Shanqing Guo Shandong University, Haixin Duan Institute for Network Science and Cyberspace, Tsinghua University; Qi An Xin Group Corp., Zhi Xue Shanghai Jiao Tong University Pre-print Media Attached | ||
15:00 10mShort-paper | VULTRITION: Nutrition Labels for Vulnerability Datasets Tool Demonstration and Data Showcase Track Torge Hinrichs Technische Universität Hamburg, Emanuele Iannone Technische Universität Hamburg, Riccardo Scandariato Hamburg University of Technology Pre-print Media Attached | ||