Measuring fuzzer performance by aggregate coverage measurement loses a significant amount of information regarding a fuzzer’s ability to explore a program. While historically fuzzer performance based on coverage has been measured as a single figure (e.g., “number of edges”), this value is necessarily misleading; two fuzzers can theoretically achieve the same number of edges but nearly mutually exclusive sets of coverage edges. In a previous work, we introduced the concept of relcov, an asymmetric similarity metric based on the Tversky index, that allowed us to identify the the relative coverage-finding ability of one fuzzer in terms of another. Seeing that this metric uncovered far greater detail regarding the relationship between fuzzers, we designed a second metric, relscore, suitable for ranking a large number of fuzzers based on the novelty of the edges they discover and the reliability with which they do so. We used relscore as the basis for evaluating the rank of fuzzers during the SBFT’25 competition, and in this report provide a deeper analysis using relcov.
Tue 29 AprDisplayed time zone: Eastern Time (US & Canada) change
16:00 - 17:30 | Tool Competitions 2 and Award CeremonySBFT at 104 Chair(s): Addison Crump CISPA Helmholtz Center for Information Security, Matteo Biagiola Università della Svizzera italiana, Alessio Gambi Austrian Institute of Technology (AIT), Vincenzo Riccio University of Udine | ||
16:00 15mPaper | SBFT Tool Competition 2025 - Java Test Case Generation Track SBFT Fitsum Kifetew Fondazione Bruno Kessler, Yun Lin Shanghai Jiao Tong University, Davide Prandi Fondazione Bruno Kessler | ||
16:15 15mPaper | EvoFuzz at the SBFT 2025 Java Tool Competition SBFT Seokhyeon Moon , Jinwoo Choi Technology Research, Samsung SDS, Seoul, Republic of Korea, Yoon-Chan Jhi Technology Research, Samsung SDS, Seoul, South Korea | ||
16:30 15mPaper | SBFT Tool Competition 2025 - Fuzzing Track SBFT Addison Crump CISPA Helmholtz Center for Information Security, Matteo Leonelli CISPA Helmholtz Center for Information Security, Sahil Sihag CISPA Helmholtz Center for Information Security | ||
16:45 15mPaper | KRAKEN-FUZZ: Minimizing Corpus During Fuzzing SBFT Jikai Wang Huazhong University of Science and Technology, Yuekang Li UNSW, Kailong Wang Huazhong University of Science and Technology | ||
17:00 15mPaper | HFuzz: Havoc Mode Guided Fuzzing SBFT Yuchong Xie Hong Kong University of Science and Technology, Dongdong She HKUST (The Hong Kong University of Science and Technology) |