TCSE logo 
 Sigsoft logo
Sustainability badge

Measuring fuzzer performance by aggregate coverage measurement loses a significant amount of information regarding a fuzzer’s ability to explore a program. While historically fuzzer performance based on coverage has been measured as a single figure (e.g., “number of edges”), this value is necessarily misleading; two fuzzers can theoretically achieve the same number of edges but nearly mutually exclusive sets of coverage edges. In a previous work, we introduced the concept of relcov, an asymmetric similarity metric based on the Tversky index, that allowed us to identify the the relative coverage-finding ability of one fuzzer in terms of another. Seeing that this metric uncovered far greater detail regarding the relationship between fuzzers, we designed a second metric, relscore, suitable for ranking a large number of fuzzers based on the novelty of the edges they discover and the reliability with which they do so. We used relscore as the basis for evaluating the rank of fuzzers during the SBFT’25 competition, and in this report provide a deeper analysis using relcov.

Tue 29 Apr

Displayed time zone: Eastern Time (US & Canada) change

16:00 - 17:30
Tool Competitions 2 and Award CeremonySBFT at 104
Chair(s): Addison Crump CISPA Helmholtz Center for Information Security, Matteo Biagiola Università della Svizzera italiana, Alessio Gambi Austrian Institute of Technology (AIT), Vincenzo Riccio University of Udine
16:00
15m
Paper
SBFT Tool Competition 2025 - Java Test Case Generation Track
SBFT
Fitsum Kifetew Fondazione Bruno Kessler, Yun Lin Shanghai Jiao Tong University, Davide Prandi Fondazione Bruno Kessler
16:15
15m
Paper
EvoFuzz at the SBFT 2025 Java Tool Competition
SBFT
Seokhyeon Moon , Jinwoo Choi Technology Research, Samsung SDS, Seoul, Republic of Korea, Yoon-Chan Jhi Technology Research, Samsung SDS, Seoul, South Korea
16:30
15m
Paper
SBFT Tool Competition 2025 - Fuzzing Track
SBFT
Addison Crump CISPA Helmholtz Center for Information Security, Matteo Leonelli CISPA Helmholtz Center for Information Security, Sahil Sihag CISPA Helmholtz Center for Information Security
16:45
15m
Paper
KRAKEN-FUZZ: Minimizing Corpus During Fuzzing
SBFT
Jikai Wang Huazhong University of Science and Technology, Yuekang Li UNSW, Kailong Wang Huazhong University of Science and Technology
17:00
15m
Paper
HFuzz: Havoc Mode Guided Fuzzing
SBFT
Yuchong Xie Hong Kong University of Science and Technology, Dongdong She HKUST (The Hong Kong University of Science and Technology)
:
:
:
: