Case Study on Verification-Witness Validators: Where We Are and Where We Go
Software verification tools sometimes produce incorrect answers, which can be a false alarm or a wrong claim of correctness. To increase the reliability of verification results, many verifiers now accompany their answers by witnesses in an interoperable format. There are witness validators that can examine the witnesses and potentially confirm the verification results. This case study analyses the quality of existing witness validators for C programs using the witnesses produced by a wide variety of 47 verification tools that participated in SV-COMP 2022. In particular, we study the amount of cases in which a witness validator confirms an incorrect witness. We also suggest some advances in witness validation, including a scoring for a comparative evaluation of validators. These suggestions were recently approved by the SV-COMP community.