https://gcc.gnu.org/bugzilla/show_bug.cgi?id=128852
--- Comment #1 from David Malcolm <dmalcolm at gcc dot gnu.org> ---
I tried running GCC's -fanalyzer against the C suite
(benchproctor-c-2026.11.16.zip)
GCC 16.2.1 got this result:
Mode: filename + CWE-aware matching
==============================================================================
CATEGORY-AVERAGED SCORING (macro-averaged)
==============================================================================
Each category is weighted equally regardless of test count.
Each category is scored independently and averaged.
Category CWE TPR FPR Score
--------------------------------------------------
buffer_overflow 121 0.0% 0.0% +0.0%
buffer_overread 126 0.0% 0.0% +0.0%
cmdi 78 0.0% 0.0% +0.0%
heap_buffer_overflow 122 0.0% 0.0% +0.0%
intoverflow 190 0.0% 0.0% +0.0%
ldapi 90 0.0% 0.0% +0.0%
null_deref 476 100.0% 0.0% +100.0%
pathtraver 22 0.0% 0.0% +0.0%
sqli 89 0.0% 0.0% +0.0%
ssrf 918 0.0% 0.0% +0.0%
use_after_free 416 0.0% 0.0% +0.0%
weakcipher 327 0.0% 0.0% +0.0%
weakhash 328 0.0% 0.0% +0.0%
weakrand 330 0.0% 0.0% +0.0%
xpathi 643 0.0% 0.0% +0.0%
xxe 611 0.0% 0.0% +0.0%
--------------------------------------------------
MACRO AVERAGE 6.2% 0.0% +6.2%
==============================================================================
FLAT AGGREGATE SCORING
==============================================================================
Category CWE TP FP FN TN TPR FPR Score
------------------------------------------------------------------------------
buffer_overflow 121 0 0 3 3 0.0% 0.0% +0.0%
buffer_overread 126 0 0 3 3 0.0% 0.0% +0.0%
cmdi 78 0 0 3 3 0.0% 0.0% +0.0%
heap_buffer_overflow 122 0 0 3 3 0.0% 0.0% +0.0%
intoverflow 190 0 0 3 3 0.0% 0.0% +0.0%
ldapi 90 0 0 3 3 0.0% 0.0% +0.0%
null_deref 476 3 0 0 3 100.0% 0.0% +100.0%
pathtraver 22 0 0 3 3 0.0% 0.0% +0.0%
sqli 89 0 0 3 3 0.0% 0.0% +0.0%
ssrf 918 0 0 3 3 0.0% 0.0% +0.0%
use_after_free 416 0 0 3 3 0.0% 0.0% +0.0%
weakcipher 327 0 0 3 3 0.0% 0.0% +0.0%
weakhash 328 0 0 3 3 0.0% 0.0% +0.0%
weakrand 330 0 0 3 3 0.0% 0.0% +0.0%
xpathi 643 0 0 3 3 0.0% 0.0% +0.0%
xxe 611 0 0 3 3 0.0% 0.0% +0.0%
------------------------------------------------------------------------------
TOTAL 3 0 45 48 6.2% 0.0% +6.2%
==============================================================================
SUMMARY
==============================================================================
Total test cases: 96
Vulnerable (ground truth): 48
Safe (ground truth): 48
TP/TN balance: 50/50
Tests with findings: 3
Flat Score: +6.2%
Category-Averaged: +6.2% (macro-averaged)
Score interpretation:
+100% Perfect (catches everything, zero false alarms)
0% Random guessing (no better than a coin flip)
-100% Perfectly wrong (flags safe, misses vulnerable)