https://gcc.gnu.org/bugzilla/show_bug.cgi?id=128852

--- Comment #2 from David Malcolm <dmalcolm at gcc dot gnu.org> ---
Trunk (r17-6248-gf7f84d53720030, which includes the symbolic value rewrite) got
what I believe are the same results:

Mode: filename + CWE-aware matching

==============================================================================
CATEGORY-AVERAGED SCORING (macro-averaged)
==============================================================================

Each category is weighted equally regardless of test count.
Each category is scored independently and averaged.

Category         CWE        TPR     FPR   Score
--------------------------------------------------
buffer_overflow  121       0.0%    0.0%   +0.0%
buffer_overread  126       0.0%    0.0%   +0.0%
cmdi             78        0.0%    0.0%   +0.0%
heap_buffer_overflow 122       0.0%    0.0%   +0.0%
intoverflow      190       0.0%    0.0%   +0.0%
ldapi            90        0.0%    0.0%   +0.0%
null_deref       476     100.0%    0.0% +100.0%
pathtraver       22        0.0%    0.0%   +0.0%
sqli             89        0.0%    0.0%   +0.0%
ssrf             918       0.0%    0.0%   +0.0%
use_after_free   416       0.0%    0.0%   +0.0%
weakcipher       327       0.0%    0.0%   +0.0%
weakhash         328       0.0%    0.0%   +0.0%
weakrand         330       0.0%    0.0%   +0.0%
xpathi           643       0.0%    0.0%   +0.0%
xxe              611       0.0%    0.0%   +0.0%
--------------------------------------------------
MACRO AVERAGE              6.2%    0.0%   +6.2%

==============================================================================
FLAT AGGREGATE SCORING
==============================================================================

Category         CWE    TP    FP    FN    TN        TPR     FPR   Score
------------------------------------------------------------------------------
buffer_overflow  121    0     0     3     3        0.0%    0.0%   +0.0%
buffer_overread  126    0     0     3     3        0.0%    0.0%   +0.0%
cmdi             78     0     0     3     3        0.0%    0.0%   +0.0%
heap_buffer_overflow 122    0     0     3     3        0.0%    0.0%   +0.0%
intoverflow      190    0     0     3     3        0.0%    0.0%   +0.0%
ldapi            90     0     0     3     3        0.0%    0.0%   +0.0%
null_deref       476    3     0     0     3      100.0%    0.0% +100.0%
pathtraver       22     0     0     3     3        0.0%    0.0%   +0.0%
sqli             89     0     0     3     3        0.0%    0.0%   +0.0%
ssrf             918    0     0     3     3        0.0%    0.0%   +0.0%
use_after_free   416    0     0     3     3        0.0%    0.0%   +0.0%
weakcipher       327    0     0     3     3        0.0%    0.0%   +0.0%
weakhash         328    0     0     3     3        0.0%    0.0%   +0.0%
weakrand         330    0     0     3     3        0.0%    0.0%   +0.0%
xpathi           643    0     0     3     3        0.0%    0.0%   +0.0%
xxe              611    0     0     3     3        0.0%    0.0%   +0.0%
------------------------------------------------------------------------------
TOTAL                   3     0     45    48       6.2%    0.0%   +6.2%

==============================================================================
SUMMARY
==============================================================================

  Total test cases:       96
  Vulnerable (ground truth): 48
  Safe (ground truth):    48
  TP/TN balance:          50/50
  Tests with findings:    3

  Flat Score:             +6.2%
  Category-Averaged:      +6.2% (macro-averaged)

  Score interpretation:
    +100%  Perfect (catches everything, zero false alarms)
       0%  Random guessing (no better than a coin flip)
    -100%  Perfectly wrong (flags safe, misses vulnerable)

Reply via email to