[EMAIL PROTECTED] (Justin Mason) writes: > BTW, that ROCAC technique (ie. area under ROC curve) for getting a useful > single figure from a pair of FP/FN figures seems very promising.... Dan, > weren't you drawing graphs along those lines at some stage last year?
I've been using the FP/FN plots (for SpamAssassin as well as some work stuff) pretty regularly, although I never actually tried calculating the area, I just eyeballed the area and the distance to the origin (FP=0, FN=0) in the region of the lines we cared about. (I even drew one today for a VP here trying to explain something.) The best thing about it is that it allows you to compare any two filters with tunable thresholds (and you can even plot as a point the non-tunable ones). The first time I saw the FP/FN plot was in that Microsoft presentation in Boston. ;-) Daniel -- Daniel Quinlan http://www.pathname.com/~quinlan/
