There are odd numbers. The first problem is that you have a three-way target and still have AUC. That shouldn't work. Likewise, you seem to have no data for the third case. This results in NaN when logs are taken.
Try re-running this without the third target variable. On Fri, Aug 5, 2011 at 7:54 PM, Xiaobo Gu <[email protected]> wrote: > And the output of validateAdaptiveLogistic on my system is as following: > > > Log-likelihood:Min=-100.00, Max=0.00, Mean=-27.13, Median=0.00 > > AUC = 0.48 > > ======================================================= > Confusion Matrix > ------------------------------------------------------- > a b c <--Classified as > 9711 0 0 | 9711 a = normal > 0 12833 0 | 12833 b = anomaly > 0 0 0 | 0 c = unknown > Default Category: unknown: 2 > > > > Entropy Matrix: [[NaN, NaN], [-0.0, -0.0]] > > There are a few questions about the output: > #1, From the Confusion Matrix, it seems all the records are get > classified correctly, but the AUC is just 0.48, it should be 1. > #2, What does the number after unknown mean, the internal code for > unknown? Since the confusionmatrix is created with default category > named unknown, so unknown will always shown in the result, even no > records are unknown, just like this example? > #3,The Entropy Matirx seems not working too. > #4,Since the result is 100% correct, is there something wrong? >
