Hello John,

There is a problem with the computation of VARSAMP and STDSAMP .

In selectParser.cc file you will find,

// sample variance is computed as
// (sum (x^2) / count(*) - (sum (x) / count(*))^2) * (count(*) / 
(count(*)-1))

which should be corrected by

(sum (x^2) / ( count(*) -1) - (sum (x) / count(*))^2) * (count(*) / 
(count(*)-1))

same correction for STDSAMP

sqrt((sum (x^2) / ( count(*) -1) - (sum (x) / count(*))^2) * (count(*) / 
(count(*)-1)))


Regards,

Alex
_______________________________________________
FastBit-users mailing list
[email protected]
https://hpcrdm.lbl.gov/cgi-bin/mailman/listinfo/fastbit-users

Reply via email to