Roger Andrews wrote:
That page has MAX_INTEGER as 2^53. While strictly correct in floating-point, it is conventional to have (2^n)-1 for a n-bit integer. IEEE binary64 numbers have 53 bits of precision (including the "hidden" bit), so I prefer MAX_INTEGER = 2^53-1 = 9007199254740991.
Good catch -- MAX should mean (and does mean, in Mozilla code I oversee) maximum value in the set, not the fencepost one beyond.
/be _______________________________________________ es-discuss mailing list [email protected] https://mail.mozilla.org/listinfo/es-discuss
