You're getting to the limits of the precision of a Number.
In ActionScript 3, the Number type is stored in binary, in 64-bit
double-precision IEEE floating point format:
http://en.wikipedia.org/wiki/Binary64
It uses 52 bits for the mantissa (fractional part) which gives it an effective
precision of 53 bits, equal to about 16 decimal digits of precision. The error
you're getting is in the 17th digit - no surprise at all.
-Gerry
On 2010-12-19 , at 09:55 , Anthony Pace wrote:
> trace(Number('1000000009999992.2'));
>
> //why does it output 1000000009999992.3
> //I am assuming I am missing something pretty obvious
> _______________________________________________
> Flashcoders mailing list
> [email protected]
> http://chattyfig.figleaf.com/mailman/listinfo/flashcoders
_______________________________________________
Flashcoders mailing list
[email protected]
http://chattyfig.figleaf.com/mailman/listinfo/flashcoders
