yup interesting that the old AVM gives you what you'd think...
On 14 December 2010 16:36, Zeh Fernando <z...@zehfernando.com> wrote: > I like to quote this, from PHP.net's "Floating Point" documentation: > > "Floating point numbers have limited precision. Although it depends on the > system, PHP typically uses the IEEE 754 double precision format, which will > give a maximum relative error due to rounding in the order of 1.11e-16. Non > elementary arithmetic operations may give larger errors, and, of course, > error propagation must be considered when several operations are > compounded. > > Additionally, rational numbers that are exactly representable as floating > point numbers in base 10, like 0.1 or 0.7, do not have an exact > representation as floating point numbers in base 2, which is used > internally, no matter the size of the mantissa. Hence, they cannot be > converted into their internal binary counterparts without a small loss of > precision. This can lead to confusing results: for example, > floor((0.1+0.7)*10) will usually return 7 instead of the expected 8, since > the internal representation will be something like > 7.9999999999999991118.... > > So never trust floating number results to the last digit, and never compare > floating point numbers for equality." > > Additional, interesting read: > http://en.wikipedia.org/wiki/Floating_point#Accuracy_problems > <http://en.wikipedia.org/wiki/Floating_point#Accuracy_problems> > On Tue, Dec 14, 2010 at 10:15 AM, tom rhodes <tom.rho...@gmail.com> wrote: > > > same here compiling for flash player 10 and flash player 9, 8 and below > > give > > 0.3 as expected.... > > > > > > On 14 December 2010 15:42, Adrian Zając <zajac.adr...@gmail.com> wrote: > > > > > trace (0.27 + 0.03); > > _______________________________________________ > > Flashcoders mailing list > > Flashcoders@chattyfig.figleaf.com > > http://chattyfig.figleaf.com/mailman/listinfo/flashcoders > > > _______________________________________________ > Flashcoders mailing list > Flashcoders@chattyfig.figleaf.com > http://chattyfig.figleaf.com/mailman/listinfo/flashcoders > _______________________________________________ Flashcoders mailing list Flashcoders@chattyfig.figleaf.com http://chattyfig.figleaf.com/mailman/listinfo/flashcoders
