Math.round(num)*10 ==3 should work On 12/6/06, T. Michael Keesey <[EMAIL PROTECTED]> wrote:
Couple of ways. Round to the nearest tenth. Math.round(num * 10) / 10 Direct test for 3 in the tenths place: Math.round(num * 10) % 10 == 3 On 12/6/06, Doug Coning <[EMAIL PROTECTED]> wrote: > Is there a better way to get the decimal value if flash is returning > .2999999? > > The decimal value will always be either .1, .2 or .3. It will not > exceed that. > > I just need to test for a .3 value. > > Any ideas? > > -----Original Message----- > From: [EMAIL PROTECTED] > [mailto:[EMAIL PROTECTED] On Behalf Of T. > Michael Keesey > Sent: Wednesday, December 06, 2006 3:23 PM > To: Flashcoders mailing list > Subject: Re: [Flashcoders] Compare Decimal Point Value? > > In Flash 9, I get this for the traces: > 2.3 > 0.2999999999999998 > 0.3 > false > false > true > > Good old-fashioned floating point precision error. Instead of testing > if they are equal, You could test if the difference between them is > very small, e.g.: > > trace(Math.abs(num2 - num3) < 0.00001); // true > > On 12/6/06, Doug Coning <[EMAIL PROTECTED]> wrote: > > I'm scratching my head over this. Not sure what I'm doing wrong? I > > need to compare a decimal value of a numeric field to see if it > contains > > a specific value of 0.3. Here is some sample code: > > > > var num:Number = 2.3; > > var num2:Number = num - int(num); > > var num3:Number = 0.3; > > > > trace(num); // 2.3 > > trace(num2); // 0.3 > > trace(num3); // 0.3 > > trace(num2 == num3);// false > > trace(num2 > num3);// false > > trace(num2 < num3);// true > > > > Why doesn't 0.3 equal 0.3? I've replaced int with Math.floor(), and > it > > still doesn't work. I need to get the value after the decimal point > and > > see if it equals 0.3. > > > > Thanks for your help. _______________________________________________ Flashcoders@chattyfig.figleaf.com To change your subscription options or search the archive: http://chattyfig.figleaf.com/mailman/listinfo/flashcoders Brought to you by Fig Leaf Software Premier Authorized Adobe Consulting and Training http://www.figleaf.com http://training.figleaf.com
_______________________________________________ Flashcoders@chattyfig.figleaf.com To change your subscription options or search the archive: http://chattyfig.figleaf.com/mailman/listinfo/flashcoders Brought to you by Fig Leaf Software Premier Authorized Adobe Consulting and Training http://www.figleaf.com http://training.figleaf.com
