Raymond E. Griffith wrote:
> I set the numberFormat to 0.########## (10 places to the right of
> the decimal point) for calculation, but all answers are returned as
> integers.
As example calculation would be useful. You didn't state whether the
answer actually is an integer.
Eg: you want 10.0000000000 but only get 10 with no decimal point.
> I then set the numberFormat to 0.0000000000 for calculation. The
> calculations were stored correctly. I then set the numberFormat to
> 0.##########, added 0 to the calculated amounts for display. Again,
> the displayed amounts were integers.
Hashes in the NumberFormat specify that only non-zero trailing figures
are kept (eg 2.001000 -> 2.001), so again we need to know the actual
result of the calculation before we can tell if its a bug.
My apologies if you already knew this, but its been my experience that
its always good to check the simple things first before firing off bug
reports. There's nothing worse than paying for a service call on a
television because it wasn't plugged in :-)
> This is a pretty important issue for me.
Do you mind if I ask, what are you doing that requires 10 decimal places
of accuracy? That's a lot.
--
Steven D'Aprano
==========================================
M.B. Sales Pty Ltd Ph: +61 3 9460-5244
A.C.N. 005-964-796 Fax: +61 3 9462-1161
This is the MetaCard mailing list.
Archives: http://www.mail-archive.com/metacard%40lists.best.com/
Info: http://www.xworlds.com/metacard/mailinglist.htm
