Joey K Tuttle wrote:
Oh, you mean like this -
0j2 ": 295r1000 2995r10000
0.30 0.30
0j20 ": 295r1000 2995r10000
0.29500000000000000000 0.29950000000000000000
I agree with your expectations - but seems that already works...
Pocket calculators are authoritative about math rulse? This is
any old 4 function chip, or some specific one?
I think I will never use rational number for everyday calculation. I was
queried by a client why a report showed 0.29 when it should be 0.30, We verified
the calculation (qty * price / 1000) with her calculator, sanyo or casio I could
remembered but definitely a scientific calculator. It has round down, 4/5, round
up to 2 or 4 decimals or floating. IMO it does not matter which is more
authoritative, What is being shown on calculator lcd panel is a state of fact,
at least to accountants.
--
regards,
bill
----------------------------------------------------------------------
For information about J forums see http://www.jsoftware.com/forums.htm