https://bugs.documentfoundation.org/show_bug.cgi?id=173053

--- Comment #10 from [email protected] ---
Thanks Ady
The VALUE() didn't help in what I am trying to produce but it turns out that I
can evaluate the decimal places from a TEXT cell, which I didn't expect and is
a good result.

So,  TEXT works well and VALUE() can be used for maths that doesn't like TEXT.

I've added a real world example, which mostly works. I don't need VALUE() for
the calcs so far.  I thought you might like to see what it is that I've been
going on about, basically it's the evaluation of physically measurements
against the design tolerances with are either the Default (D) drawing top
corner stand or stated per measurement by dimension limits.

I have found what I believe to be a rounding error, I'm not sure if it's the
internal TEXT to number conversion or something else, but changing the TEXT
using VALUE() doesn't resolve it. I've duplicated the sheet to both approaches
are tested. 

The IF() statement and the associated maths produce a wrong result in one case
and it doesn't matter whether I calculate using the TEXT cells or the VALUE()
cells.  The error is tiny, 15 decimal places, but enough to make a < in an IF
statement go wrong.  It's with BORE 3, the Calculation should be 0, if I change
the tolerance ( BORE 4) from -0.4 to -0.400000000001  then it works. 

IF -0.4 < -0.4 should be FALSE  and -0.4 - -0.4 should be 0 .  In the case of
BORE 3, it isn't. 

At least I've proved the concept, I might need to add a function to ignore
errors that are outside of the decimal places that the tolerances are to so any
error values smaller that 0.0009 can be ignored.  If I can prove the cause of
the error, I will raise a bug report.   

Thanks for the Help

-- 
You are receiving this mail because:
You are the assignee for the bug.

Reply via email to