Re: Floating Point Arithmetics, reading 0.1066913 gives 0.10669129999999999

2019-10-18 Thread Schene, Chris
I think a lot of financial institutions used BCD (Binary Coded Decimal) because it is accurate without round off like floating point. Christopher Schene Field Engineer Fraud & Identity Client Implementations 16260 N. 71st Street, Suite 400 | Scottsdale, Arizona 85254

Re: Floating Point Arithmetics, reading 0.1066913 gives 0.10669129999999999

2019-10-18 Thread David Law
Hi Andreas, I tried to create a Spreadsheet to reproduce this but failed. (it returned double = 0.1066913) Could you share an example.xslsx with us to demonstrate the behaviour? All the best, DaveLaw On 18/10/2019 04:34, Andreas Reichel wrote: Dear All, compliments of the day. We face some

Re: Floating Point Arithmetics, reading 0.1066913 gives 0.10669129999999999

2019-10-18 Thread David Law
What we IBM Mainframers call "packed decimal". Rounding is still an issue: try dividing 2 by 3. But that doesn't help us here: Excel calculates using Floating Point so we just need to learn to live with its advantages & disadvantages. All the best, DaveLaw On 18/10/2019 22:55, Schene, Chris