Re: [Jprogramming] Thoughts on formatting numbers

2018-04-12 Thread Don Guinn
Perhaps we shouldn't assume that the last binary digit is accurate. Previous calculations could reduce precision. And usually input is not accurate - especially to 16 significant digits. Often the input may not even be correct in the first digit. On Thu, Apr 12, 2018 at 5:20 PM, Raul Miller wrote

[Jprogramming] Thoughts on formatting numbers

2018-04-12 Thread Raul Miller
Conceptually, a floating point number does not represent a precise value. Instead, it represents a value from an interval which extends roughly half a bit lower and half a bit higher in the largest fractional position which can't be represented in that floating point format. But not only is that a