https://bugs.documentfoundation.org/show_bug.cgi?id=96918
Bug ID: 96918
Summary: Rounding display error for 15 digits integers
Product: LibreOffice
Version: unspecified
Hardware: All
OS: All
Status: UNCONFIRMED
Severity: normal
Priority: medium
Component: Calc
Assignee: [email protected]
Reporter: [email protected]
Found by DarthGizka on StackOverflow:
http://stackoverflow.com/questions/34499255/spreadsheet-calculations-with-at-least-the-accuracy-of-a-c-double
Even though internal values are at least precise to 2^52 or 2^53 (precision of
a IEEE 754 double), displayed values are less than 15 digits-precise.
* inputing 999999999999999 shows 1000000000000000
* inputing 1125899906842623 shows 1125899906842620
* inputing 4503599627370495 shows 4503599627370490
* inputing 4503599627370496 shows 4503599627370500
The displayed values should match the precision of internal values.
--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Libreoffice-bugs mailing list
[email protected]
http://lists.freedesktop.org/mailman/listinfo/libreoffice-bugs