https://bugs.documentfoundation.org/show_bug.cgi?id=141614

            Bug ID: 141614
           Summary: EDITING: Calc shows incorrect SUM (deviation of
                    0.000000000002 added to/sub'd from total) in bottom
                    right status bar
           Product: LibreOffice
           Version: 6.4.6.2 release
          Hardware: x86-64 (AMD64)
                OS: Linux (All)
            Status: UNCONFIRMED
          Severity: minor
          Priority: medium
         Component: Calc
          Assignee: libreoffice-bugs@lists.freedesktop.org
          Reporter: thewebmach...@gmail.com

Description:
I found a rather annoying bug that I was surprised not to see in this tracker
yet (unless my 40m of searching was incomplete). While f you select an entire
column, you can see the SUM in the lower right. No matter what column of
numbers I select, I get a deviation of +/-0.000000000001 or +/-0.000000000001
added to the real sum. So, if the real sum is 123.45, I will see
123.450000000002 reported by Calc...or I'll see 123.449999999999.

Here's a good example data set:
1.2
1.44
1.2
1.2
2.4
1.44
1.2
1.2
1.2
2.4
1.2
1.68
0
1.44
3.36
1.2
1.44
0
1.2
1.68
0
1.2
1.44
2.4
1.2
20.4
1.44
1.2
1.68
1.44
1.2
1.44
1.2
1.2
1.2
1.68
1.2
1.2
1.2
1.2
1.2
1.2
1.44
1.44
1.2
1.44
1.2
1.2
1.2
2.4
1.2
1.44
1.2
0
1.2
1.2
1.2
1.2
1.2
1.2
1.2
0
1.2
1.2
1.2
1.2
1.2
1.2
1.44
1.2
0
1.2
1.44
0
1.2
1.44
1.2
1.2
1.44
4.8
3.36
1.2
1.2
1.2
1.44
1.2
1.2
1.44
1.2
1.2
1.44
1.2
1.2
4.32
1.2
1.2
1.2
1.2
3.36
1.1
3.6
1.2
0.85
0
0
0.35
2.4
1.2
0
1.44
1.2
1.2
1.2
1.2
2.4
1.2
1.2
1.2
1.2
1.2
1.2
1.2
1.2
1.2
2.4
1.2
2.88
1.2
0.7
1.44
1.2
1.44
1.2
1.2
1.2
0.78
1.2
1.2
3.36
1.44
0.6
1.2
1.2
1.2
1.2
1.2
1.2
1.2
1.2
1.2
1.2
1.2
1.2
1.2
1.68
2.4
1.2
1.2
1.2
SUM reported: 232.14

Now just add one more value: 1.2
SUM now reports: 233.339999999999


New set of numbers:
1.2
1.44
4.8
3.36
1.2
1.2
1.2
1.44
1.2
1.2
1.44
1.2
1.2
1.44
1.2
1.2
4.32
1.2
1.2
1.2
1.2
3.36
1.1
3.6
1.2
0.85
0
0
0.35
2.4
1.2
0
1.44
1.2
1.2
1.2
1.2
2.4
1.2
1.2
1.2
1.2
1.2
1.2
1.2
1.2
1.2
2.4
1.2
2.88
1.2
0.7
1.44
1.2
1.44
1.2
1.2
1.2
SUM reported as: 84.6

Now add just one more row: 0.78
SUM now reports: 85.380000000001

How is simple addition resulting in such a deviation from reality?

Steps to Reproduce:
1. Select or add a column of decimal numbers
2. Observe SUM in lower right status bar
3. SUM sometimes differs by +/-0.000000000001 or +/-0.000000000002

Actual Results:
Incorrect SUM in ~30% of cases

Expected Results:
Correct SUM


Reproducible: Always


User Profile Reset: No


OpenGL enabled: Yes

Additional Info:
Version: 6.4.6.2
Build ID: 1:6.4.6-0ubuntu0.20.04.1
CPU threads: 24; OS: Linux 5.8; UI render: default; VCL: gtk3; 
Locale: en-US (en_US.UTF-8); UI-Language: en-US
Calc: CL

OpenGL vendor string: NVIDIA Corporation
OpenGL renderer string: GeForce RTX 2080 SUPER/PCIe/SSE2
OpenGL core profile version string: 4.6.0 NVIDIA 460.67
OpenGL core profile shading language version string: 4.60 NVIDIA
OpenGL core profile context flags: (none)
OpenGL core profile profile mask: core profile
OpenGL core profile extensions:
OpenGL version string: 4.6.0 NVIDIA 460.67
OpenGL shading language version string: 4.60 NVIDIA
OpenGL context flags: (none)
OpenGL profile mask: (none)
OpenGL extensions:
OpenGL ES profile version string: OpenGL ES 3.2 NVIDIA 460.67
OpenGL ES profile shading language version string: OpenGL ES GLSL ES 3.20
OpenGL ES profile extensions:

-- 
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Libreoffice-bugs mailing list
Libreoffice-bugs@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/libreoffice-bugs

Reply via email to