https://bugs.documentfoundation.org/show_bug.cgi?id=97989

            Bug ID: 97989
           Summary: LO Calc very poor performance when saving to ODS or
                    CSV on large spreadsheet
           Product: LibreOffice
           Version: 5.1.0.3 release
          Hardware: x86-64 (AMD64)
                OS: Windows (All)
            Status: UNCONFIRMED
          Severity: normal
          Priority: medium
         Component: Calc
          Assignee: [email protected]
          Reporter: [email protected]

Created attachment 122781
  --> https://bugs.documentfoundation.org/attachment.cgi?id=122781&action=edit
source file and performance usage charts for cases described in ticket

Hi,
I'd like to report problem I discovered when playing with larger files in LO
calc on version 5.1.0.3 x64 on windows7(x64).
Calc saves larger file very slowly - basically preventing any reasonable work
with such files.

Findings:
It takes about 15-20 seconds to load a file with 200 000 rows.
It takes 6 minutes (!!!) to save to CSV (random line was copied and added at
the bottom, so the file is not identical).
It takes 7 minutes (!!!) to save this 200k rows to ODS format (no changes in
content).
It takes only around 20 seconds to save to XLSX (no changes in content).

I also tested on portable LO 4.4.7x32 from portableapps and it wors MUCH
faster.
Times recorded
Load of CSV - cca 15s
Save to CSV (again with a random row copied and attached at the bottom) - less
than 10 seconds.
Save to ODS - 20 seconds
Save to XLSX - 10 seconds

What I find weird that handling XLSX is faster than ODS. (Saving and loading -
there is one chart with loads speeds.)

The attachment contains:
1) Original CSV file with 200k rows - star0000-1-200k.csv
Data are from here
https://sdm.lbl.gov/fastbit/data/samples.html , file star2000.csv.gz - I just
took 200k rows from it and save do separate file (in notepad).

2) screenshots from charts from Process Hacker.
How to read the charts: Top is CPU, middle memory, bottom I/O
Vertical lines are 10 second markers.
First bump is loading of the file, second bump (veeery long CPU hog for LO
5.1.0) is saving of the file to specific format.

Please notice that while CPU is hogged for few minutes in the worst cases,
there is almost no I/O activity.

OUTPUT files - not included due to attachmet limitation - I have them and can
provide on request.

Tested on Lenovo W520 laptop with i7-2760QM CPU. It is a quad-core with HT, so
eating 1 cpu core is visible as 12.5% CPU load on the chart.
8GB of RAM installed in the laptop.

I can run additional tests per instructions or provide more info, just let me
know.

Thanks and hopefully this could be corrected soon as it makes working with
larger files impossible.

Lastly - the loading and saving progressbar is NOT working in 5.1.0 x64 - LO
Calc just freezes during the save.

-- 
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Libreoffice-bugs mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/libreoffice-bugs

Reply via email to