[Libreoffice-bugs] [Bug 65046] Threaded calculation of formula groups (multi-threading)
https://bugs.documentfoundation.org/show_bug.cgi?id=65046 Rinat changed: What|Removed |Added Status|RESOLVED|CLOSED --- Comment #37 from Rinat --- I've made several test today. I think the issue that I've reported 8 years ago is reduced. I also don't remember the spread sheet I used for reproduction. And a way to reproduce is changed from my experience too. New way to reproduce: 1. Create Spreadsheet 2. Fill many cells with data or formulas. BUT SET a limits for reproduction size!! columns A-AZ, 2 rows, up to 20 symbols per cell. Don't use too many cascaded formulas. 3. save it, close office, and open file again. Currently it consumes up to 2 cores which is good. Also new Libreoffice uses GPU, which was not available 8 years old version. The opening speed for me is decent now. Issue I've reported is resolved. -- You are receiving this mail because: You are the assignee for the bug.
[Libreoffice-bugs] [Bug 65046] Threaded calculation of formula groups (multi-threading)
https://bugs.documentfoundation.org/show_bug.cgi?id=65046 --- Comment #36 from Rinat --- Created attachment 176069 --> https://bugs.documentfoundation.org/attachment.cgi?id=176069=edit new test file3 -- You are receiving this mail because: You are the assignee for the bug.
[Libreoffice-bugs] [Bug 65046] Threaded calculation of formula groups (multi-threading)
https://bugs.documentfoundation.org/show_bug.cgi?id=65046 --- Comment #35 from Rinat --- Created attachment 176068 --> https://bugs.documentfoundation.org/attachment.cgi?id=176068=edit new test file2 -- You are receiving this mail because: You are the assignee for the bug.
[Libreoffice-bugs] [Bug 65046] Threaded calculation of formula groups (multi-threading)
https://bugs.documentfoundation.org/show_bug.cgi?id=65046 --- Comment #34 from Kevin Suo --- (In reply to Rinat from comment #33) I see your test file. Now please explain how to reproduce the bug? Please use 1,2,3, and explain the current behaviour and your expected behavior. E.g.: Steps to Reproduce: 1. Open the file; 2. Set formula "=vlookup(?)" in cell ? 3. Fill down to the end of the column? 4. ??? Current Behaviour: In step 3, the formula filling down operation takes ? minutes to finish and uses only 1 core of CPU. ??? Expected Behaviour: Formula filling down operation in step 3 should finish in ? minutes and should use all my CPU cores. ??? Then copy-paste the libreoffice version information as shown in "Help -> About LibreOffice". Also state the operating system information (e.g. Ubuntu 18.04 LTS x64 etc), your GPU information. Be aware that this should be the system you have tested the bug. -- You are receiving this mail because: You are the assignee for the bug.
[Libreoffice-bugs] [Bug 65046] Threaded calculation of formula groups (multi-threading)
https://bugs.documentfoundation.org/show_bug.cgi?id=65046 --- Comment #33 from Rinat --- Created attachment 176067 --> https://bugs.documentfoundation.org/attachment.cgi?id=176067=edit new test file -- You are receiving this mail because: You are the assignee for the bug.
[Libreoffice-bugs] [Bug 65046] Threaded calculation of formula groups (multi-threading)
https://bugs.documentfoundation.org/show_bug.cgi?id=65046 --- Comment #32 from Aron Budea --- (In reply to fredgib from comment #31) > I thought any resource-intensive task would show the problem. In case I was > wrong and, as you suggest, it might depend on the nature of the task, here > is what I daily struggle with: > 1. create a 30,000-row and two-column file with: > - first column being unique integers > - second column being whatever text > 2. create another similar file, this time with 300,000 rows. > 3. In the second file, create a third column with a formula only having a > VLOOKUP to fetch the second column's value in the first file, against the > first column's integer. > 4. monitor your CPU resource consumption (and have a cocktail): only one > core is fully used, while the other are idle. Please create a new report, and include sample files created based on the description you gave. Set the new report to "block" the VLOOKUP meta bug: bug 109329. -- You are receiving this mail because: You are the assignee for the bug.
[Libreoffice-bugs] [Bug 65046] Threaded calculation of formula groups (multi-threading)
https://bugs.documentfoundation.org/show_bug.cgi?id=65046 --- Comment #31 from fred...@free.fr --- (In reply to Kevin Suo from comment #30) > @fredgib: > So what exactly is not working at this stage? You mentioned that "What I > have witnessed is exactly what is described in the original post of this > thread". However, it was many years ago and things have changed a lot, see > bug 114159 I saw this, and like many users, I have however witnessed only one core used during processing by LibreOffice. > and > https://bugs.documentfoundation.org/showdependencytree.cgi?id=139443. This is exactly what I experience too. But it was marked as a duplicate of THIS bug, so I thought THIS bug should be marked as "major", precisely because it had been marked as "enhancement" for 7 or 8 years without being addressed in a way that forced LibreOffice to actually use all the cores. > Citing > the description of what has been reported many years ago does not help. You > should re-test with a most recent release. As I mentioned implicitly by "with all the versions since v6.0", I tested it with all the versions since 6.0, to the present version 7.2.2, with exactly the same result. > > The point is, one should clearly describe what exactly is not working today > with the multi-threading calculation in Calc, I think we are several to have done this, in https://bugs.documentfoundation.org/showdependencytree.cgi?id=139443, in this thread or in support forums (one example among several instances in several languages: https://ask.libreoffice.org/t/how-can-i-make-libreoffice-multi-threaded/18749) > and if it does not work then > one should describe which function/formula is not working, it provide clear > and simple reproducible steps. I thought any resource-intensive task would show the problem. In case I was wrong and, as you suggest, it might depend on the nature of the task, here is what I daily struggle with: 1. create a 30,000-row and two-column file with: - first column being unique integers - second column being whatever text 2. create another similar file, this time with 300,000 rows. 3. In the second file, create a third column with a formula only having a VLOOKUP to fetch the second column's value in the first file, against the first column's integer. 4. monitor your CPU resource consumption (and have a cocktail): only one core is fully used, while the other are idle. > Only in this way the devs can jump in and > help to improve. In my opinion it does not matter if new bug reports should > be opened for this purpose. I agree. Whatever works to have some skilled people solve that issue... -- You are receiving this mail because: You are the assignee for the bug.
[Libreoffice-bugs] [Bug 65046] Threaded calculation of formula groups (multi-threading)
https://bugs.documentfoundation.org/show_bug.cgi?id=65046 --- Comment #30 from Kevin Suo --- @fredgib: So what exactly is not working at this stage? You mentioned that "What I have witnessed is exactly what is described in the original post of this thread". However, it was many years ago and things have changed a lot, see bug 114159 and https://bugs.documentfoundation.org/showdependencytree.cgi?id=139443. Citing the description of what has been reported many years ago does not help. You should re-test with a most recent release. The point is, one should clearly describe what exactly is not working today with the multi-threading calculation in Calc, and if it does not work then one should describe which function/formula is not working, it provide clear and simple reproducible steps. Only in this way the devs can jump in and help to improve. In my opinion it does not matter if new bug reports should be opened for this purpose. -- You are receiving this mail because: You are the assignee for the bug.
[Libreoffice-bugs] [Bug 65046] Threaded calculation of formula groups (multi-threading)
https://bugs.documentfoundation.org/show_bug.cgi?id=65046 --- Comment #29 from fred...@free.fr --- (In reply to Aron Budea from comment #27) > That still isn't actionable, please do feel free to open new bug report(s) > with specifics. (reproduction steps, expectations etc.) Sorry I am not very familiar with bug reporting, Bugzilla and LibreOffice development process... What I have witnessed is exactly what is described in the original post of this thread, with all the versions since v6.0, with 6 or 8 intel cores and Debian Testing, therefore I don't see the added value of copy-pasting it in a new thread. Moreover, maybe because English is not by mother tongue, I don't quite understand what you mean by "it is not actionable". Could you please be more specific in a "newbie-friendly" sense? -- You are receiving this mail because: You are the assignee for the bug.
[Libreoffice-bugs] [Bug 65046] Threaded calculation of formula groups (multi-threading)
https://bugs.documentfoundation.org/show_bug.cgi?id=65046 --- Comment #28 from Timur --- It would be useful if fredgib could attach his anonymized 300,000 rows sample. -- You are receiving this mail because: You are the assignee for the bug.___ Libreoffice-bugs mailing list Libreoffice-bugs@lists.freedesktop.org https://lists.freedesktop.org/mailman/listinfo/libreoffice-bugs
[Libreoffice-bugs] [Bug 65046] Threaded calculation of formula groups (multi-threading)
https://bugs.documentfoundation.org/show_bug.cgi?id=65046 --- Comment #27 from Aron Budea --- That still isn't actionable, please do feel free to open new bug report(s) with specifics. (reproduction steps, expectations etc.) -- You are receiving this mail because: You are the assignee for the bug.___ Libreoffice-bugs mailing list Libreoffice-bugs@lists.freedesktop.org https://lists.freedesktop.org/mailman/listinfo/libreoffice-bugs
[Libreoffice-bugs] [Bug 65046] Threaded calculation of formula groups (multi-threading)
https://bugs.documentfoundation.org/show_bug.cgi?id=65046 --- Comment #26 from pharmankur --- I Agree with @fred...@free.fr on --> Note: Activating "Settings > Calc > Calculation > multi-thread" has no effect and enabling OpenCL is not persistent after LibreOffice required restart. --- Calc speed is not improved visibly since last 8 Yrs (since I started using it). Here I am not discrediting any contributions done under the hood which may be many! But net result for the user is not pleasing at all. In my system monitor (Linux Mint) I always get one core stuck at 100% even if so called multithreading is enabled ( I am on Libreoffice Version 7.1.4.2 ) For many of my Calculation intensive sheets and still prefer to copy-paste data on Google sheet, Get calculation data from there and paste the result back to Libreoffice calc. ... This takes pretty less time than applying same formulae in calc itself ! Other strategy I am following is :- > First disable "Autocalculate" from Data --> calculate --> Autocalculate > Do all data inputs in your sheets > Then once all data is in the place, do Data --> calculate --> Recalculate HARD OR press Shift+Ctrl+F9 > Now wait for considerable time ( from "Plant a coffee seed --- to ---> Have > coffee !" ) > Finally it gets over . -- So I will NOT say the basic issue is resolved and will not go with @Aron Budea to "Consider" it Done. -- You are receiving this mail because: You are the assignee for the bug.___ Libreoffice-bugs mailing list Libreoffice-bugs@lists.freedesktop.org https://lists.freedesktop.org/mailman/listinfo/libreoffice-bugs
[Libreoffice-bugs] [Bug 65046] Threaded calculation of formula groups (multi-threading)
https://bugs.documentfoundation.org/show_bug.cgi?id=65046 Aron Budea changed: What|Removed |Added OS|Linux (All) |All Status|NEW |RESOLVED Resolution|--- |WORKSFORME See Also|https://bugs.documentfounda | |tion.org/show_bug.cgi?id=11 | |4159| --- Comment #25 from Aron Budea --- Let's consider this done, the bug report isn't actionable, threaded calculation is already implemented (META is bug 114159), if someone has specific performance issues either compared to other applications, or related to cores not being sufficiently utilized (at least in case of Calc formula), consider opening a new bug report. -- You are receiving this mail because: You are the assignee for the bug.___ Libreoffice-bugs mailing list Libreoffice-bugs@lists.freedesktop.org https://lists.freedesktop.org/mailman/listinfo/libreoffice-bugs
[Libreoffice-bugs] [Bug 65046] Threaded calculation of formula groups (multi-threading)
https://bugs.documentfoundation.org/show_bug.cgi?id=65046 --- Comment #24 from fred...@free.fr --- I think the level of importance of this bug should be changed from "enhancement" to "major". Here is my rationale: - The bug has not been addressed in 8 years; worse: it has remained in status "NEW" for 8 years! - Nowadays, all the consumer-grade CPU vendors have split their CPUs' power in several slower cores rather than single faster ones. This makes Calc barely usable in a professional environment with heavy calculation loads. I do my best to push everyone towards open source software, with some success, but in the case of Calc, it's becoming ridiculous. In an environment where everybody has 8 core CPUs, my colleagues can launch heavy tasks (like 300,000 rows, each with a lookup in a 25,000 table) and have the result in about 20 minutes in Excel, while I have to wait 3 hours for the same thing (with LibreOffice 7 in Debian and the same hardware). I actually came to learn R just to avoid re-creating a Windows partition dedicated to Excel use on my computer. Therefore, I believe that to be an Excel challenger taken seriously in the multicore-friendly XXIst century, Calc not being able to make use of those multicore CPUs is a major bug. Note: Activating "Settings > Calc > Calculation > multi-thread" has no effect and enabling OpenCL is not persistent after LibreOffice required restart. -- You are receiving this mail because: You are the assignee for the bug.___ Libreoffice-bugs mailing list Libreoffice-bugs@lists.freedesktop.org https://lists.freedesktop.org/mailman/listinfo/libreoffice-bugs
[Libreoffice-bugs] [Bug 65046] Threaded calculation of formula groups (multi-threading)
https://bugs.documentfoundation.org/show_bug.cgi?id=65046 raal changed: What|Removed |Added CC||mahajan.dee...@jains.com --- Comment #23 from raal --- *** Bug 139355 has been marked as a duplicate of this bug. *** -- You are receiving this mail because: You are the assignee for the bug.___ Libreoffice-bugs mailing list Libreoffice-bugs@lists.freedesktop.org https://lists.freedesktop.org/mailman/listinfo/libreoffice-bugs
[Libreoffice-bugs] [Bug 65046] Threaded calculation of formula groups (multi-threading)
https://bugs.documentfoundation.org/show_bug.cgi?id=65046 --- Comment #22 from b. --- as of now and afaik there are two threaded options available, 'openCL' for LO in general, and 'calc - calculate - threaded calculation' for calc, thus 'WFM'? there is a fantastic speedup in opening the sample file with v. 7.1 compared to 6.1, even 'unparallelized', thus 'WFM'? be careful, both parallelizing options contributed to at least two 'hard to spot' bugs, tdf#132451, tdf#131340, tdf#129753, tdf#124577, tdf#103532 it's unclear if there are more ... 'un-duping' 98184 as it's a different request to have 'open file' 'non-blocking' (be able to do (interactive) work on other files during the wait time) than to speed up things - and open file - by parallelizing computations, besides: acc. to the sample file the bug is about draw, doe's draw have 'formula groups'? besides: graphic work -> inkscape and .svg, besides: export from draw to .svg is ... poor ... -- You are receiving this mail because: You are the assignee for the bug.___ Libreoffice-bugs mailing list Libreoffice-bugs@lists.freedesktop.org https://lists.freedesktop.org/mailman/listinfo/libreoffice-bugs
[Libreoffice-bugs] [Bug 65046] Threaded calculation of formula groups (multi-threading)
https://bugs.documentfoundation.org/show_bug.cgi?id=65046 Xisco Faulí changed: What|Removed |Added Priority|medium |high --- Comment #21 from Xisco Faulí --- Changing priority to 'high' since the number of duplicates is higher than 5 or the number of people in CC higher than 20 -- You are receiving this mail because: You are the assignee for the bug.___ Libreoffice-bugs mailing list Libreoffice-bugs@lists.freedesktop.org https://lists.freedesktop.org/mailman/listinfo/libreoffice-bugs
[Libreoffice-bugs] [Bug 65046] Threaded calculation of formula groups (multi-threading)
https://bugs.documentfoundation.org/show_bug.cgi?id=65046 Xisco Faulí changed: What|Removed |Added CC||dbir...@gmail.com --- Comment #20 from Xisco Faulí --- *** Bug 128396 has been marked as a duplicate of this bug. *** -- You are receiving this mail because: You are the assignee for the bug.___ Libreoffice-bugs mailing list Libreoffice-bugs@lists.freedesktop.org https://lists.freedesktop.org/mailman/listinfo/libreoffice-bugs
[Libreoffice-bugs] [Bug 65046] Threaded calculation of formula groups (multi-threading)
https://bugs.documentfoundation.org/show_bug.cgi?id=65046 --- Comment #19 from melutov...@gmail.com --- The summary was changed from 'libreoffice multithreading' to to 'Threaded calculation of formula groups (multi-threading)' However some of the bugs marked as a duplicate of this one fit better to the original summary. -- You are receiving this mail because: You are the assignee for the bug.___ Libreoffice-bugs mailing list Libreoffice-bugs@lists.freedesktop.org https://lists.freedesktop.org/mailman/listinfo/libreoffice-bugs
