Re: Calc memory consumption
El 2021-01-22 08:18, Daniel Armando Rodriguez escribió: El 2021-01-21 17:35, Michael Meeks escribió: On 20/01/2021 10:29, Daniel A. Rodriguez wrote: Hi, exists some kind of formula to estimate how much RAM a spreadsheet could use? For instance 468K rows and columns from A to AG. Well, trying to do something with such file using an i3 based PC with 4Gb freezes the software completely. Both Tor and Noel are right; but I collect the 'shape' of pathological spreadsheets as a hobby =) Can you tell me: + what data-type is in each column + whether the column is sparse (ie, are there 'holes' in the data) + what formulae are used - and what their shape is ? + hopefully formulae are normally non-confidential Don't have access to the file so have asked + what file format you're using. XLSX, it's exported from the software the company use But of course, this really doesn't belong on the dev list, but in a bug if you have one ? Nope, just acting as an intermediate in this case In case nothing jumps out of the above data, possibly running a sampling profiler under Linux like 'perf' might show what's being slow, though I imagine it sounds like a memory issue (perhaps even a transient memory use) problem. Thanks ! =) Michael. About the file, it's just a log from month activity. No formulas involved. -- DAR ___ LibreOffice mailing list LibreOffice@lists.freedesktop.org https://lists.freedesktop.org/mailman/listinfo/libreoffice
Re: Calc memory consumption
Hi Daniel, I share Michael's hobby of collecting 'shapes' of pathological spreadsheets. Could you please ask someone with access to this interesting XLSX document to be so gentle to: 1. Validate the XLSX: https://archive.codeplex.com/?p=ooxmlvalidator (collect the results) 2. Anonymize the document, e.g. exchanging business data via https://github.com/Motorrat/anonyxel 3. Check if the problem still occurs being anonymized, otherwise please switch some relevant data back until it occurs (or remove sensitive data manually) ;-) 4. Attach the anonymized XSLX & prior validation results to an issue: https://wiki.documentfoundation.org/QA/BugReport Thanks in advance, Daniel. Svante Am Fr., 22. Jan. 2021 um 12:18 Uhr schrieb Daniel Armando Rodriguez < drodrig...@documentfoundation.org>: > El 2021-01-21 17:35, Michael Meeks escribió: > > On 20/01/2021 10:29, Daniel A. Rodriguez wrote: > Hi, exists some kind of formula to estimate how much RAM a > spreadsheet > could use? For instance 468K rows and columns from A to AG. > >> > >> Well, trying to do something with such file using an i3 based PC with > >> 4Gb freezes the software completely. > > > > Both Tor and Noel are right; but I collect the 'shape' of > pathological > > spreadsheets as a hobby =) > > > > Can you tell me: > > > > + what data-type is in each column > > + whether the column is sparse (ie, are > > there 'holes' in the data) > > + what formulae are used - and what their shape is ? > > + hopefully formulae are normally > > non-confidential > > Don't have access to the file so have asked > > > + what file format you're using. > > XLSX, it's exported from the software the company use > > > > > But of course, this really doesn't belong on the dev list, but in > a > > bug > > if you have one ? > > Nope, just acting as an intermediate in this case > > > In case nothing jumps out of the above data, possibly running a > > sampling profiler under Linux like 'perf' might show what's being slow, > > though I imagine it sounds like a memory issue (perhaps even a > > transient > > memory use) problem. > > > > Thanks ! =) > > > > Michael. > > -- > DAR > ___ > LibreOffice mailing list > LibreOffice@lists.freedesktop.org > https://lists.freedesktop.org/mailman/listinfo/libreoffice > ___ LibreOffice mailing list LibreOffice@lists.freedesktop.org https://lists.freedesktop.org/mailman/listinfo/libreoffice
Re: Calc memory consumption
El 2021-01-21 17:35, Michael Meeks escribió: On 20/01/2021 10:29, Daniel A. Rodriguez wrote: Hi, exists some kind of formula to estimate how much RAM a spreadsheet could use? For instance 468K rows and columns from A to AG. Well, trying to do something with such file using an i3 based PC with 4Gb freezes the software completely. Both Tor and Noel are right; but I collect the 'shape' of pathological spreadsheets as a hobby =) Can you tell me: + what data-type is in each column + whether the column is sparse (ie, are there 'holes' in the data) + what formulae are used - and what their shape is ? + hopefully formulae are normally non-confidential Don't have access to the file so have asked + what file format you're using. XLSX, it's exported from the software the company use But of course, this really doesn't belong on the dev list, but in a bug if you have one ? Nope, just acting as an intermediate in this case In case nothing jumps out of the above data, possibly running a sampling profiler under Linux like 'perf' might show what's being slow, though I imagine it sounds like a memory issue (perhaps even a transient memory use) problem. Thanks ! =) Michael. -- DAR ___ LibreOffice mailing list LibreOffice@lists.freedesktop.org https://lists.freedesktop.org/mailman/listinfo/libreoffice
Re: Calc memory consumption
On 20/01/2021 10:29, Daniel A. Rodriguez wrote: >>> Hi, exists some kind of formula to estimate how much RAM a spreadsheet >>> could use? For instance 468K rows and columns from A to AG. > > Well, trying to do something with such file using an i3 based PC with > 4Gb freezes the software completely. Both Tor and Noel are right; but I collect the 'shape' of pathological spreadsheets as a hobby =) Can you tell me: + what data-type is in each column + whether the column is sparse (ie, are there 'holes' in the data) + what formulae are used - and what their shape is ? + hopefully formulae are normally non-confidential + what file format you're using. But of course, this really doesn't belong on the dev list, but in a bug if you have one ? In case nothing jumps out of the above data, possibly running a sampling profiler under Linux like 'perf' might show what's being slow, though I imagine it sounds like a memory issue (perhaps even a transient memory use) problem. Thanks ! =) Michael. -- michael.me...@collabora.com <><, GM Collabora Productivity Hangout: mejme...@gmail.com, Skype: mmeeks (M) +44 7795 666 147 - timezone usually UK / Europe ___ LibreOffice mailing list LibreOffice@lists.freedesktop.org https://lists.freedesktop.org/mailman/listinfo/libreoffice
Re: Calc memory consumption
20 ene. 2021 02:56:24 Tor Lillqvist : >> >> Hi, exists some kind of formula to estimate how much RAM a spreadsheet could >> use? For instance 468K rows and columns from A to AG. > > Why do you need to know? And why is the amount of RAM interesting and not the > amount of virtual memory required? > > --tml > Well, trying to do something with such file using an i3 based PC with 4Gb freezes the software completely. However, an i7 with 16Gb handles it well. The idea is to find a common ground in between to prevent with hardware. ___ LibreOffice mailing list LibreOffice@lists.freedesktop.org https://lists.freedesktop.org/mailman/listinfo/libreoffice
Re: Calc memory consumption
Well, trying to do something with such file using an i3 based PC with 4Gb freezes the software completely. However, an i7 with 16Gb handles it well. The idea is to find a common ground in between to prevent with hardware. El mié., 20 de enero de 2021 02:56, Tor Lillqvist escribió: > >> Hi, exists some kind of formula to estimate how much RAM a spreadsheet >> could use? For instance 468K rows and columns from A to AG. >> > > Why do you need to know? And why is the amount of RAM interesting and not > the amount of virtual memory required? > > --tml > > ___ LibreOffice mailing list LibreOffice@lists.freedesktop.org https://lists.freedesktop.org/mailman/listinfo/libreoffice
Re: Calc memory consumption
On 2021/01/20 1:56 am, Daniel A. Rodriguez wrote: Hi, exists some kind of formula to estimate how much RAM a spreadsheet could use? For instance 468K rows and columns from A to AG. Calc uses a kind of compression for columns (when there is repeating data), and it depends heavily on what kind of data it is, so no, not really. ___ LibreOffice mailing list LibreOffice@lists.freedesktop.org https://lists.freedesktop.org/mailman/listinfo/libreoffice
Re: Calc memory consumption
> > > Hi, exists some kind of formula to estimate how much RAM a spreadsheet > could use? For instance 468K rows and columns from A to AG. > Why do you need to know? And why is the amount of RAM interesting and not the amount of virtual memory required? --tml ___ LibreOffice mailing list LibreOffice@lists.freedesktop.org https://lists.freedesktop.org/mailman/listinfo/libreoffice
Calc memory consumption
Hi, exists some kind of formula to estimate how much RAM a spreadsheet could use? For instance 468K rows and columns from A to AG. ___ LibreOffice mailing list LibreOffice@lists.freedesktop.org https://lists.freedesktop.org/mailman/listinfo/libreoffice
