Thanks for the offer, Andrew! The original file is definitely bigger than the allowable limit. However, when I originally tried to import it, it opened up the first third of the file and allowed me to save it, and reopen it. However, when I tried to save it a second time, it crashed and the file was corrupted.
I am pretty sure the problem is not that I am running out of memory. I have 24 gig on a 64-bit machine. I think the program is just buggy when you try to run it at its absolute outside capacity limit. So I have figured out how to open my file in R and save subsets small enough to open more reliably. I wish the program checked for file size and offered a sensible list of options when it is too big, like opening the first N rows, or opening n rows after skipping m rows, or opening a taking a p percent sample of rows. But perhaps that is too much to hope for in a spreadsheet. And thanks again for your thought and attention. Warmest regards, Andrew On Fri, Apr 4, 2014 at 10:44 PM, Andrew Douglas Pitonyak [via Document Foundation Mail Archive] <ml-node+s969070n410416...@n3.nabble.com> wrote: > On 04/04/2014 07:44 PM, andrewH wrote: > > > I am working with a data set that keeps causing my LibreOffice to > freeze. I > > am pretty sure that this is only because it is big. It is a > pipe-separated > > text from the US Economic Census imported into Calc, about 30 columns > and > > around a million rows. (The actual data set is bigger, but Calc quits at > a > > million-odd. The complete file is about 0.8 gig.) I suspect but can not > > prove that this is related to file handling somehow, e.g. breaking down > > during auto-saving. The first time I saved the data as a Calc file it > took > > nearly an hour with the "soffice.bin *32" process running at 25 percent > of > > CPU time and using about 825 meg of memory the entire time. (Not sure > why > > this is showing up as a 32-bit version). And when Calc freezes, all the > > LibreOffice programs freeze. So I can't just switch to another file and > > noodle away while waiting. > > It looks to me as though Calc cannot handle more than 1048576 rows of > data, > > Do you have more rows than that? If yes, then I think that you cannot > open the file. > > If you have less than that, and, if you think that you are simply > running out of memory.... if you can figure out how to get the data to > me, I can run a test on a 64 bit version (running on Linux). My machine > has 32 GB of RAM... > > > -- > Andrew Pitonyak > My Macro Document: http://www.pitonyak.org/AndrewMacro.odt > Info: http://www.pitonyak.org/oo.php > > > -- > To unsubscribe e-mail to: [hidden > email]<http://user/SendEmail.jtp?type=node&node=4104166&i=0> > Problems? > http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/ > Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette > List archive: http://listarchives.libreoffice.org/global/users/ > All messages sent to this list will be publicly archived and cannot be > deleted > > > > ------------------------------ > If you reply to this email, your message will be added to the discussion > below: > > http://nabble.documentfoundation.org/Intentionally-crashing-LibreOffice-when-frozen-LibreOffice-will-not-start-tp4104156p4104166.html > To unsubscribe from Intentionally crashing LibreOffice when > frozen/LibreOffice will not start., click > here<http://nabble.documentfoundation.org/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=4104156&code=YWhvZXJuZXJAcnByb2dyZXNzLm9yZ3w0MTA0MTU2fC0yMDQ3NjI1NDM5> > . > NAML<http://nabble.documentfoundation.org/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml> > -- J. Andrew Hoerner Director, Sustainable Economics Program Redefining Progress (510) 507-4820 -- View this message in context: http://nabble.documentfoundation.org/Intentionally-crashing-LibreOffice-when-frozen-LibreOffice-will-not-start-tp4104156p4105609.html Sent from the Users mailing list archive at Nabble.com. -- To unsubscribe e-mail to: users+unsubscr...@global.libreoffice.org Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/ Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette List archive: http://listarchives.libreoffice.org/global/users/ All messages sent to this list will be publicly archived and cannot be deleted
