Dear Tom -- Thanks for your attention to my problem. I believe the problem with using Calc as a viewer is that I have 3.6 million lines of data. But I am getting more comfortable with using R itself to answer these questions. I think part of my problem is that it is the nature of of legal training to try to andticipate every possible problem. But when the number of possible problems exceeds a certain level, my brain runs out of working memory even if my computer still has RAM. Also, I set ambitious goals for allowing people to run my software on ordinary laptops a year or three old. I have to say that since I have scaled those back and got 24 gig of RAM instead, many problems seem more manageable, even without a database.
Peace, Andrew On Fri, Apr 18, 2014 at 6:39 AM, TomD [via Document Foundation Mail Archive] <[email protected]> wrote: > Hi :) > Ahh, Base seems to be better when the data is held externally. Postgresql > should be an excellent choice for holding the data and then 'just' get > Base > to connect to it. > > I would have thought Calc would then be really good at displaying the > data?! So i'm not sure what the problem is now. Hopefully someone better > with databases might be more helpful! Errr, most people on this mailing > list seem to be better with databases than me! > Good luck and regards from > Tom :) > > > > > > On 17 April 2014 22:56, andrewH <[hidden > email]<http://user/SendEmail.jtp?type=node&node=4105676&i=0>> > wrote: > > > Thanks Tom! > > > > Gnumeric is a great product and I have used it before. I was hoping to > use > > Calc in this case because I am trying to learn to use the LO database, > > Base, as a stand-alone or a front end for PostgreSQL. But I find it very > > hard to define, use, and even just to import a file into a database if I > > can not first look at it and determine how missing variables are coded, > > which fields are character and which are numeric, etc. Some census > products > > are really good at giving users this kind of metadata, others not so > much. > > (The Economic Census metadata is hard enough to read and understand > (would > > you put material intended to explain something to the public in > > pipe-delimited text?) that I have written to them asking for meta-meta > > data). So I wanted to use Calc for exploration and base to do the heavy > > lifting, in the hope that things might be easier if I stayed withing one > > document family. Now I am thinking that some other approach will be > easier. > > > > Warmest regards, Andrew > > > > > > On Sat, Apr 5, 2014 at 2:09 AM, TomD [via Document Foundation Mail > Archive] > > <[hidden email] <http://user/SendEmail.jtp?type=node&node=4105676&i=1>> > wrote: > > > > > Hi :) > > > Try Gnumeric; > > > http://www.gnumeric.org/download.html > > > > > > It's a dedicated spreadsheet program with a tiny footprint that uses > > > minimal resources, so it's faster, lighter and more robust than Excel > > > or Calc. Many people find Gnumeric to be better than Calc or Excel > > > for serious or hefty spreadsheets and/or for handling many more > > > spreadsheets in a shorter time-frame. > > > > > > It can be installed alongside LibreOffice and/or MS Office. It uses > > > the same format as LibreOffice natively so most spreadsheets can be > > > bounced between the 2 programs quite happily. > > > > > > Part of the advantage of LibreOffice is that it fits well into a wider > > > eco-system and co-operates well with a wider range of programs and > > > suites allowing you to tailor individual machines to specific > > > use-cases and yet still retain the ability to share files between > > > different machines and different people using different OSes and > > > programs. > > > > > > Regards from > > > Tom ) > > > > > > > > > > > > > > > On 5 April 2014 06:43, Andrew Douglas Pitonyak <[hidden email]< > > http://user/SendEmail.jtp?type=node&node=4104190&i=0>> > > > wrote: > > > > > > > On 04/04/2014 07:44 PM, andrewH wrote: > > > >> > > > >> I am working with a data set that keeps causing my LibreOffice to > > > freeze. > > > >> I > > > >> am pretty sure that this is only because it is big. It is a > > > pipe-separated > > > >> text from the US Economic Census imported into Calc, about 30 > columns > > > and > > > >> around a million rows. (The actual data set is bigger, but Calc > quits > > > at a > > > >> million-odd. The complete file is about 0.8 gig.) I suspect but can > > not > > > >> prove that this is related to file handling somehow, e.g. breaking > > down > > > >> during auto-saving. The first time I saved the data as a Calc file > it > > > took > > > >> nearly an hour with the "soffice.bin *32" process running at 25 > > percent > > > of > > > >> CPU time and using about 825 meg of memory the entire time. (Not > sure > > > why > > > >> this is showing up as a 32-bit version). And when Calc freezes, > all > > > the > > > >> LibreOffice programs freeze. So I can't just switch to another file > > and > > > >> noodle away while waiting. > > > > > > > > > > > > It looks to me as though Calc cannot handle more than 1048576 rows > of > > > data, > > > > > > > > Do you have more rows than that? If yes, then I think that you > cannot > > > open > > > > the file. > > > > > > > > If you have less than that, and, if you think that you are simply > > > running > > > > out of memory.... if you can figure out how to get the data to me, I > > can > > > run > > > > a test on a 64 bit version (running on Linux). My machine has 32 GB > of > > > > RAM... > > > > > > > > > > > > -- > > > > Andrew Pitonyak > > > > My Macro Document: http://www.pitonyak.org/AndrewMacro.odt > > > > Info: http://www.pitonyak.org/oo.php > > > > > > > > > > > > > > > > -- > > > > To unsubscribe e-mail to: [hidden email]< > > http://user/SendEmail.jtp?type=node&node=4104190&i=1> > > > > Problems? > > > > > http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/ > > > > Posting guidelines + more: > > http://wiki.documentfoundation.org/Netiquette > > > > List archive: http://listarchives.libreoffice.org/global/users/ > > > > All messages sent to this list will be publicly archived and cannot > be > > > > deleted > > > > > > > > > > -- > > > To unsubscribe e-mail to: [hidden email]< > > http://user/SendEmail.jtp?type=node&node=4104190&i=2> > > > Problems? > > > http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/ > > > Posting guidelines + more: > http://wiki.documentfoundation.org/Netiquette > > > List archive: http://listarchives.libreoffice.org/global/users/ > > > All messages sent to this list will be publicly archived and cannot be > > > deleted > > > > > > > > > > > > ------------------------------ > > > If you reply to this email, your message will be added to the > discussion > > > below: > > > > > > > > > http://nabble.documentfoundation.org/Intentionally-crashing-LibreOffice-when-frozen-LibreOffice-will-not-start-tp4104156p4104190.html > > > To unsubscribe from Intentionally crashing LibreOffice when > > > frozen/LibreOffice will not start., click here< > > > > > > > . > > > NAML< > > > http://nabble.documentfoundation.org/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml > > > > > > > > > > > > > > > -- > > J. Andrew Hoerner > > Director, Sustainable Economics Program > > Redefining Progress > > (510) 507-4820 > > > > > > > > > > -- > > View this message in context: > > > http://nabble.documentfoundation.org/Intentionally-crashing-LibreOffice-when-frozen-LibreOffice-will-not-start-tp4104156p4105610.html > > Sent from the Users mailing list archive at Nabble.com. > > -- > > To unsubscribe e-mail to: [hidden > > email]<http://user/SendEmail.jtp?type=node&node=4105676&i=2> > > Problems? > > http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/ > > Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette > > List archive: http://listarchives.libreoffice.org/global/users/ > > All messages sent to this list will be publicly archived and cannot be > > deleted > > > > > > -- > To unsubscribe e-mail to: [hidden > email]<http://user/SendEmail.jtp?type=node&node=4105676&i=3> > Problems? > http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/ > Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette > List archive: http://listarchives.libreoffice.org/global/users/ > All messages sent to this list will be publicly archived and cannot be > deleted > > > ------------------------------ > If you reply to this email, your message will be added to the discussion > below: > > http://nabble.documentfoundation.org/Intentionally-crashing-LibreOffice-when-frozen-LibreOffice-will-not-start-tp4104156p4105676.html > To unsubscribe from Intentionally crashing LibreOffice when > frozen/LibreOffice will not start., click > here<http://nabble.documentfoundation.org/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=4104156&code=YWhvZXJuZXJAcnByb2dyZXNzLm9yZ3w0MTA0MTU2fC0yMDQ3NjI1NDM5> > . > NAML<http://nabble.documentfoundation.org/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml> > -- J. Andrew Hoerner Director, Sustainable Economics Program Redefining Progress (510) 507-4820 -- View this message in context: http://nabble.documentfoundation.org/Intentionally-crashing-LibreOffice-when-frozen-LibreOffice-will-not-start-tp4104156p4107071.html Sent from the Users mailing list archive at Nabble.com. -- To unsubscribe e-mail to: [email protected] Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/ Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette List archive: http://listarchives.libreoffice.org/global/users/ All messages sent to this list will be publicly archived and cannot be deleted
