hey brian, i will try to generate a smaller set in the next days in case i do not succeed with splitting up the data.
cheers, andreas On Mon, Sep 28, 2009 at 5:14 PM, Brian Pratt <[email protected]>wrote: > oops, typo > ftp://insilicos.serveftp.net/pub > > On Mon, Sep 28, 2009 at 8:13 AM, Brian Pratt <[email protected]>wrote: > >> I'd be happy to look at a much smaller but otherwise similar data set for >> any clues - you can send to ftp://insilics.serveftp.net/pub >> >> Brian >> >> On Mon, Sep 28, 2009 at 8:08 AM, Andreas Quandt < >> [email protected]> wrote: >> >>> hi matt, >>> >>> this was also my first thought but the memory usage was at about 8 GB of >>> 48GB which are available on that system.... >>> >>> >>> cheers, >>> andreas >>> >>> On Mon, Sep 28, 2009 at 4:55 PM, Matthew Chambers < >>> [email protected]> wrote: >>> >>>> >>>> HI Andreas, >>>> >>>> It sounds like it used up all the system memory and started thrashing >>>> the disk (constantly paging things in and out to the swap file) which >>>> slows down any operation tremendously. Quite possibly the parser wasn't >>>> designed for files that big (maybe it's storing something internally >>>> that's taking up too much space?). >>>> >>>> -Matt >>>> >>>> >>>> Andreas Quandt wrote: >>>> > dear list, >>>> > >>>> > i tried to convert a mscot dat file of > 7gb and it took several days. >>>> > hence, i would like to ask if any of you knows how to speed this up? >>>> > >>>> > cheers, >>>> > andreas >>>> >>>> >>>> >>> >>> >>> --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "spctools-discuss" group. To post to this group, send email to [email protected] To unsubscribe from this group, send email to [email protected] For more options, visit this group at http://groups.google.com/group/spctools-discuss?hl=en -~----------~----~----~----~------~----~------~--~---
