Re: OutOfMemory Exception in parsing

2009-02-25 Thread Kenneth Berland
. Regards, Bartosz -- View this message in context: http://www.nabble.com/OutOfMemory-Exception-in-parsing-tp22178719p22196803.html Sent from the Nutch - User mailing list archive at Nabble.com.

Re: OutOfMemory Exception in parsing

2009-02-25 Thread Julien Nioche
setting in bin/nutch script is 1000 MB. Kind regards, Martina -Ursprüngliche Nachricht- Von: manavr [mailto:manavra...@gmail.com] Gesendet: Mittwoch, 25. Februar 2009 06:56 An: nutch-user@lucene.apache.org Betreff: Re: OutOfMemory Exception in parsing Hi, I tried parsing

OutOfMemory Exception in parsing

2009-02-24 Thread manavr
? Is there a patch available or am I missing something. Thanks, Manav -- View this message in context: http://www.nabble.com/OutOfMemory-Exception-in-parsing-tp22178719p22178719.html Sent from the Nutch - User mailing list archive at Nabble.com.

Re: OutOfMemory Exception in parsing

2009-02-24 Thread Bartosz Gadzimski
manavr pisze: Hi, I have a set of 1,00,000 urls that I am trying to crawl and index. I have heap memory size for child tasktrackers set to 512MB. I have disabled pdf and doc parsing currently. I am running this on Nutch-0.8 with 1 RHEL node with depth to set to 1. I get this

Re: OutOfMemory Exception in parsing

2009-02-24 Thread manavr
. Thanks, Manav On website you have version 0.9 and in trunk (nightly builds) almost 1.0 (it's very stable). Download it and try. Regards, Bartosz -- View this message in context: http://www.nabble.com/OutOfMemory-Exception-in-parsing-tp22178719p22196803.html Sent from the Nutch

AW: OutOfMemory Exception in parsing

2009-02-24 Thread Koch Martina
: Mittwoch, 25. Februar 2009 06:56 An: nutch-user@lucene.apache.org Betreff: Re: OutOfMemory Exception in parsing Hi, I tried parsing of 1,00,000 urls with the trunk version of Nutch. However, I still get the same error OutOfMemory Exception for Java Heap space. Any ideas how to get past this error