Tomislav Poljak wrote:
Hi Andrtzej,
I am running fetcher in non-parsing mode, I have this in nutch-site.xml:
<property>
<name>fetcher.parse</name>
<value>false</value>
<description>If true, fetcher will parse content.</description>
</property>
Maybe I didn't post a question correctly. I get a couple of fetcher
threads failing with java.lang.OutOfMemoryError like this (from
hadoop.log):
2007-09-09 01:07:24,150 INFO fetcher.Fetcher - fetching
http://scholar.google.com/intl/en/scholar/libraries.html
2007-09-09 01:07:27,084 INFO fetcher.Fetcher - fetch of
Sure looks strange to me. And you are sure that your Java heap size is
set to the right amount? You didn't lose any 'm or 'g suffix in -Xmx ?
;) just checking ...
--
Best regards,
Andrzej Bialecki <><
___. ___ ___ ___ _ _ __________________________________
[__ || __|__/|__||\/| Information Retrieval, Semantic Web
___|||__|| \| || | Embedded Unix, System Integration
http://www.sigram.com Contact: info at sigram dot com
