Hi,
I'm using Nutch-1.2 and having Aborting with 10 hung threads for some
sites.
I checked this thread
http://www.mail-archive.com/nutch-user@lucene.apache.org/msg15889.html and
the JIRA issue https://issues.apache.org/jira/browse/NUTCH-719
In Fetcher.java, I did the following change:
-
Hi Remi,
if this error only occurs for some sites it may be the case that
these sites are hosting large documents and serving them slowly.
If you do not limit the document size by http.content.limit
you may have a look at:
https://issues.apache.org/jira/browse/NUTCH-1182
and the properties
2 matches
Mail list logo