i think the greatest failure was, that there always was a retry later error... im not sure
Try decreasing the number of fetcher threads to be no more than the number of hosts that you are crawling. When multiple threads try to crawl a single host then they collide and retry. After a certain number of retries (http.max.delays) the fetcher will give up and report this error. So you should also increase http.max.delays.
Doug
-------------------------------------------------------
SF email is sponsored by - The IT Product Guide
Read honest & candid reviews on hundreds of IT Products from real users.
Discover which products truly live up to the hype. Start reading now. http://productguide.itmanagersjournal.com/
_______________________________________________
Nutch-developers mailing list
[EMAIL PROTECTED]
https://lists.sourceforge.net/lists/listinfo/nutch-developers
