Lukas Vlcek wrote:
050913 113818 fetching http://xxxx_some_page_xxxx.html
org.apache.nutch.protocol.RetryLater: Exceeded http.max.delays: retry later.

This page will be retried the next time the fetcher is run.

This message means that this thread has waited http.max.delays times for fetcher.server.delay seconds, and each time it found that another thread was already accessing a page at this site. To avoid these, increase http.max.delays to a larger number, or, if you're crawling only servers that you control, set fetcher.threads.per.host to something greater than one (making the fetcher faster, but impolite).

Doug

Reply via email to