You should make changes to your nutch-site.xml really. Values in nutch-site.xml override values in nutch-default.xml.
Yes, increasing the delay will affect the speed of fetching, if you are trying to fetch pages from the same host. If you are fetching from a lot of different hosts, then the effect will be smaller. Otis --- "Feng (Michael) Ji" <[EMAIL PROTECTED]> wrote: > Hi there: > > I checked log file, found some site link met error > as"Exceeded http.max.delays: retry later" > > I change the corresponding value in conf file, > nutch-default.xml, I changed it to 300, seems still > not enough. Will that affect performance of crawling? > > Any idea? > > thanks, > > Michael > > __________________________________________________ > Do You Yahoo!? > Tired of spam? Yahoo! Mail has the best spam protection around > http://mail.yahoo.com > > > ------------------------------------------------------- > SF.Net email is Sponsored by the Better Software Conference & EXPO > September > 19-22, 2005 * San Francisco, CA * Development Lifecycle Practices > Agile & Plan-Driven Development * Managing Projects & Teams * Testing > & QA > Security * Process Improvement & Measurement * > http://www.sqe.com/bsce5sf > _______________________________________________ > Nutch-general mailing list > [email protected] > https://lists.sourceforge.net/lists/listinfo/nutch-general > ------------------------------------------------------- SF.Net email is Sponsored by the Better Software Conference & EXPO September 19-22, 2005 * San Francisco, CA * Development Lifecycle Practices Agile & Plan-Driven Development * Managing Projects & Teams * Testing & QA Security * Process Improvement & Measurement * http://www.sqe.com/bsce5sf _______________________________________________ Nutch-general mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nutch-general
