Hi Lewis, >You are not getting very many URLs! Should i increase the fetcher.server.delay from 2 to 5 seconds? I did not get what you meant by it?
I want somewhat around equal number of urls in the fetchlist from all domain so that i can fetch more number of urls at a time lewis john mcgibbney wrote > You are not getting very many URLs! > > On Tue, Jan 29, 2013 at 8:29 PM, peterbarretto < > peterbarretto08@ > >wrote: > >> >> 2013-01-29 08:44:35,014 INFO crawl.CrawlDbReader - TOTAL urls: 96404 >> >> 2013-01-29 08:44:35,018 INFO crawl.CrawlDbReader - status 1 >> (db_unfetched): >> 85672 >> -- View this message in context: http://lucene.472066.n3.nabble.com/increase-the-number-of-fetches-at-agiven-time-on-nutch-1-6-or-2-1-tp4036499p4037612.html Sent from the Nutch - User mailing list archive at Nabble.com.
