Re: Nutch crawl failure

http://wiki.apache.org/nutch/FAQ#How_can_I_recover_an_aborted_fetch_process.3F On Thursday 02 September 2010 11:25:51 Nayanish Hinge wrote: > Hi, > I have a doubt, not sure if anybody has already thought about it > What if nutch crawler fails during its crawling cycles, could we restart > the cra

Nutch crawl failure

Hi, I have a doubt, not sure if anybody has already thought about it What if nutch crawler fails during its crawling cycles, could we restart the crawling right from where we left? I mean, starting with only the unfetched urls. Thanks -- Nayanish Hyderabad