Curious to know whether Nutch AdaptiveFetchSchedule can do recrawling automatically?
I observed Hadoop automatically reinitiates the interrupted Jobs. Otherwise Hadoop is always up and running with Nutch jobs configured to it. In this scenario if a page is ready to be crawled based on adaptive schedule, whether Nutch will recrawl the page? Also I like to know the best approach for continuous crawling for live environment. Thanks, Raja -- View this message in context: http://lucene.472066.n3.nabble.com/Whether-Nutch-AdaptiveFetchSchedule-can-do-recrawling-automatically-tp4056979.html Sent from the Nutch - User mailing list archive at Nabble.com.
