Hi, I am using Nutch-0.9.
We setup a machine with two processors. For fetching two processors are being used well. But for segment merging it is utilizing only one processor the other processor is idle. For two processors utilization, below is the line added to nutch-sites.xml file. mapred.map.tasks=2 42 sites crawling is taking ~3 hours. Please let me know if crawling time can be reduced as less as possible. If so, how to reduce the crawling time. Thanks in advance. Regards, Anuradha -- View this message in context: http://www.nabble.com/How-to-reduce-recrawling-time-tf4696211.html#a13423905 Sent from the Nutch - User mailing list archive at Nabble.com.
