Hi All,

Can I increase the number of reducer in UpdateHostDB step? Currently it is 
running with 1 reducer.
Will it impact the crawling in any way?

Current command in crawl script:
__bin_nutch updatehostdb -crawldb "$CRAWL_PATH"/crawldb -hostdb 
"$CRAWL_PATH"/hostdb

Can I update it to:
__bin_nutch updatehostdb -D mapreduce.job.reduces=32 -crawldb 
"$CRAWL_PATH"/crawldb -hostdb "$CRAWL_PATH"/hostdb

Thanks it advance.

Regards,
Suraj Singh

Reply via email to