Can I use MapReduce to run Nutch on a multi CPU system? I want to run the index job on two (or four) CPUs on a single system. I'm not trying to distribute the job over multiple systems.
If the MapReduce is the way to go, do I just specify config parameters like these: mapred.tasktracker.tasks.maxiumum=2 mapred.job.tracker=localhost:9001 mapred.reduce.tasks=2 (or 1?) and bin/start-all.sh ? Must I use NDFS for MapReduce? Do I need to do anything else to make sure that the two processes run on different CPUs? Is this the only way to take advantage of a multi CPU system? -kuro
