Paul van Brouwershaven wrote:
I had mapred.map.tasks on 2 and on 4 and 8
I had mapred.reduce.tasks on 1 2 and 3
But always I have the same rsult
Name Host # running tasks Secs since heartbeat
tracker_29414 srv34 0 1
tracker_36968 srv21 1 2
Where are you setting mapred.map.tasks? It should be set in
mapred-default.xml used when starting the tasktracker. You must restart
the task trackers for this setting to take effect:
bin/nutch-daemons.sh stop tasktracker
bin/nutch-daemons.sh start tasktracker
(I assume your ~/.slaves file contains srv34 and srv21.)
Note that nutch-daemons.sh assumes that /etc/ssh/sshd_config has
'AcceptEnv yes'. Its also useful, if your hosts don't share the nutch
installation via NFS, to set NUTCH_MASTER with something like:
export NUTCH_MASTER=srv21:/home/USER/src/nutch
This will cause daemons to sync the latest config and code from the
master each time they're restarted.
I'm working on documenting this stuff better...
Doug
