On Jan 25, 2009, at 2:02 PM, nitesh bhatia wrote:
Apple provides opensource discovery service called Bonjour (zeroconf).
I don't know enough about Zeroconf to be able to answer definitively,
but I suspect the hardest bit would be figuring out the approach. Of
course Hadoop has to continue to work on other platforms, so cross-
platform strategies are better.
Presently for setting up multi-node cluster we need to add IPs
manually.
To the slaves list? The slaves list is only used to ssh to the hosts.
At Yahoo, we use a parallel ssh perl script that takes ranges of
hosts, so you issue commands like:
allssh -h node1000-3000 bin/hadoop-daemon.sh start tasktracker
and it will use ssh in parallel to connect to every node between
node1000 and node3000. Our's is a mess, but it would be great if
someone contributed a script like that. *smile*
-- Owen
