hi folks,
i'm trying to get the latest hadoop (1.0.2) deployed into aws. simply
setting "whirr.hadoop.version" *almost* does the trick.
however there now seems to be a different strategy to determine which
interface to bind to. hadoop is failing because trying to bind to its
external IP address ... which of course in AWS is not known at the
machine itself. see log below [2].
i'll poke around, there's probably a config parameter to tweak, but i
wondered if anyone had the solution at their fingertips. :)
if not, i'll report back.
btw my motivation for 1.0.2 is the hadoop-client dependency item [1]
which cuts the wars size by more than half. nice!
--a
[1] https://issues.apache.org/jira/browse/HADOOP-8009
[2] log:
2012-05-08 15:22:41,357 INFO org.apache.hadoop.mapred.JobTracker:
STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting JobTracker
STARTUP_MSG: host =
ip-10-58-231-212.eu-west-1.compute.internal/10.58.231.212
STARTUP_MSG: args = []
STARTUP_MSG: version = 1.0.2
STARTUP_MSG: build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0.2 -r
1304954; compiled by 'hortonfo' on Sat Mar 24 23:58:21 UTC 2012
************************************************************/
// ~15 lines removed
2012-05-08 15:22:41,916 FATAL org.apache.hadoop.mapred.JobTracker:
java.net.BindException: Problem binding to /79.125.41.39:8021 : Cannot
assign requested address