Hi all,

I am having trouble running the hello-samza example (
http://samza.apache.org/learn/tutorials/0.10/run-in-multi-node-yarn.html)
on our HDP cluster, which is set up with Ambari.

Upon running

*deploy/samza/bin/run-job.sh
--config-factory=org.apache.samza.config.factories.PropertiesConfigFactory
--config-path=file://$PWD/deploy/samza/config/wikipedia-feed.properties*


The output shows that Samza keeps trying to reach YARN's
ResourceManager at *0.0.0.0:8032
<http://0.0.0.0:8032>* but can't.

*2016-02-25 01:28:00 ClientHelper [INFO] trying to connect to RM
0.0.0.0:8032 <http://0.0.0.0:8032>*
*2016-02-25 01:28:00 RMProxy [INFO] Connecting to ResourceManager at
/0.0.0.0:8032 <http://0.0.0.0:8032>*
*2016-02-25 01:28:00 NativeCodeLoader [WARN] Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable*
*2016-02-25 01:28:02 Client [INFO] Retrying connect to server:
0.0.0.0/0.0.0.0:8032 <http://0.0.0.0/0.0.0.0:8032>. Already tried 0
time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10,
sleepTime=1000 MILLISECONDS)*
*2016-02-25 01:28:03 Client [INFO] Retrying connect to server:
0.0.0.0/0.0.0.0:8032 <http://0.0.0.0/0.0.0.0:8032>. Already tried 1
time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10,
sleepTime=1000 MILLISECONDS)*
*2016-02-25 01:28:04 Client [INFO] Retrying connect to server:
0.0.0.0/0.0.0.0:8032 <http://0.0.0.0/0.0.0.0:8032>. Already tried 2
time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10,
sleepTime=1000 MILLISECONDS)*


For our cluster ResourceManager is running on *node2*. Here are the
properties related to the ResourceManager address in *yarn-site.xml *(which
was generated by Ambari) on the machine I am running hello-samza:

*<property>*
*  <name>yarn.resourcemanager.address</name>*
*  <value>node02:8050</value>*
*</property>*
*<property>*
*  <name>yarn.resourcemanager.admin.address</name>*
*  <value>node02:8141</value>*
*</property>*
*<property>*
*  <name>yarn.resourcemanager.bind-host</name>*
*  <value>0.0.0.0</value>*
*</property>*
*<property>*
*  <name>yarn.resourcemanager.resource-tracker.address</name>*
*  <value>node02:8025</value>*
*</property>*
*<property>*
*  <name>yarn.resourcemanager.scheduler.address</name>*
*  <value>node02:8030</value>*
*</property>*
*<property>*
*  <name>yarn.resourcemanager.webapp.https.address</name>*
*  <value>node02:8090</value>*
*</property>*
*<property>*
*  <name>yarn.resourcemanager.webapp.address</name>*
*  <value>node02:8088</value>*
*</property>*
*<property>*
*  <name>yarn.resourcemanager.hostname</name>*
*  <value>node02</value>*
*</property>*
*<property>*
*  <name>yarn.resourcemanager.zk-address</name>*
*  <value>node03:2181,node01:2181,node02:2181</value>*
*</property>*


I can't find any other place that specifies ResourceManager address. Can
anyone help?


Thanks,

Jack Huang

Reply via email to