[
https://issues.apache.org/jira/browse/SLIDER-90?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14003132#comment-14003132
]
Steve Loughran commented on SLIDER-90:
--------------------------------------
from josh, feb 2014
I tried to test Slider on an Ambari-installed hadoop instance and kept getting
an UnknownHostException when using the nameservice as the host in the HDFS URI.
For my installation, I have a nameservice of "isty" and two namenodes (istymst
and istydn1).
It appears if I include hdfs-site.xml on Hoya's classpath (really just
$HADOOP_CONF_DIR), appears to clean things up as it gets added to the
Configuration and then NameNodeProxies correctly creates the correct class.
Alternatively, I could also make things work by including all of the HA
configuration params into {[slider-client.xml}}
{code}
<property>
<name>dfs.client.failover.proxy.provider.isty</name>
<value>org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider</value>
</property>
<property>
<name>dfs.namenode.rpc-address.isty.nn2</name>
<value>istydn1.ctolab.hortonworks.com:8020</value>
</property>
<property>
<name>dfs.namenode.rpc-address.isty.nn1</name>
<value>istymst.ctolab.hortonworks.com:8020</value>
</property>
<property>
<name>dfs.nameservices</name>
<value>isty</value>
</property>
<property>
<name>dfs.ha.namenodes.isty</name>
<value>nn1,nn2</value>
</property>
{code}
I'm presently leaning towards including HADOOP_CONF_DIR (and checking expected
dirs based on HADOOP_HOME/HADOOP_PREFIX) is the cleanest. If we can't ascertain
it on our own, we can at least print a warning and let things progress as
normal (as it won't affect the non-HA NN users).
> Slider to work on HA NNs
> ------------------------
>
> Key: SLIDER-90
> URL: https://issues.apache.org/jira/browse/SLIDER-90
> Project: Slider
> Issue Type: Sub-task
> Components: appmaster
> Reporter: Josh Elser
>
> Reported {{UnknownHostException}} when using the nameservice as the host in
> the HDFS URI.
> -likely cause failure to pass down all DFS info and/or failure to pick up
> config from local installation
--
This message was sent by Atlassian JIRA
(v6.2#6252)