[ 
https://issues.apache.org/jira/browse/SLIDER-90?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14003132#comment-14003132
 ] 

Steve Loughran commented on SLIDER-90:
--------------------------------------

from josh, feb 2014

I tried to test Slider on an Ambari-installed hadoop instance and kept getting 
an UnknownHostException when using the nameservice as the host in the HDFS URI.

For my installation, I have a nameservice of "isty" and two namenodes (istymst 
and istydn1).

It appears if I include hdfs-site.xml on Hoya's classpath (really just 
$HADOOP_CONF_DIR), appears to clean things up as it gets added to the 
Configuration and then NameNodeProxies correctly creates the correct class. 
Alternatively, I could also make things work by including all of the HA 
configuration params into {[slider-client.xml}}

{code}
  <property>
    <name>dfs.client.failover.proxy.provider.isty</name>
    
<value>org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider</value>
  </property>

  <property>
    <name>dfs.namenode.rpc-address.isty.nn2</name>
    <value>istydn1.ctolab.hortonworks.com:8020</value>
  </property>

  <property>
    <name>dfs.namenode.rpc-address.isty.nn1</name>
    <value>istymst.ctolab.hortonworks.com:8020</value>
  </property>

  <property>
    <name>dfs.nameservices</name>
    <value>isty</value>
  </property>

  <property>
    <name>dfs.ha.namenodes.isty</name>
    <value>nn1,nn2</value>
  </property>
{code}

I'm presently leaning towards including HADOOP_CONF_DIR (and checking expected 
dirs based on HADOOP_HOME/HADOOP_PREFIX) is the cleanest. If we can't ascertain 
it on our own, we can at least print a warning and let things progress as 
normal (as it won't affect the non-HA NN users).

> Slider to work on HA NNs
> ------------------------
>
>                 Key: SLIDER-90
>                 URL: https://issues.apache.org/jira/browse/SLIDER-90
>             Project: Slider
>          Issue Type: Sub-task
>          Components: appmaster
>            Reporter: Josh Elser
>
> Reported {{UnknownHostException}} when using the nameservice as the host in 
> the HDFS URI.
> -likely cause failure to pass down all DFS info and/or failure to pick up 
> config from local installation



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to