[ https://issues.apache.org/jira/browse/AMBARI-8244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386935#comment-14386935 ]
Ivan Mitic commented on AMBARI-8244: ------------------------------------ Hi folks, {{hadoop dfsadmin}} command always uses the default file system (fs.defaultFS) when trying to resolve the namenode address (not sure what happens in case of HA, would have to check). So when fs.defaultFS is something other then {{hdfs://}} you have to supply {{-fs hdfs://...}} arg to dfsadmin command. Hope this helps. {{dfs.namenode.rpc-address}} from hdfs-site is used by namenode to figure out the address it should start on. If this address is not provided, namenode will fall back to fs.defaultFS. This value is not used by dfsadmin. > Ambari HDP 2.0.6+ stacks do not work with fs.defaultFS not being hdfs > --------------------------------------------------------------------- > > Key: AMBARI-8244 > URL: https://issues.apache.org/jira/browse/AMBARI-8244 > Project: Ambari > Issue Type: Bug > Components: stacks > Affects Versions: 2.0.0 > Reporter: Ivan Mitic > Assignee: Ivan Mitic > Labels: HDP > Fix For: 2.1.0 > > Attachments: AMBARI-8244.2.patch, AMBARI-8244.3.patch, > AMBARI-8244.4.patch, AMBARI-8244.5.patch, AMBARI-8244.6.patch, > AMBARI-8244.patch > > > Right now changing the default file system does not work with the HDP 2.0.6+ > stacks. Given that it might be common to run HDP against some other file > system in the cloud, adding support for this will be super useful. One > alternative is to consider a separate stack definition for other file > systems, however, given that I noticed just 2 minor bugs needed to support > this, I would rather extend on the existing code. > Bugs: > - One issue is in Nagios install scripts, where it is assumed that > fs.defaultFS has the namenode port number. > - Another issue is in HDFS install scripts, where {{hadoop dfsadmin}} > command only works when hdfs is the default file system. > Fix for both places is to extract the namenode address/port from > {{dfs.namenode.rpc-address}} if one is defined and use it instead of relying > on {{fs.defaultFS}}. > Haven't included any tests yet (my first Ambari patch, not sure what is > appropriate, so please comment). -- This message was sent by Atlassian JIRA (v6.3.4#6332)