[
https://issues.apache.org/jira/browse/HDFS-13433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16441313#comment-16441313
]
Arpit Agarwal commented on HDFS-13433:
--------------------------------------
bq. Just because the NN has an nsId doesn't mean it overrides the defaultFS
authority.
[~daryn], this {{clientNamenodeAddress}} is used for webhdfs redirects. The
redirect URL should use the nameservice that the NN belongs to, and not
{{fs.defaultFS}}.
We've seen this in federated clusters, e.g. a webhdfs create request sent to a
NameNode in ns2 uses a redirect url with fs.defaultFS=ns1.
> webhdfs requests can be routed incorrectly in federated cluster
> ---------------------------------------------------------------
>
> Key: HDFS-13433
> URL: https://issues.apache.org/jira/browse/HDFS-13433
> Project: Hadoop HDFS
> Issue Type: Bug
> Reporter: Arpit Agarwal
> Assignee: Arpit Agarwal
> Priority: Critical
> Attachments: HDFS-13433.01.patch, HDFS-13433.02.patch,
> HDFS-13433.03.patch, HDFS-13433.04.patch
>
>
> In the following HA+Federated setup with two nameservices ns1 and ns2:
> # ns1 -> namenodes nn1, nn2
> # ns2 -> namenodes nn3, nn4
> # fs.defaultFS is {{hdfs://ns1}}.
> A webhdfs request issued to nn3/nn4 will be routed to ns1. This is because
> {{setClientNamenodeAddress}} initializes {{NameNode#clientNamenodeAddress}}
> using fs.defaultFS before the config is overriden.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
