[
https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15304441#comment-15304441
]
Inigo Goiri commented on HDFS-10467:
------------------------------------
The advantages of this approach are:
* Transparent to the users: A user can use the regular HDFS client as the
Router looks like a regular Namenode. No maintenance of the mount table, etc.
* Transparent rebalancing of subclusters: With this design, we can move data
between subclusters and hide it behind the Router.
* No additional changes to current HDFS: The Routers and State Store are
completely independent from current NNs and DNs. No additional changes to the
current HDFS code (we could add some functionality to the NN for some minor
performance improvement but not needed).
We have a prototype running with 4 subclusters and a couple implementations for
the State Store side. Once we agree with the design, I can start creating the
subtasks.
> Router-based HDFS federation
> ----------------------------
>
> Key: HDFS-10467
> URL: https://issues.apache.org/jira/browse/HDFS-10467
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: fs
> Affects Versions: 2.7.2
> Reporter: Inigo Goiri
> Attachments: HDFS Router Federation.pdf
>
>
> Add a Router to provide a federated view of multiple HDFS clusters.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
