[
https://issues.apache.org/jira/browse/HDFS-12615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16352669#comment-16352669
]
Íñigo Goiri commented on HDFS-12615:
------------------------------------
{quote}The #1 and #2 don't have to be done in this JIRA, right?
{quote}
Correct, I think those are big enough to be their own umbrella.
{quote}Does this mean that we support the mount point that points to multiple
mount points? What's the use case for this?
{quote}
It would be a mount point that points to multiple *subclusters*.
Internally we use it extensively for a couple use cases:
* Folders with a lot of data; they pretty much don't fit in a single subcluster
* Folders with a lot of accesses; we have jobs with thousands of containers
and all of them start at the same time and overload the NN
In these cases, we spread mount points across multiple subclusters and we have
a bunch of policies for that.
> Router-based HDFS federation phase 2
> ------------------------------------
>
> Key: HDFS-12615
> URL: https://issues.apache.org/jira/browse/HDFS-12615
> Project: Hadoop HDFS
> Issue Type: Improvement
> Reporter: Íñigo Goiri
> Assignee: Íñigo Goiri
> Priority: Major
> Labels: RBF
>
> This umbrella JIRA tracks set of improvements over the Router-based HDFS
> federation (HDFS-10467).
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
