[
https://issues.apache.org/jira/browse/HDFS-15087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17013422#comment-17013422
]
Brahma Reddy Battula commented on HDFS-15087:
---------------------------------------------
[~LiJinglun] . Gone through the design document,Nice Feature and Neatly
docuemented. (y)
# Scheduler will have ablitiy to identify which NS is full and automatically
schedule the job..? May be each NS can configure the threshhold..?
# Scheduler can be enchanced based RPC load/usage ( balance the RPC load
also)..?
# How the consistency is ensured if you wn't use snapshot like [~linyiqun]
and [~goiri] mentioned..? After "*saveTree"* step, before creating the mount
table(Or blockwrites will be there till job is success, but this might delay
other applications as you make tree as immutable?) .how the delta will be
processed..? ( i didn't seen, making mount table readonly)..Bytheway editlog
idea looks good here.
# Mount table properties(or attributes) also preserved..?
# saveTree() and GraftTree() are idempotent..? On Namenode failover, will
these be re-executed if it's connected to newly active namenode.
Please do correct me if I am not in same page with you guys.
Bytheway I am planning for 3.3.0 release by March mid, it will be good if we
finish before that, so that this can be included in 3.3 Release.
> RBF: Balance/Rename across federation namespaces
> ------------------------------------------------
>
> Key: HDFS-15087
> URL: https://issues.apache.org/jira/browse/HDFS-15087
> Project: Hadoop HDFS
> Issue Type: Improvement
> Reporter: Jinglun
> Priority: Major
> Attachments: HDFS-15087.initial.patch, HFR_Rename Across Federation
> Namespaces.pdf
>
>
> The Xiaomi storage team has developed a new feature called HFR(HDFS
> Federation Rename) that enables us to do balance/rename across federation
> namespaces. The idea is to first move the meta to the dst NameNode and then
> link all the replicas. It has been working in our largest production cluster
> for 2 months. We use it to balance the namespaces. It turns out HFR is fast
> and flexible. The detail could be found in the design doc.
> Looking forward to a lively discussion.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
