[
https://issues.apache.org/jira/browse/HDFS-15087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17025589#comment-17025589
]
Brahma Reddy Battula commented on HDFS-15087:
---------------------------------------------
{quote}First support DFSAdmin command balance. Then integrate it to Router.
Finally support smart balance
{quote}
Ok.this will be good to have.
{quote}When I trying to use snapshot I meet a tricky problem. I envisioned 2
ways:
In fun1, we don't do hardlink in the loop. So the final hardlink will cost a
lot. From the performance chapter we can see the HardLink part costs
474,701ms(82.22%) for a large path. The larger the path is, the higer the
hardlink proportion. So in this way the benefit of snapshot delta is not
much(17.78%).
{quote}
if we use snapshot, I dn't think, we require hardlink.
{quote}We need to check the existance of the dst-path. If the dst-path exists
then the rpc succeeds. Otherwise the rpc fails.
{quote}
When dst path have multiplefiles and subfolders, all these existence will be
checked.
{quote}Hi everyone, any further comments? Please let me know your thoughts,
thanks !
{quote}
I dn't have further comments. May be, you can update design doc with this
improvements/future plan and create the branch start contribute.
> RBF: Balance/Rename across federation namespaces
> ------------------------------------------------
>
> Key: HDFS-15087
> URL: https://issues.apache.org/jira/browse/HDFS-15087
> Project: Hadoop HDFS
> Issue Type: Improvement
> Reporter: Jinglun
> Priority: Major
> Attachments: HDFS-15087.initial.patch, HFR_Rename Across Federation
> Namespaces.pdf
>
>
> The Xiaomi storage team has developed a new feature called HFR(HDFS
> Federation Rename) that enables us to do balance/rename across federation
> namespaces. The idea is to first move the meta to the dst NameNode and then
> link all the replicas. It has been working in our largest production cluster
> for 2 months. We use it to balance the namespaces. It turns out HFR is fast
> and flexible. The detail could be found in the design doc.
> Looking forward to a lively discussion.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
