[
https://issues.apache.org/jira/browse/HDFS-13123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16905797#comment-16905797
]
hemanthboyina commented on HDFS-13123:
--------------------------------------
thanks for the comment [~crh]
_How is atomicity in distcp taken into account here? If distcp
fails, destination cluster may have unused files lying around unaudited. May be
user can specify atomicity flag through admin._
__ if the distcp fails , we will delete the files copied in the destination
cluster , +We can use atomicity flag for better purpose+
_How are multiple rebalancings going to work if executed? Should admin
maintain a state of what all rebalancing is in progress and what all completed.
Some basic auditing at least._
Yes admin should maintain what all rebalancing operations in progress , and
for a given mount point, we only allow one concurrent rebalancing operation.
_Rebalancing across secured clusters?_
As we are using distcp , distcp should be taken care of it in secure cluster
> RBF: Add a balancer tool to move data across subcluster
> --------------------------------------------------------
>
> Key: HDFS-13123
> URL: https://issues.apache.org/jira/browse/HDFS-13123
> Project: Hadoop HDFS
> Issue Type: Improvement
> Reporter: Wei Yan
> Assignee: hemanthboyina
> Priority: Major
> Attachments: HDFS Router-Based Federation Rebalancer.pdf,
> HDFS-13123.patch
>
>
> Follow the discussion in HDFS-12615. This Jira is to track effort for
> building a rebalancer tool, used by router-based federation to move data
> among subclusters.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
