Jinglun created HDFS-15640:
------------------------------

             Summary: RBF: Add fast distcp threshold to FedBalance.
                 Key: HDFS-15640
                 URL: https://issues.apache.org/jira/browse/HDFS-15640
             Project: Hadoop HDFS
          Issue Type: Improvement
            Reporter: Jinglun


Currently in the DistCpProcedure it must submit distcp round by round until 
there is no diff to go to the final distcp stage. The condition is very strict. 
If the distcp could finish in an acceptable period then we don't need to wait 
for no diff. For example if 3 consecutive distcp jobs all finish within 10 
minutes then we can predict the final distcp could also finish within 10 
minutes. So we can start the final distcp directly.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

Reply via email to