Li Bo created HDFS-9657:
---------------------------

             Summary: Schedule EC tasks at proper time to reduce the impact of 
recovery traffic
                 Key: HDFS-9657
                 URL: https://issues.apache.org/jira/browse/HDFS-9657
             Project: Hadoop HDFS
          Issue Type: Sub-task
            Reporter: Li Bo
            Assignee: Li Bo


The EC recover tasks consume a lot of network bandwidth and disk I/O. 
Recovering a corrupt block requires transferring 6 blocks , hence creating a 6X 
overhead in network bandwidth and disk I/O.  When a datanode fails , the 
recovery of the whole blocks on this datanode may use up the network bandwith.  
We need to start a recovery task at a proper time in order to give less impact 
to the system.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to