zhengchenyu opened a new pull request, #7142:
URL: https://github.com/apache/hadoop/pull/7142

   
   ### Description of PR
   
   By enabling reconstruction to decommissioning datanode, the speed increased 
by 12 times on a small-scale cluster with only 100 machines dedicated to 
storing EC data. I think in prodcution cluster with thousands of clusters, 
there will be hundreds of times growth.
   
   
   ### How was this patch tested?
   
   unit test and test in cluster
   
   ### For code changes:
   
   - [x] Support decommissioning DataNode by EC block reconstruction.
   - [x] `liveBusyBlockIndices` rename to `liveAndDecommissioningBusyIndices`.
   - [x] remove `excludeReconstructedIndices` which is duplicate with 
`liveAndDecommissioningBusyIndices`
   - [x] add new `liveAndDecommissioningBusyIndices` which is used when 
reconstruct the busy decommissioning block.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to