captainzmc opened a new pull request #814:
URL: https://github.com/apache/hadoop-ozone/pull/814


   ## What changes were proposed in this pull request?
   
   Currently delete file is to get all the keys in the directory, and then 
delete one by one. This makes for poor performance.
   By tested the deletion directory with 100,000 files, which took 3718.70 sec. 
And rename it took 7327.936 sec.
   Using this PR, when batch-size is set to 100, the time of delete and 
rename's directory of 100,000  files is 62.498 sec and 46.002 sec. Performance 
improved nearly 100 times。
   
   Rename has the same problem, and I'll add rename to the other PR.
   
   ##What is the link to the Apache JIRA
   https://issues.apache.org/jira/browse/HDDS-3286
   
   ## How was this patch tested?
   Added UT
   Existing acceptance tests.
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]



---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to