aryangupta1998 opened a new pull request, #7486:
URL: https://github.com/apache/ozone/pull/7486

   ## What changes were proposed in this pull request?
   
   When a large amount of data is deleted, we may see slow progress in clearing 
it out due to the large backlog of pending deletes, even if all deletion 
services run for their full intervals and collect their maximum number of 
entries. To speed up deletion further, more threads will need to be configured. 
This PR helps to support multi-threaded deletion for the key deleting service.
   
   Approach:
   By default, we have configured 10 threads. We have a key supplier class with 
a synchronized get() function, which each thread calls to get a set of key info 
and then process it. Concurrently, threads call this get() and process the keys 
until the key limit per task is reached.
   
   ## What is the link to the Apache JIRA
   
   https://issues.apache.org/jira/browse/HDDS-11808
   
   ## How was this patch tested?
   
   Tested Manually.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to