sodonnel opened a new pull request, #4447:
URL: https://github.com/apache/ozone/pull/4447

   ## What changes were proposed in this pull request?
   
   Similar to ReplicateContainerCommands, we should limit the number of delete 
commands queued on a given datanode at any time. This PR will enforce the limit 
with a static config variable with a view to making this more dynamic later.
   
   This change does not limit any delete container commands sent from the 
health check chain in RM. It only affects deletes for the Ratis and EC Over 
Replication Handlers, which should drive the bulk of the deletes.
   
   Note that delete container replicas from the balancer are not throttled. The 
balancer issues moves in a controlled way, and its deletes are triggered when a 
replication completes. Therefore its deletes are naturally throttled by the 
rate of completion of the replicated commands. It will not flood the cluster 
with deletes like could happen when a couple of dead nodes are brought back 
into the cluster still with their containers in place.
   
   ## What is the link to the Apache JIRA
   
   https://issues.apache.org/jira/browse/HDDS-8233
   
   ## How was this patch tested?
   
   New unit tests added.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to