sarvekshayr opened a new pull request, #9064:
URL: https://github.com/apache/ozone/pull/9064

   ## What changes were proposed in this pull request?
   SCM sends an Incremental Container Report (ICR) for every close container 
event, even when there is no actual state change. This results in a large 
number of ICRs, especially when datanode pipelines become unstable due to 
factors like other DNs going down, network issues, or the local datanode being 
overloaded. Each pipeline close triggers close container events for all 
containers in the pipeline, and these ICRs are retried repeatedly, adding 
unnecessary load.
   
   To optimise this, we have modified the behaviour so that when there is no 
state change, the close container report is deferred and sent with the next 
heartbeat. If there is a state change, the ICR is triggered immediately. This 
reduces redundant ICRs.
   
   ## What is the link to the Apache JIRA
   https://issues.apache.org/jira/browse/HDDS-13617
   
   ## How was this patch tested?
   Added a unit test - `TestKeyValueHandler#testICRsOnContainerClose`
   CI: https://github.com/sarvekshayr/ozone/actions/runs/17974803776


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to