adoroszlai opened a new pull request, #4758:
URL: https://github.com/apache/ozone/pull/4758

   ## What changes were proposed in this pull request?
   
   Currently EC pipelines are limited to 5 per EC scheme, which does not scale 
with the size of the cluster.
   
   As a simple first step for scaling EC pipeline/container count, 
`WritableECContainerProvider` should dynamically adjust the limit based on the 
number of healthy data volumes available in the cluster.
   
   To retain behavior in smaller clusters, the existing `pipeline.minimum` 
config is used if it is greater than the calculated value.
   
   https://issues.apache.org/jira/browse/HDDS-8674
   
   ## How was this patch tested?
   
   Added test case in `TestWritableECContainerProvider`.
   
   https://github.com/adoroszlai/hadoop-ozone/actions/runs/5054873935


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to