Mukul Kumar Singh created HDDS-4689:
---------------------------------------
Summary: Autoclose pipeline after 'x' containers to distribute
pipeline and containers over multiple datanodes
Key: HDDS-4689
URL: https://issues.apache.org/jira/browse/HDDS-4689
Project: Hadoop Distributed Data Store
Issue Type: Bug
Components: SCM
Reporter: Mukul Kumar Singh
Assignee: Mukul Kumar Singh
Currently, Ozone pipelines are long-lived i.e. a pipeline is normally on 3 DN's
and it stays there till the pipeline fails or the DN restarts.
This Jira proposes to close the pipeline after let's say 20 containers have
been created and then closed on a pipeline. Once the pipeline is closed, the
DN's are released and a new pipeline can be created using the set of available
nodes during that time.
This patch will hopefully help in increasing the skew of the containers on the
DN's and will help in error recovery and data loss cases when 3 DN's are lost.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
