[
https://issues.apache.org/jira/browse/HDDS-4689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mukul Kumar Singh updated HDDS-4689:
------------------------------------
Summary: Autoclose pipeline after 'n' containers to distribute pipeline and
containers over multiple datanodes (was: Autoclose pipeline after 'x'
containers to distribute pipeline and containers over multiple datanodes)
> Autoclose pipeline after 'n' containers to distribute pipeline and containers
> over multiple datanodes
> -----------------------------------------------------------------------------------------------------
>
> Key: HDDS-4689
> URL: https://issues.apache.org/jira/browse/HDDS-4689
> Project: Hadoop Distributed Data Store
> Issue Type: Bug
> Components: SCM
> Reporter: Mukul Kumar Singh
> Assignee: Mukul Kumar Singh
> Priority: Major
>
> Currently, Ozone pipelines are long-lived i.e. a pipeline is normally on 3
> DN's and it stays there till the pipeline fails or the DN restarts.
> This Jira proposes to close the pipeline after let's say 20 containers have
> been created and then closed on a pipeline. Once the pipeline is closed, the
> DN's are released and a new pipeline can be created using the set of
> available nodes during that time.
> This patch will hopefully help in increasing the skew of the containers on
> the DN's and will help in error recovery and data loss cases when 3 DN's are
> lost.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
