[
https://issues.apache.org/jira/browse/HDDS-11209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hongbing Wang updated HDDS-11209:
---------------------------------
Description:
OM cached pipeline may not cache container's all datanode information (for
example, some DNs may not report in time), which can be problematic for EC
files. If the nodes num is less than the EC data-blocks num, an error will
occur when reading data:
{code:java}
There are insufficient datanodes to read the EC block {code}
This err will persist until the cache expires (after 6 hours) even if all DNs
corresponding to the EC file are completely normal.
So, we should not cache EC pipelines with incomplete data-nodes.
was:
OM cached pipeline may not have completed caching container's all datanode
information (for example, some DNs may not have reported back yet after the SCM
restarts, or some DNs may not report due to some reasons ), which can be
problematic for EC files. If the nodes num is less than the EC data-blocks num,
an error will occur when reading data:
{code:java}
There are insufficient datanodes to read the EC block {code}
This err will persist until the cache expires (after 6 hours).
So, we should not cache EC pipelines with incomplete data-nodes.
> Avoid insufficient EC pipelines in the container pipeline cache
> ---------------------------------------------------------------
>
> Key: HDDS-11209
> URL: https://issues.apache.org/jira/browse/HDDS-11209
> Project: Apache Ozone
> Issue Type: Bug
> Components: EC, OM
> Affects Versions: 1.4.0
> Reporter: Hongbing Wang
> Assignee: Hongbing Wang
> Priority: Major
>
> OM cached pipeline may not cache container's all datanode information (for
> example, some DNs may not report in time), which can be problematic for EC
> files. If the nodes num is less than the EC data-blocks num, an error will
> occur when reading data:
> {code:java}
> There are insufficient datanodes to read the EC block {code}
> This err will persist until the cache expires (after 6 hours) even if all DNs
> corresponding to the EC file are completely normal.
> So, we should not cache EC pipelines with incomplete data-nodes.
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
