[
https://issues.apache.org/jira/browse/HDDS-12391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17930643#comment-17930643
]
Ivan Andika commented on HDDS-12391:
------------------------------------
[~Sammi] Thanks for checking this out.
> How many containers on one volume in this case?
We haven't measured it yet. Let me update the ticket once we have the number.
> Because the container yaml file reading slowness?
Most likely, [~XiChen] said that [~Nicholas Niu] mentioned that the current
bottleneck is reading the .container files.
Another possible optimizations might be to parallelize the container reading
process, but this requires synchronizing ContainerSet to prevent race
conditions.
> Speed up container set loading during Datanode Startup
> ------------------------------------------------------
>
> Key: HDDS-12391
> URL: https://issues.apache.org/jira/browse/HDDS-12391
> Project: Apache Ozone
> Issue Type: Improvement
> Components: Ozone Datanode
> Reporter: Ivan Andika
> Priority: Major
>
> We found that DN startup took very long to send the first heartbeat to the
> SCM, causing SCM to think the DN is STALE and DEAD.
> Seems DN takes very long to read all the container files in ContainerReader,
> it takes approximately 30 minutes. We should try to optimize this (maybe need
> to support merging containers).
> {code:java}
> 2024-12-10 10:46:51,000 [main] INFO
> org.apache.hadoop.ozone.container.ozoneimpl.OzoneContainer: Build
> ContainerSet costs 1939s {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
