Siyao Meng created HDDS-17129:
---------------------------------
Summary: Measure datanode and SCM load with more than 3 SCMs
Key: HDDS-17129
URL: https://issues.apache.org/jira/browse/HDDS-17129
Project: Apache Ozone
Issue Type: Sub-task
Components: Ozone Datanode, SCM HA
Reporter: Siyao Meng
Every datanode keeps one {{EndpointStateMachine}} per SCM and sends heartbeats,
full container reports, pipeline reports and incremental reports to every SCM
in parallel. Every SCM processes all of them. Going from 3 to 5 SCMs adds ~67%
of datanode -> SCM report traffic and of the per-SCM processing in the cluster.
To do: run a freon / benchmark with 3 vs 5 SCMs on a cluster with many
containers per datanode (report size, heartbeat latency, SCM CPU and heap,
report queue sizes) and add sizing guidance to the SCM HA docs.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
