Duong created HDDS-7543:
---------------------------
Summary: SCM memory optimization
Key: HDDS-7543
URL: https://issues.apache.org/jira/browse/HDDS-7543
Project: Apache Ozone
Issue Type: Improvement
Affects Versions: 1.3.0
Reporter: Duong
I recently did a simulation test to stress SCM handling of 5K of nodes and a
hundred million containers. The test shows that for each container, SCM seems
to spend around 1.5kb of memory for the metadata cache, hence 150GB for 100M
containers.
TODO: put graphs
Also GC count and cost also linearly grow with containers.
TODO: put graphs.
This ticket tracks all the efforts to micro-optimize SCM memory usage, both
long-term (cache) and short-time (like temporary variables, protobuf serialized
objects).
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
