Stephen O'Donnell created HDDS-4488:
---------------------------------------
Summary: Open RocksDB read only when loading containers
Key: HDDS-4488
URL: https://issues.apache.org/jira/browse/HDDS-4488
Project: Hadoop Distributed Data Store
Issue Type: Improvement
Components: Ozone Datanode
Affects Versions: 1.1.0
Reporter: Stephen O'Donnell
Assignee: Stephen O'Donnell
When a datanode is started, it must read some metadata from all the Containers.
Part of that metadata is stored in RocksDB, so the startup process involves
opening each rocksDB and closing it again.
Testing on a dense node, with 45 high performance spinning disks and 200K
containers, I saw about 75ms on average to open each RockDB. Further testing
demonstrated that if we open RockDB read only, the average open time is about
35ms.
At startup time, the DBs are only read and never written, so opening read only
is fine. HDDS-4427 already ensures these opened DBs are not cached.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
