[
https://issues.apache.org/jira/browse/HDDS-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lokesh Jain updated HDDS-5053:
------------------------------
Description:
The DN process uses around 20 GB of RSS after startup and does not release the
memory even though rocksdb is closed for every container.
The capacity used by AbstractDatanodeStore is default capacity * MB. Since
default capacity is 64MB therefore block cache is passed a capacity of 64TB.
After the fix the DN memory usage drops to ~3GB.
was:
RocksDB block cache is not being shared by Datanode containers. The DN process
uses around 20 GB of RSS after startup and does not release the memory even
though rocksdb is closed for every container.
Replacing the OPTIONS_CACHE in AbstractDatanodeStore with static
ColumnFamilyOptions brings the RSS down to ~3.5 GB after startup.
> RocksDB block cache capacity is wrongly configured
> --------------------------------------------------
>
> Key: HDDS-5053
> URL: https://issues.apache.org/jira/browse/HDDS-5053
> Project: Apache Ozone
> Issue Type: Bug
> Components: Ozone Datanode
> Reporter: Lokesh Jain
> Assignee: Lokesh Jain
> Priority: Major
> Labels: pull-request-available
>
> The DN process uses around 20 GB of RSS after startup and does not release
> the memory even though rocksdb is closed for every container.
> The capacity used by AbstractDatanodeStore is default capacity * MB. Since
> default capacity is 64MB therefore block cache is passed a capacity of 64TB.
> After the fix the DN memory usage drops to ~3GB.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
