[
https://issues.apache.org/jira/browse/HDDS-12501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang updated HDDS-12501:
-----------------------------------
Release Note:
Introduced a new configuration property
ozone.om.snapshot.prune.compaction.backup.batch.size which defaults to 2000.
This property controls:
Prune SST files in Compaction backup directory in batches every
ozone.om.snapshot.compaction.dag.prune.daemon.run.interval.
> Background thread in RocksDBCheckpointDiffer should convert backup sst files
> to store only key and get rid of OmKeyInfo
> -----------------------------------------------------------------------------------------------------------------------
>
> Key: HDDS-12501
> URL: https://issues.apache.org/jira/browse/HDDS-12501
> Project: Apache Ozone
> Issue Type: Sub-task
> Reporter: Swaminathan Balachandran
> Assignee: Saketa Chalamchala
> Priority: Major
> Labels: pull-request-available
> Fix For: 2.1.0
>
>
> Currently backup sst directories just stores the hard links to the input sst
> files on compaction. We should eventually rewrite the sst file(Atomic
> rewrite) and just store the key in the sst file and get rid of OMKeyInfo.
> This will significantly reduce the size of the directory significantly
> reducing the storage footprint of the sst backup directory. Currently an
> average of OMKeyInfo is in the order of few KBs or even more and the average
> key would be in the order of 50 bytes at most.
> While rewriting the sst file it should be kept in mind we read the tombstones
> in the sst file using the rawSstFileReader and write it back with
> sstFileWriter
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
