[
https://issues.apache.org/jira/browse/HDDS-11514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang updated HDDS-11514:
-----------------------------------
Release Note:
The default values for several background deletion configurations have been
increased to improve the efficiency of space reclamation. These
changes will make background deletion more aggressive, which can help to
reclaim disk space faster.
The following properties have been updated:
* ozone.key.deleting.limit.per.task: The default value has been increased
from 20,000 to 50,000. This is the maximum number of keys scanned
by the key deleting service in the Ozone Manager per run.
* hdds.scm.block.deletion.per-interval.max: The default value has been
increased from 100,000 to 500,000. This is the maximum number of
blocks SCM will send to Datanodes for deletion in a single interval.
* hdds.datanode.block.deleting.limit.per.interval: The default value has
been increased from 5,000 to 20,000. This is the maximum number of
blocks a Datanode will attempt to delete in one interval.
> Set optimal default values for delete configurations based on live cluster
> testing
> ----------------------------------------------------------------------------------
>
> Key: HDDS-11514
> URL: https://issues.apache.org/jira/browse/HDDS-11514
> Project: Apache Ozone
> Issue Type: Sub-task
> Components: OM, SCM
> Reporter: Ethan Rose
> Assignee: Aryan Gupta
> Priority: Major
> Labels: pull-request-available
> Fix For: 2.1.0
>
>
> Some configurations to throttle background deletions have been chosen with
> educated guesses, and may not reflect real cluster usage. We should test
> large scale deletions of millions of files and directories and TBs of data
> all at once on a real cluster, tune the configurations accordingly, and use
> this experiment to inform our choice of default values.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
