[
https://issues.apache.org/jira/browse/HDDS-4344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17237974#comment-17237974
]
Lokesh Jain commented on HDDS-4344:
-----------------------------------
With HDDS-4481, block deletion performance results are as follows.
Cluster:
10 data nodes with 3 disks.
Created 1 million keys of size 1 MB each followed by deletion.
HDFS performs the deletion in datanodes in about 60 - 70 minutes.
Ozone performs the deletion in 50 - 60 minutes. Configs set in Ozone.
ozone.key.deleting.limit.per.task - 100000 (OM deletes 100000 keys per minute)
ozone.scm.heartbeat.rpc-timeout - 5s
hdds.scm.block.deletion.per-interval.max - 100000 (SCM processes 100000 blocks
for deletion every minute)
> Block Deletion Performance Improvements
> ---------------------------------------
>
> Key: HDDS-4344
> URL: https://issues.apache.org/jira/browse/HDDS-4344
> Project: Hadoop Distributed Data Store
> Issue Type: Bug
> Reporter: Lokesh Jain
> Assignee: Lokesh Jain
> Priority: Major
> Attachments: Block Deletion Performance.pdf
>
>
> In cluster deployments it was observed that block deletion can be slow. For
> example if a user writes a million keys in Ozone, the time it takes for those
> million keys to be deleted from datanodes can be high. The jira would cover
> various improvements which can be made for better deletion speeds.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
