[
https://issues.apache.org/jira/browse/HDFS-15994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17327218#comment-17327218
]
Qi Zhu edited comment on HDFS-15994 at 4/22/21, 9:50 AM:
---------------------------------------------------------
cc [~weichiu] [~hexiaoqiao] [~sodonnell] [~ayushtkn] [~linyiqun]
[~jianliang.wu]
I submitted a patch for review, i think we should improve the block deletions
in huge clusters.
What's your opinions about this?
Thanks.
was (Author: zhuqi):
cc [~weichiu] [~hexiaoqiao] [~sodonnell] [~ayushtkn] [~linyiqun]
[~jianliang.wu]
I submitted a patch for review, i think we should improve the block deletions
in huge clusters.--
What's your opinions about this?
Thanks.
> Deletion should sleep some time, when there are too many pending deletion
> blocks.
> ---------------------------------------------------------------------------------
>
> Key: HDFS-15994
> URL: https://issues.apache.org/jira/browse/HDFS-15994
> Project: Hadoop HDFS
> Issue Type: Improvement
> Reporter: Qi Zhu
> Assignee: Qi Zhu
> Priority: Major
> Attachments: HDFS-15994.001.patch
>
>
> HDFS-13831 realize that we can control the frequency of other waiters to get
> the lock chance.
> But actually in our big cluster with heavy deletion:
> The problem still happened, and the pending deletion blocks will be more
> than ten million somtimes, and the size become more than 1 million in regular
> in huge clusters.
> So i think we should sleep for some time when pending too many deletion
> blocks.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
