[
https://issues.apache.org/jira/browse/HDFS-611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12753839#action_12753839
]
dhruba borthakur commented on HDFS-611:
---------------------------------------
That os certainly possible. On the other hand, what I have learnt is that
deleting a file in ext3 is slow, especially if the file is big because ext3
will synchornously access all indirect blocks and free them, thus requiring
more disk IOs. The speed of deletion is dependent on the size of the file. This
means that if we have a single thread in the Datanode doing all the deletes, it
might not be able to keep up if the incoming rate of blocks-to-be-deleted is
high.
> Heartbeats times from Datanodes increase when there are plenty of blocks to
> delete
> ----------------------------------------------------------------------------------
>
> Key: HDFS-611
> URL: https://issues.apache.org/jira/browse/HDFS-611
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: data-node
> Reporter: dhruba borthakur
> Assignee: dhruba borthakur
>
> I am seeing that when we delete a large directory that has plenty of blocks,
> the heartbeat times from datanodes increase significantly from the normal
> value of 3 seconds to as large as 50 seconds or so. The heartbeat thread in
> the Datanode deletes a bunch of blocks sequentially, this causes the
> heartbeat times to increase.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
