[
https://issues.apache.org/jira/browse/HDFS-6602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14043993#comment-14043993
]
Kihwal Lee commented on HDFS-6602:
----------------------------------
Block report processing is actually okay. All types of block report processing
goes through {{BlockManager#processReportedBlock()}} and any report from future
is queued. It is {{delete()}} that causes this queue to be populated. After
collecting all blocks to be invalidated, {{BlockManager#removeBlock()}} is
called, which calls {{addToInvalidates()}}. If NN is in standby,
{{addToInvalidates()}} should not be called.
> PendingDeletionBlocks on SBN keeps increasing
> ---------------------------------------------
>
> Key: HDFS-6602
> URL: https://issues.apache.org/jira/browse/HDFS-6602
> Project: Hadoop HDFS
> Issue Type: Bug
> Affects Versions: 2.5.0
> Reporter: Kihwal Lee
> Priority: Critical
>
> PendingDeletionBlocks is from BlockManager.invalidateBlocks.numBlocks(). It
> means this data structure is populated, but IBR (incremental block reports)
> do not cause deleted blocks to be removed from it. As a result, the heap
> usage keeps increasing.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
