[
https://issues.apache.org/jira/browse/HDFS-14554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16940607#comment-16940607
]
lindongdong commented on HDFS-14554:
------------------------------------
Hi, [~hexiaoqiao], Thanks for your work.
I test your patch, a lot of blocks are not reported. As I analyze, when DN
reports blocks one disk by one disk, this problem happens.
A boolean is not enough for this, maybe a Set is needed.
> Avoid to process duplicate blockreport of datanode when namenode in startup
> safemode
> ------------------------------------------------------------------------------------
>
> Key: HDFS-14554
> URL: https://issues.apache.org/jira/browse/HDFS-14554
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: namenode
> Reporter: Xiaoqiao He
> Assignee: Xiaoqiao He
> Priority: Major
> Attachments: HDFS-14554.001.patch
>
>
> When NameNode restart and enter stage of startup safemode, load of NameNode
> could be very high since blockreport request storm from datanodes together.
> Sometimes datanode may request blockreport times because NameNode doesn't
> return in time and DataNode meet timeoutexception then retry, Thus it
> sharpens load of NameNode.
> So we should check and filter duplicate blockreport request from one
> datannode and reduce load of Namenode.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
