[
https://issues.apache.org/jira/browse/HDFS-15764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17274302#comment-17274302
]
Yang Yun edited comment on HDFS-15764 at 1/29/21, 10:26 AM:
------------------------------------------------------------
Thanks [~hexiaoqiao] for your comments,
>From my understanding, When call notifyNamenodeDeletedBlock, it add the block
>info to the map 'pendingIBRs', a batch of blocks info will be sent at next
>hearbeat as mentioned by [~elgoiri]. So the RPC request to NN is not related
>to the number of blocks located at the failed volume.
was (Author: hadoop_yangyun):
Thanks [~hexiaoqiao] for your comments,
>From I understanding, When call notifyNamenodeDeletedBlock, it add the block
>info to the map 'pendingIBRs', a batch of blocks info will be sent at next
>hearbeat as mentioned by [~elgoiri]. So the RPC request to NN is not related
>to the number of blocks located at the failed volume.
> Notify Namenode missing or new block on disk as soon as possible
> ----------------------------------------------------------------
>
> Key: HDFS-15764
> URL: https://issues.apache.org/jira/browse/HDFS-15764
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: datanode
> Reporter: Yang Yun
> Assignee: Yang Yun
> Priority: Minor
> Attachments: HDFS-15764.001.patch, HDFS-15764.002.patch
>
>
> When a bock file is deleted on disk or copied back to the disk, the
> DirectoryScanner can find the change, but the namenode know the change only
> untill the next full report. And in big cluster the period of full report is
> set to long time invterval.
> Call notifyNamenodeDeletedBlock if block files are deleted and call
> notifyNamenodeReceivedBlock if the block files is found agian. So the
> Incremental block report can send the change to namenode in next heartbeat.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
