[ 
https://issues.apache.org/jira/browse/HDFS-9289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14981222#comment-14981222
 ] 

Chang Li commented on HDFS-9289:
--------------------------------

Thanks [~jingzhao], [~zhz] and [~daryn] for reivew and valuable discussions! 
Some additional info about several cases of mismatched GS we encountered is 
that they all happened after pipelineupdate for datanode close recovery, so no 
mismatched size of commit happen only mismatched GS. 
Could we reach a consensus of whether we should log warn of mismatched GS block 
info or throw exception?


> check genStamp when complete file
> ---------------------------------
>
>                 Key: HDFS-9289
>                 URL: https://issues.apache.org/jira/browse/HDFS-9289
>             Project: Hadoop HDFS
>          Issue Type: Bug
>            Reporter: Chang Li
>            Assignee: Chang Li
>            Priority: Critical
>         Attachments: HDFS-9289.1.patch, HDFS-9289.2.patch, HDFS-9289.3.patch, 
> HDFS-9289.4.patch
>
>
> we have seen a case of corrupt block which is caused by file complete after a 
> pipelineUpdate, but the file complete with the old block genStamp. This 
> caused the replicas of two datanodes in updated pipeline to be viewed as 
> corrupte. Propose to check genstamp when commit block



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to