[ 
https://issues.apache.org/jira/browse/HADOOP-4994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12662528#action_12662528
 ] 

Raghu Angadi commented on HADOOP-4994:
--------------------------------------


Currently block metadata does not store size of the block. I don't think it 
should either. But DN can still detect the discrepancy since file lengths of 
metadata and block sizes don't tally (metadata file length shold be : header + 
((block size + 511)/512)*4). 

> This is the use case: [...]
In this case, NN should have detected that that block is smaller than expected. 
I think it does.

> Datanode should verify block sizes vs metadata on startup
> ---------------------------------------------------------
>
>                 Key: HADOOP-4994
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4994
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: dfs
>            Reporter: Brian Bockelman
>
> I could have sworn this bug had been reported by someone else already, but I 
> can't find it on JIRA after searching.... apologies if this is a duplicate.
> The datanode, upon starting up, should check and make sure that all block 
> sizes as reported via `stat` are the same as the block sizes as reported via 
> the block's metadata.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply via email to