[ 
https://issues.apache.org/jira/browse/HDFS-1779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13097214#comment-13097214
 ] 

Uma Maheswara Rao G commented on HDFS-1779:
-------------------------------------------

Hi Todd & Hairong,
 
 Added the additional tests to reproduce this scenario!

 Patch contains: Hairong code changes
                 + Todd review comments fixes
                 + Added additional testcases for reproducing this scenario.
                 + made the supportAppends variable to private in datanode 
                   and added javadoc for processBlocksBeingWritten api.

  One more scenario is, if more number of blocks are under construction and 
also sync has been called for blocks .After that NN restart happened. Then if 
DNs didn't send the BBW report to NN, it will never become out of safemode 
because NN will expect some threshold of blocks to report to come out of 
safemode.This condition also added in tests.

  
Thanks
Uma

> After NameNode restart , Clients can not read partial files even after client 
> invokes Sync.
> -------------------------------------------------------------------------------------------
>
>                 Key: HDFS-1779
>                 URL: https://issues.apache.org/jira/browse/HDFS-1779
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: data-node, name-node
>    Affects Versions: 0.20-append
>         Environment: Linux
>            Reporter: Uma Maheswara Rao G
>            Assignee: Uma Maheswara Rao G
>             Fix For: 0.20-append, 0.20.205.0
>
>         Attachments: HDFS-1779.1.patch, HDFS-1779.2.patch, HDFS-1779.patch, 
> bbwReportAppend.patch
>
>
> In Append HDFS-200 issue,
> If file has 10 blocks and after writing 5 blocks if client invokes sync 
> method then NN will persist the blocks information in edits. 
> After this if we restart the NN, All the DataNodes will reregister with NN. 
> But DataNodes are not sending the blocks being written information to NN. DNs 
> are sending the blocksBeingWritten information in DN startup. So, here 
> NameNode can not find that the 5 persisted blocks belongs to which datanodes. 
> This information can build based on block reports from DN. Otherwise we will 
> loose this 5 blocks information even NN persisted that block information in 
> edits. 

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to