[
https://issues.apache.org/jira/browse/HADOOP-4314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12635911#action_12635911
]
Raghu Angadi commented on HADOOP-4314:
--------------------------------------
This affects only simulated datanodes.
When a SimulatedDataNode sends block report, it includes the blocks that are
currently being written. The reported size of such blocks is the default blocks
size (64MB). NameNode assumes it is a real block. When the datanodes report the
block when the writing finishes, NameNode rejects those blocks unless the size
is same as 64MB. This bug always existed but only since 0.18, NameNode started
rejecting blocks that are smaller than largest size reported by any datanode.
Even replication attempts fail.
The fix is to exclude blocks that are not "finalized" at the datanode in the
block report from simulated datanodes. I will attach a patch.
> TestReplication fails quite often
> ---------------------------------
>
> Key: HADOOP-4314
> URL: https://issues.apache.org/jira/browse/HADOOP-4314
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs, test
> Affects Versions: 0.18.0
> Reporter: Raghu Angadi
> Assignee: Raghu Angadi
> Priority: Blocker
> Fix For: 0.18.2
>
> Attachments: TestReplication.txt
>
>
> TestReplication times out once every 5-6 attempts. I will attach log from a
> failed test.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
