[
https://issues.apache.org/jira/browse/HDFS-10810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HDFS-10810:
---------------------------------
Attachment: HDFS-10810-003.patch
Hi, [~brahmareddy], I can understand that the block is removed from
{{neededReconstruction}}, but I don't see why the block is counted as corrupt.
I slightly simplified the unit test (correct me if I'm wrong) which mainly
checks the missing block count first, but it did not fail the assertion without
this patch. Also I think it's not tightly connected with batch IBR without
which the IBR may still get delayed.
The basic idea of counting pending replicas when updating the
neededReconstructions makes sense to me. We need 2nd opinion here. Ping
[~szetszwo]. Thanks.
> Setreplication removing block from underconstrcution temporarily when batch
> IBR is enabled.
> --------------------------------------------------------------------------------------------
>
> Key: HDFS-10810
> URL: https://issues.apache.org/jira/browse/HDFS-10810
> Project: Hadoop HDFS
> Issue Type: Bug
> Reporter: Brahma Reddy Battula
> Assignee: Brahma Reddy Battula
> Attachments: HDFS-10810-002.patch, HDFS-10810-003.patch,
> HDFS-10810.patch
>
>
> 1)Batch IBR is enabled with number of committed blocks allowed=1
> 2) Written one block and closed the file without waiting for IBR
> 3)Setreplication called immediately on the file.
> SO till the finalized IBR Received, this block will be marked as corrupt.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
