[ 
https://issues.apache.org/jira/browse/HDFS-8543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14578160#comment-14578160
 ] 

Walter Su commented on HDFS-8543:
---------------------------------

The problem of the old code: Assume blockGroup=\[0, 1, 2, 3\]. We lose idx=2, 
and are left \[0, 1, 3\]. After recovery, we get\[0, 1, 2, 3\]. Assume dead DN 
comes back. We have\[0, 1, 2, 3, 2\]. The old processOverReplicatedBlock() may 
delete idx=1, so we are left \[0, 2, 3, 2\], we have to recover it again. It 
could be an endless loop.

> Erasure Coding: processOverReplicatedBlock() handles striped block
> ------------------------------------------------------------------
>
>                 Key: HDFS-8543
>                 URL: https://issues.apache.org/jira/browse/HDFS-8543
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Walter Su
>            Assignee: Walter Su
>         Attachments: HDFS-8543-HDFS-7285.01.patch
>
>
> striped block group could be over replicated when: 1.dead DN comes back. 2. 
> Balancer/Mover copies block before deletes it.
> This jira add logic for processOverReplicatedBlock() handling striped block



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to