liuguanghua created HDFS-17732:
----------------------------------
Summary: addExpectedReplicasToPending should add EC block
expectedStorages in PendingReconstructionBlocks
Key: HDFS-17732
URL: https://issues.apache.org/jira/browse/HDFS-17732
Project: Hadoop HDFS
Issue Type: Bug
Reporter: liuguanghua
Now when a block is commit , it should add expectedStorages into
PendingReconstructionBlocks if the ibr is not sent from expected locations.
And for ec groups , only blkStriped.getRealTotalBlockNum() ==
expectedStorages.length will be added into PendingReconstructionBlocks.
But the following situations need to be considered：
(1)A EC file with XOR-2-1-1024k，when we write lower than 1024k into the
file，close it.
(2)Now The file has only one ec block group, indics=(0,1,2) and suppose only 0
replica ibr is received. Then the block group commit and will be completed.
(3) When block group commit , blkStriped.getRealTotalBlockNum()=1
expectedStorages.length=3 , so it can not add EC block expectedStorages in
PendingReconstructionBlocks
(4) This will result in the ec group reconstruction
(5) The 1 and 2 replicas ibr is recived.
(6) This maybe lead two same block group indics on same datanode if
reconstruction choose the same datanode
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
