[
https://issues.apache.org/jira/browse/HDFS-16423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17478312#comment-17478312
]
qinyuren commented on HDFS-16423:
---------------------------------
Hi [~weichiu] , the problem we described in HDFS-16420 was not related with
HDFS-12914. The problem happened because:
# Balancer copied the replica without deleting the replica from source node
after namenode HA.
# We have no set {color:#de350b}BlockPlacementPolicyRackFaultTolerant{color}
in balancer configuration, resulting in multiple copies of ec internal block
{color:#de350b}in the same rack{color}.
# Trigger namenode bug as described in
([https://github.com/apache/hadoop/pull/3880)] resulting in missing blocks.
> balancer should not get blocks on stale storages
> ------------------------------------------------
>
> Key: HDFS-16423
> URL: https://issues.apache.org/jira/browse/HDFS-16423
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: balancer & mover
> Reporter: qinyuren
> Assignee: qinyuren
> Priority: Major
> Labels: pull-request-available
> Attachments: image-2022-01-13-17-18-32-409.png
>
> Time Spent: 2h 20m
> Remaining Estimate: 0h
>
> We have met a problems as described in HDFS-16420
> We found that balancer copied a block multi times without deleting the source
> block if this block was placed in a stale storage. And resulting a block with
> many copies, but these redundant copies are not deleted until the storage
> become not stale.
>
> !image-2022-01-13-17-18-32-409.png|width=657,height=275!
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
