[
https://issues.apache.org/jira/browse/HDFS-16958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17705226#comment-17705226
]
ASF GitHub Bot commented on HDFS-16958:
---------------------------------------
zhangshuyan0 commented on PR #5489:
URL: https://github.com/apache/hadoop/pull/5489#issuecomment-1484670476
@tasanuma Thanks for your comment. I think I was wrong before. The chosen of
`excessTypes` should based on healthy replicas.
Assume that the storage policy is ALL_SSD, the real total block num of a
striped block group is 9, and only 8 internal blocks have healthy replicas,
while the total num of healthy replicas is 9. This means one internal block has
redundant replicas and one internal block has no healthy replica. If we choose
`excessTypes` use `numOfTarget`=9, we'll get 9 SSD storage types and can not
find any redundant.
> EC: Fix bug in processing EC excess redundancy
> -----------------------------------------------
>
> Key: HDFS-16958
> URL: https://issues.apache.org/jira/browse/HDFS-16958
> Project: Hadoop HDFS
> Issue Type: Bug
> Reporter: Shuyan Zhang
> Assignee: Shuyan Zhang
> Priority: Major
> Labels: pull-request-available
>
> When processing excess redundancy, the number of internal blocks is computed
> by traversing `nonExcess`. This way is not accurate, because `nonExcess`
> excludes replicas in abnormal states, such as corrupt ones, or maintenance
> ones. `numOfTarget` may be smaller than the actual value, which will result
> in inaccurate generated `excessTypes`.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
