[
https://issues.apache.org/jira/browse/HDFS-16735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shuyan Zhang updated HDFS-16735:
--------------------------------
Description: HeartbeatManager only processes one dead datanode (and failed
storage) per round in heartbeatCheck(), that is to say, if there are ten failed
storages, all datanode states need to be scanned 10 times, which is unnecessary
and a waste of resources. This patch makes the number of bad storages processed
per scan configurable. (was: HeartbeatManager only processes one dead datanode
(and failed storage) per round in heartbeatCheck(), that is to say, if there
are ten failed storages, all datanode states need to be scanned 10 times, which
is unnecessary. This patch makes the number of bad storages processed per scan
configurable.)
> Reduce the number of HeartbeatManager loops
> -------------------------------------------
>
> Key: HDFS-16735
> URL: https://issues.apache.org/jira/browse/HDFS-16735
> Project: Hadoop HDFS
> Issue Type: Improvement
> Reporter: Shuyan Zhang
> Assignee: Shuyan Zhang
> Priority: Major
> Labels: pull-request-available
>
> HeartbeatManager only processes one dead datanode (and failed storage) per
> round in heartbeatCheck(), that is to say, if there are ten failed storages,
> all datanode states need to be scanned 10 times, which is unnecessary and a
> waste of resources. This patch makes the number of bad storages processed per
> scan configurable.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
