Andrew Wang created HDFS-11023:
----------------------------------
Summary: I/O based throttling of DN replication work
Key: HDFS-11023
URL: https://issues.apache.org/jira/browse/HDFS-11023
Project: Hadoop HDFS
Issue Type: Sub-task
Components: erasure-coding
Affects Versions: 3.0.0-alpha1
Reporter: Andrew Wang
Datanode recovery work is currently throttled based on the number of blocks to
be recovered. This is fine in a replicated world, since each block is equally
expensive to recover. However, EC blocks are much more expensive to recover,
and the amount depends on the EC policy.
It'd be better to have recovery throttles that accounted for the amount of I/O
rather than just the # of blocks.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
