yimeng created HDFS-14988:
-----------------------------
Summary: HDFS should avoid read/write data from slow disks.
Key: HDFS-14988
URL: https://issues.apache.org/jira/browse/HDFS-14988
Project: Hadoop HDFS
Issue Type: Improvement
Components: block placement, datanode
Affects Versions: 3.2.1, 3.1.1
Reporter: yimeng
Slow disk causes real-time service(such as HBase ) become slowdown.
The slow disk detection is added to the HDFS-11461, but only the slow disk is
recorded in the Metric. I hope to further handle the detected slow disk. In my
view, the slow disk can be added to the read data policy. If the block is on
the slow disk of the DataNode, the block of other DataNodes is selected. For
write data, slow disks can be added to the data write policy. We can remove the
slow disk from all disks and then select a disk to write data based on
dfs.datanode.fsdataset.volume.choosing.policy.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
