Xiaoqiao He created HDFS-14882:
----------------------------------
Summary: Consider DataNode load when #getBlockLocation
Key: HDFS-14882
URL: https://issues.apache.org/jira/browse/HDFS-14882
Project: Hadoop HDFS
Issue Type: Improvement
Components: namenode
Reporter: Xiaoqiao He
Assignee: Xiaoqiao He
Currently, we consider load of datanode when #chooseTarget for writer, however
not consider it for reader. Thus, the process slot of datanode could be
occupied by #BlockSender for reader, and disk/network will be busy workload,
then meet some slow node exception. IIRC same case is reported times. Based on
the fact, I propose to consider load for reader same as it did #chooseTarget
for writer.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
