BELUGA BEHR created HDFS-14295:
----------------------------------
Summary: Add Threadpool for DataTransfers
Key: HDFS-14295
URL: https://issues.apache.org/jira/browse/HDFS-14295
Project: Hadoop HDFS
Issue Type: Improvement
Components: datanode
Affects Versions: 3.2.0
Reporter: BELUGA BEHR
When a DataNode data transfers a block, is spins up a new thread for each
transfer.
[Here|https://github.com/apache/hadoop/blob/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java#L2339]
and
[Here|https://github.com/apache/hadoop/blob/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java#L3019-L3022].
Instead, add the threads to a {{CachedThreadPool}} so that when their
threads complete the transfer, they can be re-used for another transfer. This
should save resources spent on creating and spinning up transfer threads.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
