hunshenshi created HDFS-14350:
---------------------------------
Summary: dfs.datanode.ec.reconstruction.threads not take effect
Key: HDFS-14350
URL: https://issues.apache.org/jira/browse/HDFS-14350
Project: Hadoop HDFS
Issue Type: Improvement
Components: datanode
Affects Versions: 3.2.0
Reporter: hunshenshi
Fix For: 3.2.0
In ErasureCodingWorker, stripedReconstructionPool is create by
{code:java}
initializeStripedBlkReconstructionThreadPool(conf.getInt(
DFSConfigKeys.DFS_DN_EC_RECONSTRUCTION_THREADS_KEY,
DFSConfigKeys.DFS_DN_EC_RECONSTRUCTION_THREADS_DEFAULT));
private void initializeStripedBlkReconstructionThreadPool(int numThreads) {
LOG.debug("Using striped block reconstruction; pool threads={}",
numThreads);
stripedReconstructionPool = DFSUtilClient.getThreadPoolExecutor(2,
numThreads, 60, new LinkedBlockingQueue<>(),
"StripedBlockReconstruction-", false);
stripedReconstructionPool.allowCoreThreadTimeOut(true);
}{code}
so stripedReconstructionPool is a ThreadPoolExecutor, and the queue is a
LinkedBlockingQueue, then the active thread is awalys 2, the
dfs.datanode.ec.reconstruction.threads not take effect.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
