dragon created HDFS-10092:
-----------------------------
Summary: CLONE - NN should consider current EC tasks handling
count from DN while assigning new tasks
Key: HDFS-10092
URL: https://issues.apache.org/jira/browse/HDFS-10092
Project: Hadoop HDFS
Issue Type: Sub-task
Components: datanode, namenode
Reporter: dragon
Assignee: Uma Maheswara Rao G
Fix For: HDFS-7285
Currently NN will pick the (maxStreams-XmitsCount) number of ECtasks at a time
for assigning to the respective DN.
{code}
//get datanode commands
final int maxTransfer = blockManager.getMaxReplicationStreams()
- xmitsInProgress;
{code}
But right now we increment xmitsInProgress count at DN only for regular
replication tasks but not for ECWorker tasks.
So, either we should treat this logic separately for EC or we should consider
EC current task handling count form DN.
This jira for discussing more for this case.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)