[
https://issues.apache.org/jira/browse/HDFS-8391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Uma Maheswara Rao G updated HDFS-8391:
--------------------------------------
Attachment: HDFS-8391-01.patch
Attached a simple patch for increment counts even in the case of EC
reconstruction.
> NN should consider current EC tasks handling count from DN while assigning
> new tasks
> ------------------------------------------------------------------------------------
>
> Key: HDFS-8391
> URL: https://issues.apache.org/jira/browse/HDFS-8391
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: datanode, namenode
> Reporter: Uma Maheswara Rao G
> Assignee: Uma Maheswara Rao G
> Attachments: HDFS-8391-01.patch
>
>
> Currently NN will pick the (maxStreams-XmitsCount) number of ECtasks at a
> time for assigning to the respective DN.
> {code}
> //get datanode commands
> final int maxTransfer = blockManager.getMaxReplicationStreams()
> - xmitsInProgress;
> {code}
> But right now we increment xmitsInProgress count at DN only for regular
> replication tasks but not for ECWorker tasks.
> So, either we should treat this logic separately for EC or we should consider
> EC current task handling count form DN.
> This jira for discussing more for this case.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
