[
https://issues.apache.org/jira/browse/HDFS-8391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Uma Maheswara Rao G resolved HDFS-8391.
---------------------------------------
Resolution: Fixed
Fix Version/s: HDFS-7285
Hadoop Flags: Reviewed
> NN should consider current EC tasks handling count from DN while assigning
> new tasks
> ------------------------------------------------------------------------------------
>
> Key: HDFS-8391
> URL: https://issues.apache.org/jira/browse/HDFS-8391
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: datanode, namenode
> Reporter: Uma Maheswara Rao G
> Assignee: Uma Maheswara Rao G
> Fix For: HDFS-7285
>
> Attachments: HDFS-8391-01.patch
>
>
> Currently NN will pick the (maxStreams-XmitsCount) number of ECtasks at a
> time for assigning to the respective DN.
> {code}
> //get datanode commands
> final int maxTransfer = blockManager.getMaxReplicationStreams()
> - xmitsInProgress;
> {code}
> But right now we increment xmitsInProgress count at DN only for regular
> replication tasks but not for ECWorker tasks.
> So, either we should treat this logic separately for EC or we should consider
> EC current task handling count form DN.
> This jira for discussing more for this case.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)