[ 
https://issues.apache.org/jira/browse/YARN-685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13704116#comment-13704116
 ] 

Devaraj K commented on YARN-685:
--------------------------------

We can reproduce this. In a cluster having multiple NM's, Submit a Job(any Job) 
having some number of reducers whose total memory(i.e resources) required to 
complete the reducers is less than available memory(i.e resources) in the 
cluster. These reducers are not distributing across the cluster, instead they 
are getting assigned to only few nodes.
                
> Capacity Scheduler is not distributing the reducers tasks across the cluster
> ----------------------------------------------------------------------------
>
>                 Key: YARN-685
>                 URL: https://issues.apache.org/jira/browse/YARN-685
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: capacityscheduler
>    Affects Versions: 2.0.4-alpha
>            Reporter: Devaraj K
>
> If we have reducers whose total memory required to complete is less than the 
> total cluster memory, it is not assigning the reducers to all the nodes 
> uniformly(~uniformly). Also at that time there are no other jobs or job tasks 
> running in the cluster.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to