[ 
https://issues.apache.org/jira/browse/YARN-3891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Siqi Li resolved YARN-3891.
---------------------------
    Resolution: Duplicate
      Assignee: Siqi Li

> Apps are starved for resource due to default FairSharePolicy in Fair Scheduler
> ------------------------------------------------------------------------------
>
>                 Key: YARN-3891
>                 URL: https://issues.apache.org/jira/browse/YARN-3891
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: fairscheduler
>            Reporter: Siqi Li
>            Assignee: Siqi Li
>            Priority: Critical
>
> Based on FairSharePolicy, FSLeafQueue will try to schedule an app that has 
> the lowest resource consumption first.
> However, we have seen some apps that have several thousand reducers stuck at 
> waiting for some newly scheduled mappers to launch. However, it would be very 
> difficult for such apps to get resources if there are many other jobs with 
> low resource consumption and the queue is full.
> If the queue keeps getting new applications, then the stuck reducers would 
> never finish.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to