[ https://issues.apache.org/jira/browse/YARN-3891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Siqi Li resolved YARN-3891. --------------------------- Resolution: Duplicate Assignee: Siqi Li > Apps are starved for resource due to default FairSharePolicy in Fair Scheduler > ------------------------------------------------------------------------------ > > Key: YARN-3891 > URL: https://issues.apache.org/jira/browse/YARN-3891 > Project: Hadoop YARN > Issue Type: Bug > Components: fairscheduler > Reporter: Siqi Li > Assignee: Siqi Li > Priority: Critical > > Based on FairSharePolicy, FSLeafQueue will try to schedule an app that has > the lowest resource consumption first. > However, we have seen some apps that have several thousand reducers stuck at > waiting for some newly scheduled mappers to launch. However, it would be very > difficult for such apps to get resources if there are many other jobs with > low resource consumption and the queue is full. > If the queue keeps getting new applications, then the stuck reducers would > never finish. -- This message was sent by Atlassian JIRA (v6.3.4#6332)