[
https://issues.apache.org/jira/browse/YARN-3933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16355169#comment-16355169
]
stefanlee edited comment on YARN-3933 at 2/7/18 8:59 AM:
---------------------------------------------------------
Because of *Needy* in *FairSharePolicy* , Whether a queue has negative used
resource can lead to FairScheduler do not assign containers to any other
queues in many scheduler rounds or not? [~yufeigu] [~djp] [~kasha]
was (Author: imstefanlee):
Because of **Needy** in **FairSharePolicy** , Whether a queue has negative
used resource can lead to FairScheduler do not assign containers to any other
queues in many scheduler rounds or not? [~yufeigu] [~djp] [~kasha]
> FairScheduler: Multiple calls to completedContainer are not safe
> ----------------------------------------------------------------
>
> Key: YARN-3933
> URL: https://issues.apache.org/jira/browse/YARN-3933
> Project: Hadoop YARN
> Issue Type: Bug
> Components: fairscheduler
> Affects Versions: 2.7.1
> Reporter: Lavkesh Lahngir
> Assignee: Shiwei Guo
> Priority: Major
> Labels: oct16-medium
> Fix For: 2.8.0, 3.0.0-alpha4
>
> Attachments: YARN-3933.001.patch, YARN-3933.002.patch,
> YARN-3933.003.patch, YARN-3933.004.patch, YARN-3933.005.patch,
> YARN-3933.006.patch, yarn-3933-branch-2.8.patch
>
>
> In our cluster we are seeing available memory and cores being negative.
> Initial inspection:
> Scenario no. 1:
> In capacity scheduler the method allocateContainersToNode() checks if
> there are excess reservation of containers for an application, and they are
> no longer needed then it calls queue.completedContainer() which causes
> resources being negative. And they were never assigned in the first place.
> I am still looking through the code. Can somebody suggest how to simulate
> excess containers assignments ?
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
