[ https://issues.apache.org/jira/browse/YARN-4781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16459919#comment-16459919 ]
Eric Payne commented on YARN-4781: ---------------------------------- I missed one of the two places that needed a check for {{USERLIMIT_FIRST}, so I uploaded a new patch 005. {quote} If more apps are from same user, older one's will be preempted in a fair manner (which means to satisfy a younger app, older apps may give some container each). Am I correct? {quote} Yes. Basically, youngest containers are preempted from largest apps of the most over-served users > Support intra-queue preemption for fairness ordering policy. > ------------------------------------------------------------ > > Key: YARN-4781 > URL: https://issues.apache.org/jira/browse/YARN-4781 > Project: Hadoop YARN > Issue Type: Sub-task > Components: scheduler > Reporter: Wangda Tan > Assignee: Eric Payne > Priority: Major > Attachments: YARN-4781.001.patch, YARN-4781.002.patch, > YARN-4781.003.patch, YARN-4781.004.patch, YARN-4781.005.patch > > > We introduced fairness queue policy since YARN-3319, which will let large > applications make progresses and not starve small applications. However, if a > large application takes the queue’s resources, and containers of the large > app has long lifespan, small applications could still wait for resources for > long time and SLAs cannot be guaranteed. > Instead of wait for application release resources on their own, we need to > preempt resources of queue with fairness policy enabled. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org