[
https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15589980#comment-15589980
]
Eric Payne commented on YARN-2009:
----------------------------------
[~sunilg], thanks for the updated patch.
There is a problem with preemption when multiple users are in the same queue.
Consider the following use case:
- {{user1}} starts {{app1}} at priority 1 and consumes the entire queue with
long-running containers. {{app1}} has many pending resources.
- {{user2}} starts {{app2}} at priority 2. {{app2}} has many pending resources.
- Intra-queue preemption monitor preempts containers from {{app1}} until both
{{app1}} and {{app2}} have equal resources.
However, the the intra-queue preemption monitor doesn't stop there. It
continues to preempt containers from {{app1}}, which are given back to {{app1}}
by the scheduler.
> Priority support for preemption in ProportionalCapacityPreemptionPolicy
> -----------------------------------------------------------------------
>
> Key: YARN-2009
> URL: https://issues.apache.org/jira/browse/YARN-2009
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: capacityscheduler
> Reporter: Devaraj K
> Assignee: Sunil G
> Attachments: YARN-2009.0001.patch, YARN-2009.0002.patch,
> YARN-2009.0003.patch, YARN-2009.0004.patch, YARN-2009.0005.patch,
> YARN-2009.0006.patch, YARN-2009.0007.patch, YARN-2009.0008.patch,
> YARN-2009.0009.patch, YARN-2009.0010.patch, YARN-2009.0011.patch
>
>
> While preempting containers based on the queue ideal assignment, we may need
> to consider preempting the low priority application containers first.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
