[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eric Payne updated YARN-4945:
-----------------------------
Attachment: Intra-Queue Preemption Use Cases.pdf
[~sunilg] and [~leftnoteasy],
I am attaching the set of use cases that I could think of for in-queue
preemption. I will include the base use-case statements in this comment, but
please do look at the document for details, examples, and open issues for each
use case.
1. Ensure each user in a queue is guaranteed its appropriate
minimum-user-limit-percent
1.1. When one (or more) user(s) are below their minimun-user-limit-percent
and one (or more) user(s) are above their minimum-user-limit-percent, resources
will be preempted after a configurable time period from the user(s) which are
above their minimum-user-limit-percent.
1.2. When two (or more) users are below their minimum-user-limit-factor,
neither will be preempted in favor of the other.
1.3. If all users in a queue are at or over their
minimum-user-limit-percent, the user-limit-percent-preemption policy will not
preempt resources.
2. Ensure priority inversion doesn’t occur between applications.
2.1. When a lower priority app is consuming long-running resources, a higher
priority app is requesting resources, and the queue cannot grow to accommodate
the higher priority app’s request, the priority-intra-queue-preemption policy
will preempt resources from the lower priority app, after a configurable period
of time.
3. Interaction between the priority and minimum-user-limit-percent
preemption policies.
3.1. If priority inversion occurs between apps owned by different users, the
priority preemption policy will not preempt containers from the lower priority
app if it would cause the lower priority app to go below the user’s
minimum-user-limit-percent guarantee.
> [Umbrella] Capacity Scheduler Preemption Within a queue
> -------------------------------------------------------
>
> Key: YARN-4945
> URL: https://issues.apache.org/jira/browse/YARN-4945
> Project: Hadoop YARN
> Issue Type: Bug
> Reporter: Wangda Tan
> Attachments: Intra-Queue Preemption Use Cases.pdf,
> IntraQueuepreemption-CapacityScheduler (Design).pdf, YARN-2009-wip.patch
>
>
> This is umbrella ticket to track efforts of preemption within a queue to
> support features like:
> YARN-2009. YARN-2113. YARN-4781.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
