[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15236305#comment-15236305
]
Wangda Tan commented on YARN-4945:
----------------------------------
Some rough ideas about design:
In general, after YARN-4822, we can implement and active new intra-queue
preemption candidate selector according to queue's policy.
There're a couple of things that needs to think more:
- Compute ideal resource allocation of applications: Currently we only support
calculating queue's ideal resource allocation. We should calculate apps' ideal
allocation as well.
- Configuration of intra-queue preemption: we should be able to turn on/off
intra/inter queue preemption separately.
- When intra-queue preemption can happen: in some cases, we need intra-queue
preemption happen when queue is under its guaranteed resource, and we also need
to make sure no excessive preemption (like crossfire between apps) happens.
- Priorities of intra-queue preemption and inter-queue preemption. Intra-queue
preemption should happen after inter-queue preemption, IAW, in an
under-satisfied queue, an app should prefer to get resources from an
over-satisfied queue instead of from other apps in the same queue.
+ [~sunilg], [~eepayne].
> [Umbrella] Capacity Scheduler Preemption Within a queue
> -------------------------------------------------------
>
> Key: YARN-4945
> URL: https://issues.apache.org/jira/browse/YARN-4945
> Project: Hadoop YARN
> Issue Type: Bug
> Reporter: Wangda Tan
>
> This is umbrella ticket to track efforts of preemption within a queue to
> support features like:
> YARN-2009. YARN-2113. YARN-4781.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
