[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15471794#comment-15471794
]
Wangda Tan commented on YARN-4945:
----------------------------------
Hi [~eepayne],
Maybe there're some misunderstandings, first of all, I'm not quite sure about
why in step.5, priority-intra-queue preemption policy can select 5 more
resources.
Step.7 is reasonable to me, imbalance between queues has higher priority than
priority inversion within a queue.
In my mind, the whole preemption process will be (as same as your examples)
Assume each queue has total-preemption-per-round, which is the total preemption
allowed for inter-queue + intra-queue preemption.
Step 1-4 will be same as what you described
Step 5 will not happen because there's 10 containers marked for preemption
already.
So Step 4 will be repeated until:
{code}
Queue 1:
User1, Used=100, Pending=50
User2, Used=0, Pending=50
Queue 2: Used=100,
{code}
Once the inter-queue resource usage back to balanced, intra-queue preemption
policy can start to preempt resources.
So the Step 5 will be:
{code}
10 container marked to be preemption for User1 from Queue 1, and after these
container preempted, they will be picked up by User2 from Queue 1.
{code}
[~sunilg] please add your thoughts if you think different.
Thanks,
> [Umbrella] Capacity Scheduler Preemption Within a queue
> -------------------------------------------------------
>
> Key: YARN-4945
> URL: https://issues.apache.org/jira/browse/YARN-4945
> Project: Hadoop YARN
> Issue Type: Bug
> Reporter: Wangda Tan
> Attachments: Intra-Queue Preemption Use Cases.pdf,
> IntraQueuepreemption-CapacityScheduler (Design).pdf, YARN-2009-wip.2.patch,
> YARN-2009-wip.patch, YARN-2009-wip.v3.patch, YARN-2009.v0.patch
>
>
> This is umbrella ticket to track efforts of preemption within a queue to
> support features like:
> YARN-2009. YARN-2113. YARN-4781.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
