[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15468165#comment-15468165
]
Eric Payne commented on YARN-4945:
----------------------------------
Thanks [~sunilg].
{quote}
bq. if it's already in selectedCandidates, it's because an inter-queue
preemption policy put it there
I think I must give some more clarity for what I am trying to do here. Its
possible that there can be some containers which were selected by
priority/user-limit policy may already be selected from inter-queue policies.
In that case, we need not have to mark them again. Rather we can deduct the
resource directly as its container marked for preemption.
{quote}
OK. I think I see what you are saying.
In {{IntraQueueCandidatesSelector#preemptFromLeastStarvedApp}}:
{code}
if (CapacitySchedulerPreemptionUtils.isContainerAlreadySelected(c,
selectedCandidates)) {
Resources.subtractFrom(toObtainByPartition, c.getAllocatedResource());
continue;
}
{code}
IIUC, you are saying that at this point, {{toObtainByPartition}} contains
requested resources from _both_ inter-queue _and_ intra-queue preemption
policies. So, since this container has already been selected by the inter-queue
policies, skip it, stop tracking its resources in {{toObtainByPartition}} (by
subtracting out the container's size), and keep looking for another container
to mark as preemptable. Is that correct?
-----
Also, I think that priority and user-limit-percent preemption policies should
be separate policies. Do you agree? If so, can we please rename
{{IntraQueueCandidatesSelector}} to something like
{{IntraQueuePriorityCandidatesSelector}}
> [Umbrella] Capacity Scheduler Preemption Within a queue
> -------------------------------------------------------
>
> Key: YARN-4945
> URL: https://issues.apache.org/jira/browse/YARN-4945
> Project: Hadoop YARN
> Issue Type: Bug
> Reporter: Wangda Tan
> Attachments: Intra-Queue Preemption Use Cases.pdf,
> IntraQueuepreemption-CapacityScheduler (Design).pdf, YARN-2009-wip.2.patch,
> YARN-2009-wip.patch, YARN-2009-wip.v3.patch
>
>
> This is umbrella ticket to track efforts of preemption within a queue to
> support features like:
> YARN-2009. YARN-2113. YARN-4781.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
