[
https://issues.apache.org/jira/browse/YARN-7424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16235857#comment-16235857
]
Sunil G commented on YARN-7424:
-------------------------------
Thanks [~eepayne] for detailed analysis.
{{"yarn.resourcemanager.monitor.capacity.preemption.intra-queue-preemption.minimum-threshold"}}
could be configured to start intra queue preemption on a queue. But yes, this
is generic in all queues.
{{max-allowable-limit}} helps only to control preemption in a given round of
preemption calculation. This could be configured to a very low value so that
only few resource will be preempted in such cases.
Now the solution which you mentioned will help to control preemption. In a
cluster where we have free space and some users who are over MULP, i think we
can restrict such users to raise demand for preemption. In which preemption
mode, this will be added ? will it be common for both ?
> Capacity Scheduler Intra-queue preemption: add property to only preempt up to
> configured MULP
> ---------------------------------------------------------------------------------------------
>
> Key: YARN-7424
> URL: https://issues.apache.org/jira/browse/YARN-7424
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: capacity scheduler, scheduler preemption
> Affects Versions: 3.0.0-beta1, 2.8.2
> Reporter: Eric Payne
> Assignee: Eric Payne
> Priority: Major
>
> If the queue's configured minimum user limit percent (MULP) is something
> small like 1%, all users will max out well over their MULP until 100 users
> have apps in the queue. Since the intra-queue preemption monitor tries to
> balance the resource among the users, most of the time in this use case it
> will be preempting containers on behalf of users that are already over their
> MULP guarantee.
> This JIRA proposes that a property should be provided so that a queue can be
> configured to only preempt on behalf of a user until that user has reached
> its MULP.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
