[
https://issues.apache.org/jira/browse/YARN-6808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16085184#comment-16085184
]
Arun Suresh edited comment on YARN-6808 at 7/13/17 5:03 AM:
------------------------------------------------------------
[~haibochen], the plan is to use it to provide stricter guaranteed-capacity to
apps, at the same time allow for preemption to be lazily performed at the NM. I
guess YARN-1015 / YARN-1013 can be viewed as something complementary. My
understanding is that in the later case, the scheduler would allocate OPP
containers to a specific node based on unused allocated resources. While, with
this patch, OPP containers will be allocated if an app requests resources
beyond its available headroom.
was (Author: asuresh):
[~haibochen], the plan to use it to provide stricter capacity guarantees to
queue, essentially push preemption to the NM. I guess YARN-1015 / YARN-1013 can
be viewed as something complementary. My understanding is that in the later
case, the scheduler would allocate OPP containers to a specific node based on
unused allocated resources. While, with this patch, OPP containers will be
allocated if an app requests resources beyond its available headroom.
> Allow Schedulers to return OPPORTUNISTIC containers when queues go over
> configured capacity
> -------------------------------------------------------------------------------------------
>
> Key: YARN-6808
> URL: https://issues.apache.org/jira/browse/YARN-6808
> Project: Hadoop YARN
> Issue Type: New Feature
> Reporter: Arun Suresh
> Assignee: Arun Suresh
> Attachments: YARN-6808.001.patch
>
>
> This is based on discussions with [~kasha] and [~kkaranasos].
> Currently, when a Queues goes over capacity, apps on starved queues must wait
> either for containers to complete or for them to be pre-empted by the
> scheduler to get resources.
> This JIRA proposes to allow Schedulers to:
> # Allocate all containers over the configured queue capacity/weight as
> OPPORTUNISTIC.
> # Auto-promote running OPPORTUNISTIC containers of apps as and when their
> GUARANTEED containers complete.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
