[
https://issues.apache.org/jira/browse/YARN-1013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16526926#comment-16526926
]
Haibo Chen commented on YARN-1013:
----------------------------------
{quote} where is the enforcement flag?
{quote}
It is per ResourceRequest, included in the ExecutionTypeRequest of a
ResourceRequest. Essentially, a RequestRequest can opt out of oversubscription
by setting its enforcement flag to true. (G, false) requests can start eagerly
as O containers, but there is a possibility that the O containers can sometimes
be preempted if the node is running hot. Applications can decide for themselves
what tasks are critical enough that the risk of starting as O containers and
being preempted is not acceptable. YARN-8240 added control on a queue level,
that is, if a queue opts out of oversubscription, all applications running in
the queue will never get Opportunistic containers for their (G, false)
requests.
{quote}Does this considers resource usages for O container or it is just
consider G container usages?
{quote}
The fair scheduler policy (SchedulingPolicy) is plug-able, so FairScheduler
queues can be sorted with O resource usage of the queue in mind.
> CS should watch resource utilization of containers and allocate speculative
> containers if appropriate
> -----------------------------------------------------------------------------------------------------
>
> Key: YARN-1013
> URL: https://issues.apache.org/jira/browse/YARN-1013
> Project: Hadoop YARN
> Issue Type: Sub-task
> Reporter: Arun C Murthy
> Assignee: Weiwei Yang
> Priority: Major
>
> CS should watch resource utilization of containers (provided by NM in
> heartbeat) and allocate speculative containers (at lower OS priority) if
> appropriate.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
