[ https://issues.apache.org/jira/browse/YARN-1013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16526926#comment-16526926 ]
Haibo Chen commented on YARN-1013: ---------------------------------- {quote} where is the enforcement flag? {quote} It is per ResourceRequest, included in the ExecutionTypeRequest of a ResourceRequest. Essentially, a RequestRequest can opt out of oversubscription by setting its enforcement flag to true. (G, false) requests can start eagerly as O containers, but there is a possibility that the O containers can sometimes be preempted if the node is running hot. Applications can decide for themselves what tasks are critical enough that the risk of starting as O containers and being preempted is not acceptable. YARN-8240 added control on a queue level, that is, if a queue opts out of oversubscription, all applications running in the queue will never get Opportunistic containers for their (G, false) requests. {quote}Does this considers resource usages for O container or it is just consider G container usages? {quote} The fair scheduler policy (SchedulingPolicy) is plug-able, so FairScheduler queues can be sorted with O resource usage of the queue in mind. > CS should watch resource utilization of containers and allocate speculative > containers if appropriate > ----------------------------------------------------------------------------------------------------- > > Key: YARN-1013 > URL: https://issues.apache.org/jira/browse/YARN-1013 > Project: Hadoop YARN > Issue Type: Sub-task > Reporter: Arun C Murthy > Assignee: Weiwei Yang > Priority: Major > > CS should watch resource utilization of containers (provided by NM in > heartbeat) and allocate speculative containers (at lower OS priority) if > appropriate. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org