[ 
https://issues.apache.org/jira/browse/YARN-2882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Konstantinos Karanasos updated YARN-2882:
-----------------------------------------
    Attachment: YARN-2882-yarn-2877.001.patch

I am uploading a new version of the patch for the GUARANTEED/QUEUEABLE 
containers.

Based on offline discussions with [~asuresh], [~chris.douglas], [~curino], 
[~subru] and [~sriramsrao], we decided to not extend the ContainerType (used to 
differentiate between AM and plain tasks; see YARN-3116) to include the 
GUARANTEED/QUEUEABLE containers distinction.

Instead, we are introducing a new enum type, the *ExecutionType*, to denote 
whether a container will be GUARANTEED or QUEUEABLE.

The main reason behind this decision is that it allows us to characterize a 
container as GUARANTEED or QUEUEABLE, regardless of whether it is an AM 
container or a plain task. Thus, the ExecutionType is now orthogonal to the 
ContainerType of YARN-3116.
Moreover, this differentiation makes it easier to extend the system in the 
future by adding new Execution Types.

Note that ExecutionType is used in both the ResourceRequest (for the AM to 
specify the desired execution/scheduling type) and the ContainerTokenIdentifier 
(used to determine the way a container is actually executed in the NM).

> Introducing container types
> ---------------------------
>
>                 Key: YARN-2882
>                 URL: https://issues.apache.org/jira/browse/YARN-2882
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: nodemanager, resourcemanager
>            Reporter: Konstantinos Karanasos
>            Assignee: Konstantinos Karanasos
>         Attachments: YARN-2882-yarn-2877.001.patch, yarn-2882.patch
>
>
> This JIRA introduces the notion of container types.
> We propose two initial types of containers: guaranteed-start and queueable 
> containers.
> Guaranteed-start are the existing containers, which are allocated by the 
> central RM and are instantaneously started, once allocated.
> Queueable is a new type of container, which allows containers to be queued in 
> the NM, thus their execution may be arbitrarily delayed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to