MENG DING updated YARN-4175:
    Attachment: YARN-4175.1.patch

Submit the initial patch for review. Will not kick jenkins as it depends on 
YARN-1509 and YARN-1510.

As mentioned in the previous post, this ticket enhances the DistributedShell 
application to enable the option to start an IPC service in the application 
master. Once started, user can use the Client program to talk to IPC service to 
issue the increase/decrease container resource requests.

More specifically:
* To enable IPC service in the application master, user needs to specify the 
*enable_ipc* option. For example:
{{hadoop org.apache.hadoop.yarn.applications.distributedshell.Client -jar 
 -shell_command "sleep 100000" -num_containers 10 *-enable_ipc*}}

* Once the application has started, user can start a new client and specify the 
*appmaster* option to set the client to the appmaster mode. Under this mode, 
user can specify *application_id*, *container_id*, *action*, 
*container_memory*, *container_vcores* options to request container resizing. 
For example, to increase a container resource, the user can do:
{{hadoop org.apache.hadoop.yarn.applications.distributedshell.Client -appmaster 
-application_id=<app_id> -container_id=<container_id> 
-action=INCREASE_CONTAINER -container_memory=2048 -container_vcores=1}} 

If you want to try this patch, you need to apply YARN-1510 and YARN-1509 first, 
or wait until these two patches are committed.

> Example of use YARN-1197
> ------------------------
>                 Key: YARN-4175
>                 URL: https://issues.apache.org/jira/browse/YARN-4175
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: api, nodemanager, resourcemanager
>            Reporter: Wangda Tan
>            Assignee: MENG DING
>         Attachments: YARN-4175.1.patch
> Like YARN-2609, we need a example program to demonstrate how to use YARN-1197 
> from end-to-end.

This message was sent by Atlassian JIRA

Reply via email to