[
https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13767639#comment-13767639
]
Bikas Saha commented on YARN-1197:
----------------------------------
YARN allocates containers and manages them. I dont think it would be possible
to change YARN to allow the app to get N containers, merge them and then launch
just 1 container.
Again, the app could accumulate small containers on a node and then merge them
or the RM could accumulate resources on a node and assign a container to the
app. The end result is the same but IMO the chances of a converging solution
are much higher if the RM does it and not the app. (because of point 2 in your
comments about small requests)
For YARN, increasing a running container size would be almost the same as
assigning another container on the same node so that the new container may be
merged with the running container. So a better feature request is to allow
increase in container capacity for an allocated container.
I would suggest that you look at the long running services jira YARN-896.
Please check if the items there cover your scenarios. If not then please
consider whether your feature request should actually be allowing increase of
resources to an allocated container. If you agree then we can change the title
of this jira to reflect that and link it to YARN-896.
> Add container merge support in YARN
> -----------------------------------
>
> Key: YARN-1197
> URL: https://issues.apache.org/jira/browse/YARN-1197
> Project: Hadoop YARN
> Issue Type: Task
> Components: api, nodemanager, resourcemanager
> Affects Versions: 2.1.0-beta
> Reporter: Wangda Tan
>
> Currently, YARN cannot support merge several containers in one node to a big
> container, which can make us incrementally ask resources, merge them to a
> bigger one, and launch our processes. The user scenario is described in the
> comments.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
