[
https://issues.apache.org/jira/browse/YARN-373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alejandro Abdelnur resolved YARN-373.
-------------------------------------
Resolution: Won't Fix
[doing self-clean up of JIRAs]
> Allow an AM to reuse the resources allocated to container for a new container
> -----------------------------------------------------------------------------
>
> Key: YARN-373
> URL: https://issues.apache.org/jira/browse/YARN-373
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: resourcemanager
> Affects Versions: 2.0.3-alpha
> Reporter: Alejandro Abdelnur
> Assignee: Alejandro Abdelnur
>
> When a container completes, instead the corresponding resources being freed
> up, it should be possible for the AM to reuse the assigned resources for a
> new container.
> As part of the reallocation, the AM would notify the RM about partial
> resources being freed up and the RM would make the necessary corrections in
> the corresponding node.
> With this functionality, an AM can ensure it gets a container in the same
> node where previous containers run.
> This will allow getting rid of the ShuffleHandler as a service in the NMs and
> run it as regular container task of the corresponding AM. In this case, the
> reallocation would reduce the CPU/MEM obtained for the original container to
> the what is needed for serving the shuffle. Note that in this example the MR
> AM would only do this reallocation for one of the many tasks that may have
> run in a particular node (as a single shuffle task could serve all the map
> outputs from all map tasks run in that node).
--
This message was sent by Atlassian JIRA
(v6.2#6252)