Alejandro Abdelnur resolved YARN-373.

    Resolution: Won't Fix

[doing self-clean up of JIRAs]

> Allow an AM to reuse the resources allocated to container for a new container
> -----------------------------------------------------------------------------
>                 Key: YARN-373
>                 URL: https://issues.apache.org/jira/browse/YARN-373
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: resourcemanager
>    Affects Versions: 2.0.3-alpha
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
> When a container completes, instead the corresponding resources being freed 
> up, it should be possible for the AM to reuse the assigned resources for a 
> new container.
> As part of the reallocation, the AM would notify the RM about partial 
> resources being freed up and the RM would make the necessary corrections in 
> the corresponding node.
> With this functionality, an AM can ensure it gets a container in the same 
> node where previous containers run.
> This will allow getting rid of the ShuffleHandler as a service in the NMs and 
> run it as regular container task of the corresponding AM. In this case, the 
> reallocation would reduce the CPU/MEM obtained for the original container to 
> the what is needed for serving the shuffle. Note that in this example the MR 
> AM would only do this reallocation for one of the many tasks that may have 
> run in a particular node (as a single shuffle task could serve all the map 
> outputs from all map tasks run in that node). 

This message was sent by Atlassian JIRA

Reply via email to