[
https://issues.apache.org/jira/browse/YARN-914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Luke Lu updated YARN-914:
-------------------------
Description:
When NNs are decommissioned for non-fault reasons (capacity change etc.), it's
desirable to minimize the impact to running applications.
Currently if a NM is decommissioned, all running containers on the NM need to
be rescheduled on other NMs. Further more, for finished map tasks, if their map
output are not fetched by the reducers of the job, these map tasks will need to
be rerun as well.
We propose to introduce a mechanism to optionally gracefully decommission a
node manager.
was:
When NNs are decommissioned for non-fault reasons (capacity change etc.), it's
desirable to minimize the impact to running applications.
Currently if a NN is decommissioned, all running containers on the NN need to
be rescheduled on other NNs. Further more, for finished map tasks, if their map
output are not fetched by the reducers of the job, these map tasks will need to
be rerun as well.
We propose to introduce a mechanism to optionally gracefully decommission a
node manager.
> Support graceful decommission of nodemanager
> --------------------------------------------
>
> Key: YARN-914
> URL: https://issues.apache.org/jira/browse/YARN-914
> Project: Hadoop YARN
> Issue Type: Improvement
> Affects Versions: 2.0.4-alpha
> Reporter: Luke Lu
> Assignee: Junping Du
>
> When NNs are decommissioned for non-fault reasons (capacity change etc.),
> it's desirable to minimize the impact to running applications.
> Currently if a NM is decommissioned, all running containers on the NM need to
> be rescheduled on other NMs. Further more, for finished map tasks, if their
> map output are not fetched by the reducers of the job, these map tasks will
> need to be rerun as well.
> We propose to introduce a mechanism to optionally gracefully decommission a
> node manager.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
