GitHub user PraveenSeluka opened a pull request:
https://github.com/apache/spark/pull/5233
[SPARK-4069] [YARN] When AppMaster finishes, this change calls AMRMClient
to removeContainer...
Currently Application Master goes down without releasing the containers.
Once AM goes down, YARN kills those containers. This change is to explicitly
remove all container requests made, also release all assigned containers.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/PraveenSeluka/spark master
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/5233.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #5233
----
commit c52bc113aad04122e1e5436c25b2692e4a4a1830
Author: Praveen Seluka <[email protected]>
Date: 2015-03-27T19:36:54Z
When AppMaster finishes, this change calls AMRMClient to
removeContainerRequests and then releaseAssignedContainers before AM goes down
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
