GitHub user zuotingbing opened a pull request:
https://github.com/apache/spark/pull/19034
[SPARK-21821][CORE]Support to force kill the CoarseGrainedExecutorBackend
process which is likely be orphaned.
## What changes were proposed in this pull request?
In out production environments, it often happens that even the application
has finished, but the CoarseGrainedExecutorBackend process still exists and
take up the resource.
Take a look at ExecutorRunner.scala, it maybe failed to terminate process
in killProcess method for some reason. In this case, the process of
CoarseGrainedExecutorBackend will likely be orphaned. It would be great to
support a script to kill the CoarseGrainedExecutorBackend process forcibly.
## How was this patch tested?
manual tests
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/zuotingbing/spark SPARK-21821
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/19034.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #19034
----
commit 00955e5a86db5acf4d7ff05135e135a807273b70
Author: zuotingbing <[email protected]>
Date: 2017-08-24T06:47:10Z
[SPARK-21821][CORE]Support to force kill the CoarseGrainedExecutorBackend
process which is likely be orphaned.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
