GitHub user vundela opened a pull request:
https://github.com/apache/spark/pull/9866
[SPARK-11801][CORE] Notify driver when OOM is thrown before executor â¦
â¦JVM is killed
This fix try to make sure that task which caught OOM will update its status
to driver so that driver logs will have enough information why the tasks are
lost or executor is lost. This fix does the following
1) Registers a shutdown hook for executor which does the following
a) Synchronizes with OOM handler thread (Assumption is that OOM
thread is still running and gets the lock prior to the shutdown hook thread. I
thought of introducing some delay, but my runs with fix several times didn't
get to that situation.)
b) Kill all the remaining tasks running in the current container(
I thought it would be good to clean the task properly, so that they wont do any
job which might throw unwanted error/exceptions)
c) Sleeps some time so that OOM handler status is flushed to
driver(No sleeping causes the status message lost)
2) Separate handler for OOM, so that we can send proper message to driver.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/vundela/spark SPARK-11801
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/9866.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #9866
----
commit aa4ba96c5d42669d3bf9e2f52a202345d2cc2210
Author: Srinivasa Reddy Vundela <[email protected]>
Date: 2015-11-20T19:30:20Z
[SPARK-11801][CORE] Notify driver when OOM is thrown before executor JVM is
killed
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
