GitHub user JoshRosen opened a pull request:
https://github.com/apache/spark/pull/7603
[SPARK-9266]
When a task fails with an exception and also fails to properly clean up its
managed memory, the `spark.unsafe.exceptionOnMemoryLeak` memory leak detection
mechanism's exceptions will mask the original exception that caused the task to
fail. We should throw the memory leak exception only if no other exception
occurred.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/JoshRosen/spark SPARK-9266
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/7603.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #7603
----
commit 448eae83c190789e1946f010eecb36ee49d99e4f
Author: Josh Rosen <[email protected]>
Date: 2015-07-22T23:03:43Z
Add regression test
commit c1f01672d3a3862b0a4e99c5658f454f554cfd71
Author: Josh Rosen <[email protected]>
Date: 2015-07-22T23:10:47Z
Fix the error masking problem
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
