GitHub user xuanyuanking opened a pull request:
https://github.com/apache/spark/pull/21945
[SPARK-24989][Core] Add retrying support for OutOfDirectMemoryError
## What changes were proposed in this pull request?
As the detailed description in
[SPARK-24989](https://issues.apache.org/jira/browse/SPARK-24989), add retrying
support in RetryingBlockFetcher while get io.netty.maxDirectMemory. The failed
stages detail attached below:
## How was this patch tested?
Add UT in RetryingBlockFetcherSuite.java and test in the job above
mentioned.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/xuanyuanking/spark SPARK-24989
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/21945.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #21945
----
commit bb6841b3a7a160e252fe35dab82f4ddeb0032591
Author: Yuanjian Li <xyliyuanjian@...>
Date: 2018-08-01T16:15:09Z
[SPARK-24989][Core] Add retry support for OutOfDirectMemoryError
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
