[GitHub] spark pull request #21945: [SPARK-24989][Core] Add retrying support for OutO...

[xuanyuanking]

GitHub user xuanyuanking opened a pull request:

    https://github.com/apache/spark/pull/21945

    [SPARK-24989][Core] Add retrying support for OutOfDirectMemoryError

    ## What changes were proposed in this pull request?
    
    As the detailed description in 
[SPARK-24989](https://issues.apache.org/jira/browse/SPARK-24989), add retrying 
support in RetryingBlockFetcher while get io.netty.maxDirectMemory. The failed 
stages detail attached below:
    
![image](https://user-images.githubusercontent.com/4833765/43534362-c3a934a4-95e9-11e8-9ec1-5f868e04bc07.png)
    
    
    ## How was this patch tested?
    
    Add UT in RetryingBlockFetcherSuite.java and test in the job above 
mentioned.


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/xuanyuanking/spark SPARK-24989

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/spark/pull/21945.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #21945
    
----
commit bb6841b3a7a160e252fe35dab82f4ddeb0032591
Author: Yuanjian Li <xyliyuanjian@...>
Date:   2018-08-01T16:15:09Z

    [SPARK-24989][Core] Add retry support for OutOfDirectMemoryError

----


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org