GitHub user shrutig opened a pull request:
https://github.com/apache/spark/pull/21756
[SPARK-24764] [CORE] Add ServiceLoader implementation for SparkHadoopUtil
## What changes were proposed in this pull request?
Currently SparkHadoopUtil creation is static and cannot be changed. This
pull request is to move the creation of SparkHadoopUtil to a ServiceLoader, so
that external cluster managers can create their own SparkHadoopUtil.
## How was this patch tested?
Unit Tests have been added in this commit.
Please review http://spark.apache.org/contributing.html before opening a
pull request.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/shrutig/spark SPARK-24764
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/21756.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #21756
----
commit dd5d92459ea2ce869057492dd6f802cb0479b9cb
Author: Shruti Gumma <shruti_gumma@...>
Date: 2018-05-23T01:03:53Z
Move SparkHadoopUtil creation to ServiceLoader based architecture
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
