GitHub user NiharS opened a pull request:
https://github.com/apache/spark/pull/22192
[SPARK-24918] Executor Plugin API
A continuation of @squito's executor plugin task. By his request I took his
code and added testing and moved the plugin initialization to a separate thread.
## What changes were proposed in this pull request?
Executor plugins now run on one separate thread, so the executor does not
wait on them. Added testing.
## How was this patch tested?
Added test cases that test using a sample plugin.
Please review http://spark.apache.org/contributing.html before opening a
pull request.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/NiharS/spark executorPlugin
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/22192.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #22192
----
commit 44454dd586e35bdf16492c4a8969494bd3b7f8f5
Author: Nihar Sheth <niharrsheth@...>
Date: 2018-08-20T17:53:37Z
[SPARK-24918] Executor Plugin API
This commit adds testing and moves the plugin initialization to
a separate thread.
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
