GitHub user robert3005 opened a pull request:
https://github.com/apache/spark/pull/18176
[SPARK-20952] Make TaskContext an InheritableTheadLocal
## What changes were proposed in this pull request?
Make TaskContext reference an InheritableTheadLocal so thread pools spun up
inside tasks have access to the reference
## How was this patch tested?
Added tests
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/palantir/spark rk/inheritable-thread-local
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/18176.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #18176
----
commit 91abcbd6ab4c164c4b41f4647728b82d6bc28402
Author: Robert Kruszewski <[email protected]>
Date: 2017-06-01T17:32:38Z
inheritable thead locals
commit c631037afbdc363c968c6d4cd641393a7213e476
Author: Robert Kruszewski <[email protected]>
Date: 2017-06-01T17:45:39Z
and a test
commit 06405ef8983e22af78a9166a02d757557d16b84b
Author: Robert Kruszewski <[email protected]>
Date: 2017-06-01T17:49:21Z
fix test exception
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
