Robert Kruszewski created SPARK-20952:
-----------------------------------------
Summary: TaskContext should be an InheritableThreadLocal
Key: SPARK-20952
URL: https://issues.apache.org/jira/browse/SPARK-20952
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 2.1.1
Reporter: Robert Kruszewski
Priority: Minor
TaskContext is a ThreadLocal as a result when you fork a thread inside your
executor task you lose the handle on the original context set by the executor.
We should change it to InheritableThreadLocal so we can access it inside thread
pools on executors.
See ParquetFileFormat#readFootersInParallel for example of code that uses
thread pools inside the tasks.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
