GitHub user squito opened a pull request:
https://github.com/apache/spark/pull/21185
[SPARK-23894][CORE][SQL] Defensively clear ActiveSession in Executors
Because SparkSession.getActiveSession uses an InheritableThreadLocal,
the ThreadPool in executors might end up inheriting the SparkSession
from a driver thread. This leads to test failures as executors should
never have an active SparkSession. So in local mode, defensively clear
the active session.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/squito/spark SPARK-23894
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/21185.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #21185
----
commit 2a4944ffe5836408b80f9aa06e9b28e57aa16649
Author: Imran Rashid <irashid@...>
Date: 2018-04-27T20:03:14Z
[SPARK-23894][CORE][SQL] Defensively clear ActiveSession in Executors
Because SparkSession.getActiveSession uses an InheritableThreadLocal,
the ThreadPool in executors might end up inheriting the SparkSession
from a driver thread. This leads to test failures as executors should
never have an active SparkSession. So in local mode, defensively clear
the active session.
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
