Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/21518#discussion_r208613943
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/UnsafeRowSerializerSuite.scala
---
@@ -45,6 +44,14 @@ class ClosableByteArrayInputStream(buf: Array[Byte])
extends ByteArrayInputStrea
class UnsafeRowSerializerSuite extends SparkFunSuite with
LocalSparkContext {
+ override def beforeAll() {
+ super.beforeAll()
+ // This test suite calls `UnsafeProjection.create` which accesses
`SQLConf.get`, we should make
+ // sure active session is cleaned so that `SQLConf.get` won't refer to
a stopped session.
+ SparkSession.clearActiveSession()
+ SparkSession.clearDefaultSession()
--- End diff --
@praetp yeah I think so, you probably also need to call
`clearActiveSession()` and `clearDefaultSession()` in your `afterEach()` in
your tests (or similar).
If that doesn't work, might be best to open a thread on
[email protected] with more details.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
