Github user praetp commented on a diff in the pull request:
https://github.com/apache/spark/pull/21518#discussion_r208555306
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/UnsafeRowSerializerSuite.scala
---
@@ -45,6 +44,14 @@ class ClosableByteArrayInputStream(buf: Array[Byte])
extends ByteArrayInputStrea
class UnsafeRowSerializerSuite extends SparkFunSuite with
LocalSparkContext {
+ override def beforeAll() {
+ super.beforeAll()
+ // This test suite calls `UnsafeProjection.create` which accesses
`SQLConf.get`, we should make
+ // sure active session is cleaned so that `SQLConf.get` won't refer to
a stopped session.
+ SparkSession.clearActiveSession()
+ SparkSession.clearDefaultSession()
--- End diff --
@squito @cloud-fan : we are facing similar issues in our own Spark tests.
Are you saying just closing the sparkSession is not enough ?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
