Github user praetp commented on a diff in the pull request:
https://github.com/apache/spark/pull/21518#discussion_r208830232
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/UnsafeRowSerializerSuite.scala
---
@@ -45,6 +44,14 @@ class ClosableByteArrayInputStream(buf: Array[Byte])
extends ByteArrayInputStrea
class UnsafeRowSerializerSuite extends SparkFunSuite with
LocalSparkContext {
+ override def beforeAll() {
+ super.beforeAll()
+ // This test suite calls `UnsafeProjection.create` which accesses
`SQLConf.get`, we should make
+ // sure active session is cleaned so that `SQLConf.get` won't refer to
a stopped session.
+ SparkSession.clearActiveSession()
+ SparkSession.clearDefaultSession()
--- End diff --
Seems like a major resource leakage to me then..
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
