Github user gaborgsomogyi commented on the issue:
https://github.com/apache/spark/pull/19893
> Those try to keep the same session alive for multiple suites
Good point to make this part clear.
As a first step I've taken a look at the code and as I see SparkSession as
well as SQLContext recreated between different suites. They're shared inside a
suite. Have I missed something?
```
Class: org.apache.spark.sql.test.GenericFlatSpecSuite SparkSession:
org.apache.spark.sql.test.TestSparkSession@1b5bc39d SQLContext:
org.apache.spark.sql.SQLContext@655a5d9c
Class: org.apache.spark.sql.test.GenericWordSpecSuite SparkSession:
org.apache.spark.sql.test.TestSparkSession@53cddaf8 SQLContext:
org.apache.spark.sql.SQLContext@55c50f52
Class: org.apache.spark.sql.test.GenericFunSpecSuite SparkSession:
org.apache.spark.sql.test.TestSparkSession@22ff1372 SQLContext:
org.apache.spark.sql.SQLContext@356341c9
Class: org.apache.spark.sql.test.DataFrameReaderWriterSuite SparkSession:
org.apache.spark.sql.test.TestSparkSession@2c02a007 SQLContext:
org.apache.spark.sql.SQLContext@63a72cc6
```
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
