vinooganesh commented on pull request #28128:
URL: https://github.com/apache/spark/pull/28128#issuecomment-631653122
Thanks, @cloud-fan and @stczwd. Did some cleanup and added a test.
If anyone was curious, before this PR, running the following
```
SparkSession.builder().master("local").getOrCreate()
SparkSession.clearActiveSession()
SparkSession.clearDefaultSession()
SparkSession.builder().master("local").getOrCreate()
SparkSession.clearActiveSession()
SparkSession.clearDefaultSession()
```
would result in a `SparkContext` with the following listeners on the
listener bus:
```
[org.apache.spark.status.AppStatusListener@5f610071,
org.apache.spark.HeartbeatReceiver@d400c17,
org.apache.spark.sql.SparkSession$$anon$1@25849aeb, <-First instance
org.apache.spark.sql.SparkSession$$anon$1@fadb9a0] <- Second instance
```
After this PR, the execution of the same code above results in
`SparkContext` with the following listeners on the listener bus:
```
[org.apache.spark.status.AppStatusListener@5f610071,
org.apache.spark.HeartbeatReceiver@d400c17,
org.apache.spark.sql.SparkSession$$anon$1@25849aeb] <-One instance
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
