vinooganesh opened a new pull request #28128: [SPARK-31354] SparkSession Lifecycle methods to fix memory leak URL: https://github.com/apache/spark/pull/28128 ## What changes were proposed in this pull request? This change introduces the new `terminate()` method on a `SparkSession` instance that marks the session as terminated, cleans up the listener state on the `SparkContext`, and marks the session instance as unusable. The purpose of this PR is 2-fold: 1. Many users have multi-tenant applications which contain multiple `SparkSession` instances. Currently these instances aren't cleaned up and a memory leak exists. 2. This PR also introduces framework to treat the SparkSessions as they were originally intended - lightweight and shortlived "sessions" that are easy to create and tear down. ## How was this patch tested? * Unit test included as a part of the PR
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
