Lantao Jin created SPARK-29972:
----------------------------------
Summary: Manage/trace all spark sessions
Key: SPARK-29972
URL: https://issues.apache.org/jira/browse/SPARK-29972
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 3.0.0
Reporter: Lantao Jin
Current there is no place to trace all live spark sessions in a
non-thrift-server application. For example spark session can be stored in
thread local variable and be garbage collection when user's thread exit. So it
may has some problems like memory leak in an application. Also, seems we don't
have such an action called "close session" in Spark SQL. SparkSession.close
closes the SparkContext and thus closes all sessions.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
