Łukasz Pińkowski created SPARK-28882:
----------------------------------------
Summary: Memory leak when stopping spark session
Key: SPARK-28882
URL: https://issues.apache.org/jira/browse/SPARK-28882
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 2.4.3
Reporter: Łukasz Pińkowski
When calling stop() method on spark session underlying SparkContext is being
stopped.
It causes also stop of underlying ContextCleaner thread, usually before it is
able to clean all context objects (not all of them are returned to
ReferenceQueue by GC). It causes memory leak because this ReferenceQueue is
never collected by GC.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]