Łukasz Pińkowski created SPARK-28882:
----------------------------------------

             Summary: Memory leak when stopping spark session
                 Key: SPARK-28882
                 URL: https://issues.apache.org/jira/browse/SPARK-28882
             Project: Spark
          Issue Type: Bug
          Components: Spark Core
    Affects Versions: 2.4.3
            Reporter: Łukasz Pińkowski


When calling stop() method on spark session underlying SparkContext is being 
stopped.

It causes also stop of underlying ContextCleaner thread, usually before it is 
able to clean all context objects (not all of them are returned to 
ReferenceQueue by GC). It causes memory leak because this ReferenceQueue is 
never collected by GC.



--
This message was sent by Atlassian Jira
(v8.3.2#803003)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to