Myroslav Lisniak created SPARK-23670:

             Summary: Memory leak of SparkPlanGraphWrapper in sparkUI
                 Key: SPARK-23670
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 2.3.0
            Reporter: Myroslav Lisniak

Memory leak on driver for a long time running application. We have application 
using structured streaming and running 48 hours. But driver fails with out of 
memory after 25 hours. After investigating heap dump we found that most of the 
memory was occupied with a lot of *SparkPlanGraphWrapper* objects inside 

 Application was run with option: 
--driver-memory 4G

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

Reply via email to