[ https://issues.apache.org/jira/browse/SPARK-25814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sean Owen resolved SPARK-25814. ------------------------------- Resolution: Duplicate I think there are a few related items that this could be a duplicate of; picked one here. > spark driver runs out of memory on org.apache.spark.util.kvstore.InMemoryStore > ------------------------------------------------------------------------------ > > Key: SPARK-25814 > URL: https://issues.apache.org/jira/browse/SPARK-25814 > Project: Spark > Issue Type: Bug > Components: Spark Core > Affects Versions: 2.2.2, 2.3.2 > Reporter: Ruslan Dautkhanov > Priority: Major > Labels: driver, memory-analysis, memory-leak, statestore > Attachments: image-2018-10-23-14-06-53-722.png > > > We're looking into issue when even huge spark driver memory gets eventually > exhausted and GC makes driver stop responding. > Used [JXRay.com|http://jxray.com/] tool and found that most of driver heap is > used by > > {noformat} > org.apache.spark.status.AppStatusStore > -> org.apache.spark.status.ElementTrackingStore > -> org.apache.spark.util.kvstore.InMemoryStore > > {noformat} > > Is there is a way to tune this particular spark driver's memory region down? > > > !image-2018-10-23-14-06-53-722.png! > -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org