Ryne Yang created SPARK-27434: --------------------------------- Summary: memory leak in spark driver Key: SPARK-27434 URL: https://issues.apache.org/jira/browse/SPARK-27434 Project: Spark Issue Type: Bug Components: Spark Core Affects Versions: 2.4.0 Environment: OS: Centos 7
JVM: **_openjdk version "1.8.0_201"_ _OpenJDK Runtime Environment (IcedTea 3.11.0) (Alpine 8.201.08-r0)_ _OpenJDK 64-Bit Server VM (build 25.201-b08, mixed mode)_ Spark version: 2.4.0 Reporter: Ryne Yang we got a OOM exception on the driver after driver has completed multiple jobs(we are reusing spark context). so we took a heap dump and looked at the leak analysis, found out that under AsyncEventQueue there are 3.5GB of heap allocated. Possibly a leak. can someone take a look at? here is the heap analysis: !image-2019-04-10-12-24-03-184.png! -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org