Ryne Yang created SPARK-27434:
---------------------------------
Summary: memory leak in spark driver
Key: SPARK-27434
URL: https://issues.apache.org/jira/browse/SPARK-27434
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 2.4.0
Environment: OS: Centos 7
JVM:
**_openjdk version "1.8.0_201"_
_OpenJDK Runtime Environment (IcedTea 3.11.0) (Alpine 8.201.08-r0)_
_OpenJDK 64-Bit Server VM (build 25.201-b08, mixed mode)_
Spark version: 2.4.0
Reporter: Ryne Yang
we got a OOM exception on the driver after driver has completed multiple
jobs(we are reusing spark context).
so we took a heap dump and looked at the leak analysis, found out that under
AsyncEventQueue there are 3.5GB of heap allocated. Possibly a leak.
can someone take a look at?
here is the heap analysis:
!image-2019-04-10-12-24-03-184.png!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
