Yunling Cai created SPARK-25091:
-----------------------------------
Summary: Spark Thrift Server: UNCACHE TABLE and CLEAR CACHE does
not clean up executor memory
Key: SPARK-25091
URL: https://issues.apache.org/jira/browse/SPARK-25091
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 2.3.1
Reporter: Yunling Cai
UNCACHE TABLE and CLEAR CACHE does not clean up executor memory.
Through Spark UI, although in Storage, we see the cached table removed. In
Executor, the executors continue to hold the RDD and the memory is not cleared.
This results in huge waste in executor memory usage. As we call CACHE TABLE, we
run into issues where the cached tables are spilled to disk instead of
reclaiming the memory storage.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
