Reynold Xin created SPARK-3503: ---------------------------------- Summary: Disable thread local cache in PooledByteBufAllocator Key: SPARK-3503 URL: https://issues.apache.org/jira/browse/SPARK-3503 Project: Spark Issue Type: Sub-task Components: Shuffle Reporter: Reynold Xin Assignee: Reynold Xin
Feedback from Norman. Thread-local caches should be disabled because the ByteBufs are allocated by the event loop thread, but released by the executor thread rather than the event loop thread. Those thread-local caches actually delay the recycling of buffers, leading to larger memory usage. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org