Mukul Murthy created SPARK-25182:
------------------------------------
Summary: Block Manager master and slave thread pools are unbounded
Key: SPARK-25182
URL: https://issues.apache.org/jira/browse/SPARK-25182
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 2.3.0
Reporter: Mukul Murthy
Currently, BlockManagerMasterEndpoint and BlockManagerSlaveEndpoint both have
thread pools with unbounded numbers of threads. In certain cases, this can lead
to driver OOM errors. We should add an upper bound on the number of threads in
these thread pools; this should not break any existing behavior because they
still have queues of size Integer.MAX_VALUE.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
