Pavel Plotnikov created SPARK-23287:
---------------------------------------
Summary: Spark scheduler does not remove initial executor if not
one job submitted
Key: SPARK-23287
URL: https://issues.apache.org/jira/browse/SPARK-23287
Project: Spark
Issue Type: Bug
Components: Scheduler
Affects Versions: 2.2.1
Environment: Cluster manager - Mesos 1.4.1
Spark 2.2.1
spark app configuration:
spark.dynamicAllocation.minExecutors=0
spark.dynamicAllocation.executorIdleTimeout=25s
spark.dynamicAllocation.initialExecutors=1
spark.dynamicAllocation.schedulerBacklogTimeout=4s
spark.dynamicAllocation.sustainedSchedulerBacklogTimeout=5s
Reporter: Pavel Plotnikov
When spark application submitted it asquare initial number of executors. If no
one job was submitted to application spark didn't remove initial executor.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
