[ https://issues.apache.org/jira/browse/SPARK-23287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16388885#comment-16388885 ]
Apache Spark commented on SPARK-23287: -------------------------------------- User 'devaraj-kavali' has created a pull request for this issue: https://github.com/apache/spark/pull/20754 > Spark scheduler does not remove initial executor if not one job submitted > ------------------------------------------------------------------------- > > Key: SPARK-23287 > URL: https://issues.apache.org/jira/browse/SPARK-23287 > Project: Spark > Issue Type: Bug > Components: Mesos, Scheduler > Affects Versions: 2.2.1 > Environment: Cluster manager - Mesos 1.4.1 > Spark 2.2.1 > spark app configuration: > spark.dynamicAllocation.minExecutors=0 > spark.dynamicAllocation.executorIdleTimeout=25s > spark.dynamicAllocation.initialExecutors=1 > spark.dynamicAllocation.schedulerBacklogTimeout=4s > spark.dynamicAllocation.sustainedSchedulerBacklogTimeout=5s > Reporter: Pavel Plotnikov > Priority: Minor > > When spark application submitted it deploy initial number of executors. If > none of job has been submitted to application spark doesn't remove initial > executor. > > Cluster manager - Mesos 1.4.1 > Spark 2.2.1 > spark app configuration: > spark.dynamicAllocation.minExecutors=0 > spark.dynamicAllocation.executorIdleTimeout=25s > spark.dynamicAllocation.initialExecutors=1 > spark.dynamicAllocation.schedulerBacklogTimeout=4s > spark.dynamicAllocation.sustainedSchedulerBacklogTimeout=5s -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org