[
https://issues.apache.org/jira/browse/SPARK-10515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14936306#comment-14936306
]
KaiXinXIaoLei commented on SPARK-10515:
---------------------------------------
If the heartbeat receiver kills executors (and new ones are not registered to
replace them), the idle timeout for the old executors will be lost (and then
change a total number of executors requested by Driver), So new ones will be
not to asked to replace them.
For example, executorsPendingToRemove=Set(1), and executor 2 is idle timeout
before a new executor is asked to replace executor 1. Then driver kill executor
2, and sending RequestExecutors to AM. But executorsPendingToRemove=Set(1,2),
So AM doesn't allocate a executor to replace 1.
> When killing executor, the pending replacement executors will be lost
> ---------------------------------------------------------------------
>
> Key: SPARK-10515
> URL: https://issues.apache.org/jira/browse/SPARK-10515
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 1.4.1
> Reporter: KaiXinXIaoLei
> Fix For: 1.6.0
>
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
