[
https://issues.apache.org/jira/browse/SPARK-3413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-3413.
------------------------------
Resolution: Cannot Reproduce
> Spark Blocked due to Executor lost in FIFO MODE
> -----------------------------------------------
>
> Key: SPARK-3413
> URL: https://issues.apache.org/jira/browse/SPARK-3413
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 0.9.2
> Reporter: Patrick Liu
>
> I run spark on yarn.
> Spark scheduler is running in FIFO mode.
> I have 80 worker instances setup. However, as time passes, some worker will
> be lost. (Killed by JVM when OOM, etc).
> But some tasks will still run in those executors.
> Obviously the task will never finished.
> Then the stage will not finish. So the later stages will be blocked.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
