Sital Kedia created SPARK-22312:
-----------------------------------
Summary: Spark job stuck with no executor due to bug in Executor
Allocation Manager
Key: SPARK-22312
URL: https://issues.apache.org/jira/browse/SPARK-22312
Project: Spark
Issue Type: Bug
Components: Scheduler
Affects Versions: 2.2.0
Reporter: Sital Kedia
We often see the issue of Spark jobs stuck because the Executor Allocation
Manager does not ask for any executor even if there are pending tasks in case
dynamic allocation is turned on. Looking at the logic in EAM which calculates
the running tasks, it can happen that the calculation will be wrong and the
number of running tasks can become negative.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]