wuyi created SPARK-33799:
----------------------------
Summary: ExecutorMonitor should handle
SparkListenerExecutorExcluded/SparkListenerNodeExcluded
Key: SPARK-33799
URL: https://issues.apache.org/jira/browse/SPARK-33799
Project: Spark
Issue Type: Improvement
Components: Spark Core
Affects Versions: 3.1.0
Environment:
Reporter: wuyi
Currently, when dynamic-executor-allocation and exclude-on-failure (but
exclude_on_kill_enabled is disabled) are both enabled, the excluded executors
are still counted as available executor for running tasks. But that's obviously
not true.
We could let the ExecutorMonitor handle
SparkListenerExecutorExcluded/SparkListenerNodeExcluded to not count excluded
executors.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
