wuyi created SPARK-41469:
----------------------------
Summary: Task rerun on decommissioned executor can be avoided if
shuffle data has migrated
Key: SPARK-41469
URL: https://issues.apache.org/jira/browse/SPARK-41469
Project: Spark
Issue Type: Improvement
Components: Spark Core
Affects Versions: 3.3.1, 3.2.2, 3.1.3
Reporter: wuyi
Currently, we will always rerun a finished shuffle map task if it once runs the
lost executor. However, in the case of the executor loss is caused by
decommission, the shuffle data might be migrated so that task doesn't need to
rerun.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
