Jiang Xingbo created SPARK-24877:
------------------------------------
Summary: Ignore the task completion event from a zombie barrier
task
Key: SPARK-24877
URL: https://issues.apache.org/jira/browse/SPARK-24877
Project: Spark
Issue Type: Improvement
Components: Spark Core
Affects Versions: 3.0.0
Reporter: Jiang Xingbo
Currently we abort the barrier stage if a zombie barrier task can't get killed
to prevent data correctness issue. We can improve the behavior to let zombie
barrier task continue running but not able to interact with other barrier tasks
(maybe from different stage attempt) and ignore the task completion event from
a zombie barrier task.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
