wuyi created SPARK-31651:
----------------------------
Summary: Improve handling for the case of different barrier sync
types in a single sync
Key: SPARK-31651
URL: https://issues.apache.org/jira/browse/SPARK-31651
Project: Spark
Issue Type: Improvement
Components: Spark Core
Affects Versions: 3.0.0
Reporter: wuyi
Currently, we use cleanupBarrierStage when detecting different barrier sync
types in a single sync. This cause a problem that a new `ContextBarrierState`
can be created again if there's following requesters on the way. And those
corresponding tasks will fail because of killing instead of different barrier
sync types deteced.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]