Github user mengxr commented on a diff in the pull request:
https://github.com/apache/spark/pull/21898#discussion_r206717197
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/TaskScheduler.scala ---
@@ -61,6 +61,9 @@ private[spark] trait TaskScheduler {
*/
def killTaskAttempt(taskId: Long, interruptThread: Boolean, reason:
String): Boolean
+ // Kill all the running task attempts in a stage.
+ def killAllTaskAttempts(stageId: Int, interruptThread: Boolean, reason:
String): Unit
--- End diff --
I'm also confused here. Is it part of this PR? We should kill all task
attempts in case of any task failures in a barrier stage, not limited to
context.barrier() failures. Right?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
