Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21898#discussion_r207098735
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/TaskScheduler.scala ---
@@ -61,6 +61,9 @@ private[spark] trait TaskScheduler {
*/
def killTaskAttempt(taskId: Long, interruptThread: Boolean, reason:
String): Boolean
+ // Kill all the running task attempts in a stage.
+ def killAllTaskAttempts(stageId: Int, interruptThread: Boolean, reason:
String): Unit
--- End diff --
IIRC killing all tasks is just the best effort, we can guarantee the tasks
are all killed. Shall we tolerate this in the barrier scheduling?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
