Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21943#discussion_r207098475
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/TaskScheduler.scala ---
@@ -51,7 +51,7 @@ private[spark] trait TaskScheduler {
// Submit a sequence of tasks to run.
def submitTasks(taskSet: TaskSet): Unit
- // Cancel a stage.
+ // Kill all the tasks in a stage and fail the stage and all the jobs
that depend on the stage.
--- End diff --
is it guaranteed to work for any backend like YARN, Mesos, K8s?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
