Github user jiangxb1987 commented on a diff in the pull request:
https://github.com/apache/spark/pull/21943#discussion_r207103696
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/TaskScheduler.scala ---
@@ -51,7 +51,7 @@ private[spark] trait TaskScheduler {
// Submit a sequence of tasks to run.
def submitTasks(taskSet: TaskSet): Unit
- // Cancel a stage.
+ // Kill all the tasks in a stage and fail the stage and all the jobs
that depend on the stage.
--- End diff --
Updated comment to note that if the backend doesn't support kill a task
then the method shall throw UnsupportedOperationException.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
