GitHub user jiangxb1987 opened a pull request: https://github.com/apache/spark/pull/21943
[SPARK-24795][Core][FOLLOWUP] Kill all running tasks when a task in a barrier stage fail ## What changes were proposed in this pull request? Kill all running tasks when a task in a barrier stage fail in the middle. `TaskScheduler`.`cancelTasks()` will also fail the job, so we implemented a new method `killAllTaskAttempts()` to just kill all running tasks of a stage without cancel the stage/job. ## How was this patch tested? To be added. You can merge this pull request into a Git repository by running: $ git pull https://github.com/jiangxb1987/spark killAllTasks Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/21943.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #21943 ---- commit e4752c520f602e1d31aa5a51bc08a1b738b8aebb Author: Xingbo Jiang <xingbo.jiang@...> Date: 2018-08-01T14:34:03Z kill all task attempts for a stage without fail the entire job. commit 97bfba8b0d4e464690d89f743a68b03a92f8c3e7 Author: Xingbo Jiang <xingbo.jiang@...> Date: 2018-08-01T14:45:27Z update comments ---- --- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org