Github user cloud-fan commented on a diff in the pull request:

    https://github.com/apache/spark/pull/20930#discussion_r181776729
  
    --- Diff: 
core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala ---
    @@ -750,6 +752,10 @@ private[spark] class TaskSetManager(
           if (tasksSuccessful == numTasks) {
             isZombie = true
           }
    +    } else if (fetchFailedTaskIndexSet.contains(index)) {
    --- End diff --
    
    We should handle this case in DAGScheduler, then we can look up the stage 
by task id, and see if the stage is failed or not. Then we don't need 
`fetchFailedTaskIndexSet`.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

Reply via email to