Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/20930#discussion_r182338127 --- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala --- @@ -1266,6 +1266,9 @@ class DAGScheduler( } if (failedEpoch.contains(execId) && smt.epoch <= failedEpoch(execId)) { logInfo(s"Ignoring possibly bogus $smt completion from executor $execId") + } else if (failedStages.contains(shuffleStage)) { --- End diff -- Sorry I may nitpick kere. Can you simulate what happens to result task if FechFaileded comes before task success?
--- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org