Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/22112#discussion_r212452014
--- Diff:
core/src/test/scala/org/apache/spark/scheduler/DAGSchedulerSuite.scala ---
@@ -2627,6 +2632,81 @@ class DAGSchedulerSuite extends SparkFunSuite with
LocalSparkContext with TimeLi
assert(countSubmittedMapStageAttempts() === 2)
}
+ test("SPARK-23207: retry all the succeeding stages when the map stage is
random") {
--- End diff --
We need to add a test where final result stage has not started (yet) but
intermediate stages are retried on failure.
This will validate that if result stage has not yet started, it wont fail
the job
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
