Github user mengxr commented on a diff in the pull request:
https://github.com/apache/spark/pull/22001#discussion_r208066204
--- Diff:
core/src/test/scala/org/apache/spark/BarrierStageOnSubmittedSuite.scala ---
@@ -185,4 +185,56 @@ class BarrierStageOnSubmittedSuite extends
SparkFunSuite with LocalSparkContext
testSubmitJob(sc, rdd,
message = DAGScheduler.ERROR_MESSAGE_RUN_BARRIER_WITH_DYN_ALLOCATION)
}
+
--- End diff --
We need a test verifies if total slots are good but some are running other
jobs, we shouldn't fail the barrier job.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
