dongjoon-hyun commented on a change in pull request #32730:
URL: https://github.com/apache/spark/pull/32730#discussion_r643670680
##########
File path: core/src/main/scala/org/apache/spark/MapOutputTracker.scala
##########
@@ -234,6 +252,7 @@ private class ShuffleStatus(
for (mapIndex <- mapStatuses.indices) {
if (mapStatuses(mapIndex) != null && f(mapStatuses(mapIndex).location)) {
_numAvailableMapOutputs -= 1
+ mapStatusesDeleted(mapIndex) = mapStatuses(mapIndex)
Review comment:
BTW, I agree with you that we don't have a test coverage for the
indeterministic stage case. Let me try to add some.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
