zuston commented on code in PR #2301:
URL:
https://github.com/apache/incubator-uniffle/pull/2301#discussion_r1914105485
##########
client-spark/common/src/main/java/org/apache/uniffle/shuffle/manager/ShuffleManagerGrpcService.java:
##########
@@ -118,6 +118,9 @@ public void reportShuffleWriteFailure(
// Clear the metadata of the completed task, otherwise some of
the stage's data will
// be lost.
shuffleManager.unregisterAllMapOutput(shuffleId);
+ // Need to clear the mapStatus twice to prevent partition data
loss due to the
+ // long-tail task performed before the stage retry.
+ shuffleManager.unregisterAllMapOutput(shuffleId);
Review Comment:
Does it work? Just invoking twice in the same time point.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
