[GitHub] [spark] otterc commented on pull request #40393: [SPARK-40082] Schedule mergeFinalize when push merge shuffleMapStage retry but no running tasks

otterc commented on PR #40393: URL: https://github.com/apache/spark/pull/40393#issuecomment-1474749275 @Stove-hust The main change in `DAGScheduler` looks good to me. Basically,

[GitHub] [spark] otterc commented on pull request #40393: [SPARK-40082] Schedule mergeFinalize when push merge shuffleMapStage retry but no running tasks

otterc commented on PR #40393: URL: https://github.com/apache/spark/pull/40393#issuecomment-1474477575 One of the problems that I see is that a successful completion of speculative task will not trigger shuffle merge finalization of a stage that was marked failed but doesn't have any

[GitHub] [spark] otterc commented on pull request #40393: [SPARK-40082] Schedule mergeFinalize when push merge shuffleMapStage retry but no running tasks

otterc commented on PR #40393: URL: https://github.com/apache/spark/pull/40393#issuecomment-1470501033 @akpatnam25 @shuwang21 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] otterc commented on pull request #40393: [SPARK-40082] Schedule mergeFinalize when push merge shuffleMapStage retry but no running tasks

otterc commented on PR #40393: URL: https://github.com/apache/spark/pull/40393#issuecomment-1469293356 @Stove-hust Haven't had a chance to look at it yet. I'll take a look at it this week. -- This is an automated message from the Apache Git Service. To respond to the message, please log