mridulm commented on pull request #34735: URL: https://github.com/apache/spark/pull/34735#issuecomment-986484286
I am trying to understand the change here, I saw the gist but it was not clear to me why/what the expected behavior we are trying to expose here. Are we trying to preserve skipped stages when they are retried ? If yes, why ? Or is it simply to surface the fact that stage 2, when it shows up in stage list, is a retry due to some failure ? (this is useful information to show). But showing a skipped stage, when it runs initially, as "retry 1" can be confusing - since it is running for first time (as stage 2). Not sure if it is easy to show what was the original stage which ran, and resulted in stage 2 becoming skipped. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
