mridulm commented on pull request #34735: URL: https://github.com/apache/spark/pull/34735#issuecomment-987856439
BTW, one query - specific to SQL (does not apply to vanilla RDD jobs). In context of skewed joins or partition coalascing, when AQE changes number of partitions post shuffle, how does this work ? Will stage 2 retry 1 preserve the earlier stage 2 skipped attempt 0 task counts (if it was getting fully re-executed) ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
