otterc opened a new pull request #35325: URL: https://github.com/apache/spark/pull/35325
### What changes were proposed in this pull request? This is fixes the bugs that were reported in SPARK-37675 and SPARK-37793. - Empty merged partitions were reported by the shuffle server to the driver. - The push merged files were getting overwritten after a shuffle merge is finalized. It is WIP because we need to validate that the fix will not result in increased memory on the shuffle server. ### Why are the changes needed? Changes are need to fix the bug. ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? Have added unit test. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
