grundprinzip opened a new pull request, #46060: URL: https://github.com/apache/spark/pull/46060
### Why are the changes needed? Running some of the tests repetitively have shown that there is an edge case in which the progress reporting yields undesired behavior. This is in particular the case when the response sender loop has already sent the last expected message in the stream to indicate that the stream is finished, but the response sender would send at least one additional progress message. This patch removes this race condition and guarantees that the `ResultComplete` message is the last message on the stream. ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? Added an additional UT, but existing tests cover the race condition. ### Was this patch authored or co-authored using generative AI tooling? No -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
