wypoon opened a new pull request #25673: [SPARK-28770][CORE][TEST] Fix ReplayListenerSuite tests that sometime… URL: https://github.com/apache/spark/pull/25673 …s fail. ### What changes were proposed in this pull request? In `testApplicationReplay`, filter out stage executor metrics for the driver from the original application events before comparing with the events logged on replay. ### Why are the changes needed? `testApplicationReplay` fails if the application runs long enough for the driver to send an executor metrics update. This causes stage executor metrics to be written for the driver. However, executor metrics updates are not logged, and thus not replayed. Therefore no stage executor metrics for the driver is logged on replay. ### Does this PR introduce any user-facing change? No. ### How was this patch tested? Existing unit tests.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
