liupc opened a new pull request #27002: [SPARK-30346]Improve logging when events dropped URL: https://github.com/apache/spark/pull/27002 ### What changes were proposed in this pull request? 1. Make logging events dropping every 60s works fine, the orignal implementaion some times not working due to susequent events comming and updating the DroppedEventCounter 2. Logging thread dump when the events dropping was logged every 60s. ### Why are the changes needed? Currenly, the logging may be skipped and delayed a long time under high concurrency, that make debugging hard. So This PR will try to fix it. Also this PR added logging for thread dump of dispatcher thread to help debugging performance issue that may causing events dropped. ### Does this PR introduce any user-facing change? No ### How was this patch tested? NA
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
