ajithme opened a new pull request #25396: [SPARK-28676] Avoid excessive logging in Info level URL: https://github.com/apache/spark/pull/25396 ## What changes were proposed in this pull request? In high workload environments, ContextCleaner seems to have excessive logging at INFO level which do not give much information. In one Particular case we see that ``INFO ContextCleaner: Cleaned accumulator`` message is 25-30% of the generated logs. We can log this information for cleanup in DEBUG level instead. ## How was this patch tested? This do not modify any functionality. This is just changing cleanup log levels to DEBUG for ContextCleaner
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
