cxzl25 commented on PR #39918: URL: https://github.com/apache/spark/pull/39918#issuecomment-1420390122
> May I ask why Shuffle block corruption become a frequent event in your cluster? This problem doesn't occur very often, I don't have exact statistics yet. Adding these logs is to do in-depth research and find out the possible reasons for this problem. > Why you cannot use DEBUG and TRACE level for your analysis when you can control via log4j property files? OK, I adjusted the INFO level to debug level. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
