dongjoon-hyun commented on PR #39883: URL: https://github.com/apache/spark/pull/39883#issuecomment-1416913338
Yes, this is not a regression. I filed this JIRA as a bug for all live release branches. However, Apache Spark 3.4 hits this at a significant higher rates. @mridulm . For now, I have only this code path logs. > Is this sufficient (a point fix at this location) ? Or are there other codepaths which will trigger something similar ? For this one, I'm still not quite sure if I understand the proposed way clearly, but we can try it separately if there is a ready-to-go patch, @mridulm . > If not sufficient, should we modify it in Logging itself - for the Throwable variants, to only log message, and not the stacktrace when spark context is stopped ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
