pan3793 commented on PR #7150: URL: https://github.com/apache/kyuubi/pull/7150#issuecomment-3615128220
SPARK-48547 addresses the non-daemon thread issue, an alternative SPARK-53198 that is somewhat similar to this PR, but unfortunately was abandoned. I'd like to provide a new case that might benefit from this feature - sometimes the Spark app might hang, likely caused by 1) OOM causes some services to be abnormal, 2) events lost due to exceeding queue capacity thus causing scheduler hangs, 3) blocked at user code. users are likely to perform KILL (via YARN API or deleting driver POD), and ask admin to investigate why app gets stuck. In this case, it would be helpful if it can print thread dumps before driver exited. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
