skonto edited a comment on issue #24796: [SPARK-27900][CORE] Add uncaught exception handler to the driver URL: https://github.com/apache/spark/pull/24796#issuecomment-513038825 Ok if we all agree I can open a PR to add `XX:OnOutOfMemoryError` at the entrypoint with the old flag (java 11 is coming though and people are encouraged to use the latest for security reasons and so we should do in our images). @squito all executors get a handler here: https://github.com/apache/spark/blob/453cbf3dd8df5ec4da844c93eb6000610b551541/core/src/main/scala/org/apache/spark/executor/Executor.scala#L62 @felixcheung @squito @mccheah @ifilonenko The problem is https://issues.apache.org/jira/browse/SPARK-27812, which can appear due to another type of exception besides OOM (the only solution there is a handler to the afaik).
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
