mridulm commented on issue #24796: [SPARK-27900][CORE] Add uncaught exception handler to the driver URL: https://github.com/apache/spark/pull/24796#issuecomment-505274362 I had added exit on OOM as part of initial yarn integration for both driver and executor. Over the years this has been (incorrectly IMO) removed from spark with attempts to gracefully handle it. Unlike normal error's/exception's, OOM cannot be handled gracefully in a complex app though. In context of spark, the right thing would be to fail fast.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
