squito commented on issue #24796: [SPARK-27900][CORE] Add uncaught exception handler to the driver URL: https://github.com/apache/spark/pull/24796#issuecomment-505063314 my point about the inconsistency from my more minimal repro is just that we might not be able to rely on the usual semantics of joins & interrupts after an OOM. Also a reason I'd rather trust `XX:+ExitOnOutOfMemoryError` as something that's part of the JVM itself (and perhaps it should be added to the executors too for the same reasons). Though one argument against using that is that it was only available [starting with java 8u92](https://www.oracle.com/technetwork/java/javase/8u92-relnotes-2949471.html) (do we specify a minimal version with java 1.8?) and its a non-standard option. The old way to do this is with `-XX:OnOutOfMemoryError="kill -9 %p"`. @kiszk @mridulm @tgravescs -- maybe you have some thoughts on this one from prior experience with JVM error conditions?
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
