n-marion opened a new pull request #27384: [SPARK-30310][CORE] Resolve missing match case in SparkUncaughtExcept… URL: https://github.com/apache/spark/pull/27384 …ionHandler and added tests 1) Added missing match case to SparkUncaughtExceptionHandler, so that it would not halt the process when the exception doesn't match any of the match case statements. 2) Added log message before halting process. During debugging it wasn't obvious why the Worker process would DEAD (until we set SPARK_NO_DAEMONIZE=1) due to the shell-scripts puts the process into background and essentially absorbs the exit code. 3) Added SparkUncaughtExceptionHandlerSuite. Basically we create a Spark exception-throwing application with SparkUncaughtExceptionHandler and then check its exit code. SPARK-30310, because the process would halt unexpectedly. All unit tests (mvn test) were ran and OK. Closes #26955 from tinhto-000/uncaught_exception_fix. Authored-by: Tin Hang To <[email protected]> Signed-off-by: Sean Owen <[email protected]> Backport of SPARK-30310 to master (f5f05d549efd8f9a81376bfc31474292be7aaa8a)
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
