tgravescs commented on pull request #33873: URL: https://github.com/apache/spark/pull/33873#issuecomment-909242265
this comes back to the same thing we discussed before (https://github.com/apache/spark/pull/33780). Client mode always returns success right now. It seems you are trying to change that here in a slightly different way then the other PR. https://issues.apache.org/jira/browse/SPARK-3627 has some history on that. Note that here is where they don't want system.exit to happen in client mode: https://issues.apache.org/jira/browse/SPARK-1516 I think if you want to change the behavior of yarn client mode please start a mail on spark dev to get feedback, I'm not sure who might all be interested. Adding a few here @mirdulm @dbtsai @srowen -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
