Github user tgravescs commented on the pull request:
https://github.com/apache/spark/pull/9946#issuecomment-173644365
so I haven't seen any use cases this would break.
I would argue is they are relying on this behavior its a bug in the user
code. They should be using shut down hook or other and that still work with
system.exit. If they are doing this now they are getting undeterministic
results because YARN and other cluster managers could shoot them at any time.
Personally I think inconsistent behavior is worse as it is much harder to
debug.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]