Github user vanzin commented on the pull request:
https://github.com/apache/spark/pull/9946#issuecomment-173404935
> You still get shutdown hooks but System.exit kills the non-daemon threads?
You get shutdown hooks when the JVM exits (nor matter how, except `kill -9`
of course). The explicit `System.exit` is to kill non-daemon threads.
> it's because the app has already told YARN it's done but hasn't completed?
Precisely.
> Could we emulate the delay as well as better-than-nothing?
Why? What would that really help with? Any use application relying on
"container stays alive after YARN application is deemed finished" is doing
something wrong, and cannot assume anything about how long containers will live
after the app is finished.
I still haven't seen a single, valid use case for not killing these
non-daemon threads.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
