Github user drcrallen commented on the pull request:
https://github.com/apache/spark/pull/10319#issuecomment-165809417
@tnachen For some reason the shutdown hooks are not finishing properly if
it receives a SIGTERM during shutdown. See logs in
https://issues.apache.org/jira/browse/SPARK-12330 where `INFO
CoarseGrainedExecutorBackend: Driver commanded a shutdown` is followed by a
`ERROR CoarseGrainedExecutorBackend: RECEIVED SIGNAL 15: SIGTERM`
Fixing that may be a better root cause fix, but I haven't looked into the
hadoop shutdown hooks enough to know where the issue could be with that.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
