Kousuke Saruta created SPARK-3090:
-------------------------------------
Summary: Add shutdown hook to stop SparkContext for YARN Client
mode
Key: SPARK-3090
URL: https://issues.apache.org/jira/browse/SPARK-3090
Project: Spark
Issue Type: Bug
Components: Spark Core, YARN
Affects Versions: 1.1.0
Reporter: Kousuke Saruta
When we use YARN Cluster mode, ApplicationMaser register a shutdown hook,
stopping SparkContext.
Thanks to this, SparkContext can stop even if Application forgets to stop
SparkContext itself.
But, unfortunately, YARN Client mode doesn't have such mechanism.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
