Kousuke Saruta created SPARK-3099:
-------------------------------------
Summary: Add a shutdown hook for cleanup staging directory to
ExecutorLauncher
Key: SPARK-3099
URL: https://issues.apache.org/jira/browse/SPARK-3099
Project: Spark
Issue Type: Bug
Components: YARN
Affects Versions: 1.1.0
Reporter: Kousuke Saruta
When we run application with YARN Cluster mode, the class 'ApplicationMaster'
is used as ApplicationMaster, which has shutdown hook to cleanup stagind
directory (~/.sparkStaging).
But, when we run application with YARN Client mode, the class
'ExecutorLauncher' as an ApplicationMaster doesn't cleanup staging directory.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
