Kousuke Saruta created SPARK-7503:
-------------------------------------
Summary: Resources in .sparkStaging directory can't be cleaned up
on error
Key: SPARK-7503
URL: https://issues.apache.org/jira/browse/SPARK-7503
Project: Spark
Issue Type: Bug
Components: YARN
Affects Versions: 1.4.0
Reporter: Kousuke Saruta
When we run applications on YARN with cluster mode, uploaded resources on
.sparkStaging directory can't be cleaned up in case of failure of uploading
local resources.
You can see this issue by running following command.
{code}
bin/spark-submit --master yarn --deploy-mode cluster --class <someClassName>
<non-existing-jar>
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
