Weizhong created SPARK-5644:
-------------------------------
Summary: Delete tmp dir when sc is stop
Key: SPARK-5644
URL: https://issues.apache.org/jira/browse/SPARK-5644
Project: Spark
Issue Type: Improvement
Components: Spark Core
Reporter: Weizhong
Priority: Minor
When we run driver as a service which will not stop. In this service process we
will create SparkContext and run job and then stop it, because we only call
sc.stop but not exit this service process so the tmp dirs created by
HttpFileServer and SparkEnv will not be deleted after SparkContext is stopped,
and this will lead to creating too many tmp dirs if we create many SparkContext
to run job in this service process.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
