GitHub user Sephiroth-Lin opened a pull request:
https://github.com/apache/spark/pull/4412
Delete tmp dir when sc is stop
When we run driver as a service, and for each time we run job we only call
sc.stop, then will not delete tmp dir create by HttpFileServer and SparkEnv, it
will be deleted until the service process exit, so we need to delete these tmp
dirs when sc is stop directly.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/Sephiroth-Lin/spark bug-fix-master-01
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/4412.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #4412
----
commit c0d5b283ecbf3332d5a68280b2e617325d5d9b6b
Author: Sephiroth-Lin <[email protected]>
Date: 2015-02-06T01:33:12Z
Delete tmp dir when sc is stop
When we run driver as a service, and for each time we run job we only call
sc.stop, then will not delete tmp dir create by HttpFileServer and SparkEnv, it
will be deleted until the service process exit
commit aeac51861e5c5bb185b0738dba2d25e57752038c
Author: Sephiroth-Lin <[email protected]>
Date: 2015-02-06T01:35:33Z
Delete tmp dir when sc is stop
When we run driver as a service, and for each time we run job we only call
sc.stop, then will not delete tmp dir create by HttpFileServer and SparkEnv, it
will be deleted until the service process exit
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
