Github user li-zhihui commented on the pull request:
https://github.com/apache/spark/pull/1616#issuecomment-54914557
@andrewor14
In yarn mode, these cache files will be clean up automatically, and in
standalone mode, it's not handled.
Now in standalone mode, application work directory
<code>SPARK_HOME/work/APPLICATION_ID</code> in slave nodes is not clean up too.
I think if this issue (cleaning up application work directory) was resolved, we
could use the application work directory as cache directory.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
