[
https://issues.apache.org/jira/browse/SPARK-27014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16783113#comment-16783113
]
Hyukjin Kwon commented on SPARK-27014:
--------------------------------------
2.5.0 is not released and it will be 3.0.0. Also please avoid to set fix
versions which are usually set when it's actually fixed.
> Support removal of jars and Spark binaries from Mesos driver and executor
> sandboxes
> -----------------------------------------------------------------------------------
>
> Key: SPARK-27014
> URL: https://issues.apache.org/jira/browse/SPARK-27014
> Project: Spark
> Issue Type: New Feature
> Components: Mesos
> Affects Versions: 2.5.0
> Reporter: Martin Loncaric
> Priority: Minor
>
> Currently, each Spark application run on Mesos leaves behind at least 500MB
> of data in sandbox directories, coming from Spark binaries and copied URIs.
> These can build up as a disk leak, causing major issues on Mesos clusters
> unless their grace period for sandbox directories is very short.
> Spark should have a feature to delete these (from both driver and executor
> sandboxes) on teardown.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
