[
https://issues.apache.org/jira/browse/SPARK-25818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16661822#comment-16661822
]
Apache Spark commented on SPARK-25818:
--------------------------------------
User 'ouyangxiaochen' has created a pull request for this issue:
https://github.com/apache/spark/pull/22813
> WorkDirCleanup should only remove the directory at the beginning of the app
> ---------------------------------------------------------------------------
>
> Key: SPARK-25818
> URL: https://issues.apache.org/jira/browse/SPARK-25818
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 2.0.0, 2.2.1, 2.3.2
> Reporter: Xiaochen Ouyang
> Priority: Minor
>
> The cleanup mechanism will clear all the eligible directories under
> SPARK_WORK_DIR. If the other configured paths are the same as the
> SPARK_WORK_DIR configuration, this will cause the file directories of other
> configuration items to be deleted by mistake. For example, the
> SPARK_LOCAL_DIRS and SPARK_WORK_DIR settings are the same.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
