Liang-Chi Hsieh created SPARK-3801:
--------------------------------------
Summary: Make app dir cleanup more efficient
Key: SPARK-3801
URL: https://issues.apache.org/jira/browse/SPARK-3801
Project: Spark
Issue Type: Improvement
Reporter: Liang-Chi Hsieh
Priority: Minor
The newly merged more conservative app directory cleanup can be more efficient.
Since it is not needed to store newer files, using 'exists' instead of 'filter'
can be more efficient because redundant items are skipped.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
