srowen commented on a change in pull request #25072: [SPARK-28294][CORE]
Support `spark.history.fs.cleaner.maxNum` configuration
URL: https://github.com/apache/spark/pull/25072#discussion_r301256887
##########
File path: docs/monitoring.md
##########
@@ -190,7 +190,10 @@ Security options for the Spark History Server are covered
more detail in the
<td>1d</td>
<td>
How often the filesystem job history cleaner checks for files to delete.
- Files are only deleted if they are older than
<code>spark.history.fs.cleaner.maxAge</code>
+ Files are deleted in two cases. First, they are older than
<code>spark.history.fs.cleaner.maxAge</code>.
Review comment:
Maybe more like, "Files are deleted if at least one of two conditions holds.
First, they're deleted if they're older than ... They are also deleted if the
number of files is more than ..."
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
