Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/19826#discussion_r153211458
--- Diff: docs/configuration.md ---
@@ -2306,6 +2306,50 @@ showDF(properties, numRows = 200, truncate = FALSE)
</tr>
</table>
+### Spark Application Garbage Collector
+
+<table class="table">
+ <tr><th>Property Name</th><th>Default</th><th>Meaning</th></tr>
+ <tr>
+ <td><code>spark.cleaner.periodicGC.interval</code></td>
+ <td>30min</td>
+ <td>
+ Controls how often to trigger a garbage collection.
+ </td>
+ </tr>
+ <tr>
+ <td><code>spark.cleaner.referenceTracking</code></td>
+ <td>true</td>
+ <td>
+ Controls whether a ContextCleaner should be created when a
SparkContext initializes.
+ </td>
+ </tr>
+ <tr>
+ <td><code>spark.cleaner.referenceTracking.blocking</code></td>
+ <td>true</td>
+ <td>
+ Controls whether the cleaning thread should block on cleanup tasks
(other than shuffle, which is controlled by
+ spark.cleaner.referenceTracking.blocking.shuffle Spark
property).<br><br>
+ It is true as a workaround to <a
href="https://issues.apache.org/jira/browse/SPARK-3015";>
--- End diff --
I think you can remove comments like this, or leave them to the source
code. This doesn't directly help the reader understand when or if to change it.
Or, add context here about why one would set this.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
