This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 21451fb312fe [SPARK-50505][DOCS] Fix
`spark.storage.replication.proactive` default value documentation
21451fb312fe is described below
commit 21451fb312fee32188b6d24f406cb4f3a8349414
Author: Dongjoon Hyun <[email protected]>
AuthorDate: Thu Dec 5 14:43:39 2024 -0800
[SPARK-50505][DOCS] Fix `spark.storage.replication.proactive` default value
documentation
### What changes were proposed in this pull request?
This PR aims to fix `spark.storage.replication.proactive` default value
documentation.
### Why are the changes needed?
`spark.storage.replication.proactive` has been enabled by default since
Apache Spark 3.2.0.
https://github.com/apache/spark/blob/6add9c89855f9311d5e185774ddddcbf4323beee/docs/core-migration-guide.md?plain=1#L85
https://github.com/apache/spark/blob/6add9c89855f9311d5e185774ddddcbf4323beee/core/src/main/scala/org/apache/spark/internal/config/package.scala#L494-L502
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Manual review.
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #49081 from dongjoon-hyun/SPARK-50505.
Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
---
docs/configuration.md | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/docs/configuration.md b/docs/configuration.md
index e095ae7a61b2..6957ca9a03d2 100644
--- a/docs/configuration.md
+++ b/docs/configuration.md
@@ -2116,7 +2116,7 @@ Apart from these, the following properties are also
available, and may be useful
</tr>
<tr>
<td><code>spark.storage.replication.proactive</code></td>
- <td>false</td>
+ <td>true</td>
<td>
Enables proactive block replication for RDD blocks. Cached RDD block
replicas lost due to
executor failures are replenished if there are any existing available
replicas. This tries
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
