This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-3.5
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.5 by this push:
new 86e29e94d9fd [SPARK-50505][DOCS] Fix
`spark.storage.replication.proactive` default value documentation
86e29e94d9fd is described below
commit 86e29e94d9fd5637d0258b0b234f1a82eb4fd860
Author: Dongjoon Hyun <[email protected]>
AuthorDate: Thu Dec 5 14:43:39 2024 -0800
[SPARK-50505][DOCS] Fix `spark.storage.replication.proactive` default value
documentation
### What changes were proposed in this pull request?
This PR aims to fix `spark.storage.replication.proactive` default value
documentation.
### Why are the changes needed?
`spark.storage.replication.proactive` has been enabled by default since
Apache Spark 3.2.0.
https://github.com/apache/spark/blob/6add9c89855f9311d5e185774ddddcbf4323beee/docs/core-migration-guide.md?plain=1#L85
https://github.com/apache/spark/blob/6add9c89855f9311d5e185774ddddcbf4323beee/core/src/main/scala/org/apache/spark/internal/config/package.scala#L494-L502
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Manual review.
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #49081 from dongjoon-hyun/SPARK-50505.
Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
(cherry picked from commit 21451fb312fee32188b6d24f406cb4f3a8349414)
Signed-off-by: Dongjoon Hyun <[email protected]>
---
docs/configuration.md | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/docs/configuration.md b/docs/configuration.md
index abd934572bd0..302348aa0f0e 100644
--- a/docs/configuration.md
+++ b/docs/configuration.md
@@ -1959,7 +1959,7 @@ Apart from these, the following properties are also
available, and may be useful
</tr>
<tr>
<td><code>spark.storage.replication.proactive</code></td>
- <td>false</td>
+ <td>true</td>
<td>
Enables proactive block replication for RDD blocks. Cached RDD block
replicas lost due to
executor failures are replenished if there are any existing available
replicas. This tries
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]