This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-3.5
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.5 by this push:
new c048653435f9 [SPARK-47847][CORE] Deprecate
`spark.network.remoteReadNioBufferConversion`
c048653435f9 is described below
commit c048653435f9b7c832f79d38a504a145a17654c0
Author: Cheng Pan <[email protected]>
AuthorDate: Thu May 9 22:55:07 2024 -0700
[SPARK-47847][CORE] Deprecate `spark.network.remoteReadNioBufferConversion`
### What changes were proposed in this pull request?
`spark.network.remoteReadNioBufferConversion` was introduced in
https://github.com/apache/spark/commit/2c82745686f4456c4d5c84040a431dcb5b6cb60b,
to allow disable
[SPARK-24307](https://issues.apache.org/jira/browse/SPARK-24307) for safety,
while during the whole Spark 3 period, there are no negative reports, it proves
that [SPARK-24307](https://issues.apache.org/jira/browse/SPARK-24307) is solid
enough, I propose to mark it deprecated in 3.5.2 and remove in 4.1.0 or later
### Why are the changes needed?
Code clean up
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Pass GA.
### Was this patch authored or co-authored using generative AI tooling?
No
Closes #46047 from pan3793/SPARK-47847.
Authored-by: Cheng Pan <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
(cherry picked from commit 33cac4436e593c9c501c5ff0eedf923d3a21899c)
Signed-off-by: Dongjoon Hyun <[email protected]>
---
core/src/main/scala/org/apache/spark/SparkConf.scala | 4 +++-
1 file changed, 3 insertions(+), 1 deletion(-)
diff --git a/core/src/main/scala/org/apache/spark/SparkConf.scala
b/core/src/main/scala/org/apache/spark/SparkConf.scala
index 813a14acd19e..f49e9e357c84 100644
--- a/core/src/main/scala/org/apache/spark/SparkConf.scala
+++ b/core/src/main/scala/org/apache/spark/SparkConf.scala
@@ -638,7 +638,9 @@ private[spark] object SparkConf extends Logging {
DeprecatedConfig("spark.blacklist.killBlacklistedExecutors", "3.1.0",
"Please use spark.excludeOnFailure.killExcludedExecutors"),
DeprecatedConfig("spark.yarn.blacklist.executor.launch.blacklisting.enabled",
"3.1.0",
- "Please use spark.yarn.executor.launch.excludeOnFailure.enabled")
+ "Please use spark.yarn.executor.launch.excludeOnFailure.enabled"),
+ DeprecatedConfig("spark.network.remoteReadNioBufferConversion", "3.5.2",
+ "Please open a JIRA ticket to report it if you need to use this
configuration.")
)
Map(configs.map { cfg => (cfg.key -> cfg) } : _*)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
