yaooqinn opened a new pull request, #52893: URL: https://github.com/apache/spark/pull/52893
### What changes were proposed in this pull request? Deprecated spark.shuffle.server.finalizeShuffleMergeThreadsPercent first, and then we can remove finalizeWorker usages in the future. ### Why are the changes needed? In the Netty project, those related APIs are - removed from the main branch https://github.com/netty/netty/pull/8778 - and deprecated in 4.2 branch https://github.com/netty/netty/pull/14538 ### Does this PR introduce _any_ user-facing change? no ### How was this patch tested? I verified this by a SparkPi local test ```scala bin/run-example -c spark.shuffle.server.finalizeShuffleMergeThreadsPercent=10 SparkPi WARNING: Using incubator modules: jdk.incubator.vector Using Spark's default log4j profile: org/apache/spark/log4j2-defaults.properties 25/11/05 10:59:14 WARN SparkConf: The configuration key 'spark.shuffle.server.finalizeShuffleMergeThreadsPercent' has been deprecated as of Spark 4.2.0 and may be removed in the future. Using separate finalizeWorkers could be problematic due to the underlying netty layer ``` ### Was this patch authored or co-authored using generative AI tooling? no -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
