(spark) branch master updated: [SPARK-46498][CORE] Remove `shuffleServiceEnabled` from `o.a.spark.util.Utils#getConfiguredLocalDirs`

[dongjoon]

This is an automated email from the ASF dual-hosted git repository.

dongjoon pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git


The following commit(s) were added to refs/heads/master by this push:
     new 8ea09de807f9 [SPARK-46498][CORE] Remove `shuffleServiceEnabled` from 
`o.a.spark.util.Utils#getConfiguredLocalDirs`
8ea09de807f9 is described below

commit 8ea09de807f9f218d549ae179e09bd5219979e06
Author: yangjie01 <yangji...@baidu.com>
AuthorDate: Tue Dec 26 00:19:28 2023 -0800

    [SPARK-46498][CORE] Remove `shuffleServiceEnabled` from 
`o.a.spark.util.Utils#getConfiguredLocalDirs`
    
    ### What changes were proposed in this pull request?
    This PR cleans up an unused local variables from 
`org.apache.spark.util.Utils#getConfiguredLocalDirs` function, It is no longer 
used after the support for Mesos was removed in SPARK-44442 
(https://github.com/apache/spark/pull/43135).
    
    ### Why are the changes needed?
    Code clean up
    
    ### Does this PR introduce _any_ user-facing change?
    No
    
    ### How was this patch tested?
    Pass GitHub Actions
    
    ### Was this patch authored or co-authored using generative AI tooling?
    No
    
    Closes #44475 from LuciferYang/utils-useless.
    
    Lead-authored-by: yangjie01 <yangji...@baidu.com>
    Co-authored-by: YangJie <yangji...@baidu.com>
    Signed-off-by: Dongjoon Hyun <dh...@apple.com>
---
 core/src/main/scala/org/apache/spark/util/Utils.scala | 3 +--
 1 file changed, 1 insertion(+), 2 deletions(-)

diff --git a/core/src/main/scala/org/apache/spark/util/Utils.scala 
b/core/src/main/scala/org/apache/spark/util/Utils.scala
index 09f6c5344546..aa5bd73e8535 100644
--- a/core/src/main/scala/org/apache/spark/util/Utils.scala
+++ b/core/src/main/scala/org/apache/spark/util/Utils.scala
@@ -67,7 +67,7 @@ import org.slf4j.Logger
 
 import org.apache.spark._
 import org.apache.spark.deploy.SparkHadoopUtil
-import org.apache.spark.internal.{config, Logging}
+import org.apache.spark.internal.Logging
 import org.apache.spark.internal.config._
 import org.apache.spark.internal.config.Streaming._
 import org.apache.spark.internal.config.Tests.IS_TESTING
@@ -769,7 +769,6 @@ private[spark] object Utils
    * logic of locating the local directories according to deployment mode.
    */
   def getConfiguredLocalDirs(conf: SparkConf): Array[String] = {
-    val shuffleServiceEnabled = conf.get(config.SHUFFLE_SERVICE_ENABLED)
     if (isRunningInYarnContainer(conf)) {
       // If we are in yarn mode, systems can have different disk layouts so we 
must set it
       // to what Yarn on this system said was available. Note this assumes 
that Yarn has


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org