(celeborn) branch branch-0.6 updated: [CELEBORN-2139] Fix the condition for using OSS storage

[ethanfeng]

This is an automated email from the ASF dual-hosted git repository.

ethanfeng pushed a commit to branch branch-0.6
in repository https://gitbox.apache.org/repos/asf/celeborn.git


The following commit(s) were added to refs/heads/branch-0.6 by this push:
     new d1ef219fe [CELEBORN-2139] Fix the condition for using OSS storage
d1ef219fe is described below

commit d1ef219fe28dc02bac2ab2fc5ef9aa0053eefeb3
Author: xxx <953396...@qq.com>
AuthorDate: Wed Sep 3 15:40:42 2025 +0800

    [CELEBORN-2139] Fix the condition for using OSS storage
    
    ### What changes were proposed in this pull request?
    
    Fix the condition for using OSS storage
    
    ### Why are the changes needed?
    
    When OSS is enabled, the local disk should be used first if it is available.
    
    ### Does this PR introduce _any_ user-facing change?
    
    NO
    
    ### How was this patch tested?
    
    CI
    
    Closes #3463 from xy2953396112/CELEBORN-2139.
    
    Authored-by: xxx <953396...@qq.com>
    Signed-off-by: mingji <fengmingxiao....@alibaba-inc.com>
    (cherry picked from commit 750aeefbc6bc737257967db5772b59b4040b09cc)
    Signed-off-by: mingji <fengmingxiao....@alibaba-inc.com>
---
 .../apache/celeborn/service/deploy/worker/storage/StorageManager.scala  | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git 
a/worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala
 
b/worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala
index 7b3f1ed8c..59a4cc1da 100644
--- 
a/worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala
+++ 
b/worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala
@@ -1146,7 +1146,7 @@ final private[worker] class StorageManager(conf: 
CelebornConf, workerSource: Abs
           fileName,
           s3FileInfo)
         return (s3Flusher.get, s3FileInfo, null)
-      } else if (hasOssStorage && location.getStorageInfo.OSSAvailable()) {
+      } else if (dirs.isEmpty && location.getStorageInfo.OSSAvailable()) {
         val shuffleDir =
           new Path(new Path(ossDir, conf.workerWorkingDir), 
s"$appId/$shuffleId")
         FileSystem.mkdirs(