[incubator-celeborn] branch main updated: [CELEBORN-950] Change CelebornShuffleReader log level and information

[zhouky]

This is an automated email from the ASF dual-hosted git repository.

zhouky pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/incubator-celeborn.git


The following commit(s) were added to refs/heads/main by this push:
     new b2e03d27b [CELEBORN-950] Change CelebornShuffleReader log level and 
information
b2e03d27b is described below

commit b2e03d27bd5f3d968b75a54b9df3b5c6560a2bb5
Author: jiaoqingbo <1178404...@qq.com>
AuthorDate: Wed Sep 6 21:07:19 2023 +0800

    [CELEBORN-950] Change CelebornShuffleReader log level and information
    
    ### What changes were proposed in this pull request?
    
    As Title
    
    ### Why are the changes needed?
    
    As Title
    
    ### Does this PR introduce _any_ user-facing change?
    
    No
    
    ### How was this patch tested?
    
    PASS GA
    
    Closes #1882 from jiaoqingbo/950.
    
    Authored-by: jiaoqingbo <1178404...@qq.com>
    Signed-off-by: zky.zhoukeyong <zky.zhoukey...@alibaba-inc.com>
---
 .../org/apache/spark/shuffle/celeborn/CelebornShuffleReader.scala     | 4 ++--
 .../org/apache/spark/shuffle/celeborn/CelebornShuffleReader.scala     | 4 ++--
 2 files changed, 4 insertions(+), 4 deletions(-)

diff --git 
a/client-spark/spark-2/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleReader.scala
 
b/client-spark/spark-2/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleReader.scala
index 337143a50..4116d54d5 100644
--- 
a/client-spark/spark-2/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleReader.scala
+++ 
b/client-spark/spark-2/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleReader.scala
@@ -95,10 +95,10 @@ class CelebornShuffleReader[K, C](
               streams.put(partitionId, inputStream)
             } catch {
               case e: IOException =>
-                logInfo("Exception caught when readPartition!")
+                logError(s"Exception caught when readPartition $partitionId!", 
e)
                 exceptionRef.compareAndSet(null, e)
               case e: Throwable =>
-                logInfo("Non IOException caught when readPartition!", e)
+                logError(s"Non IOException caught when readPartition 
$partitionId!", e)
                 exceptionRef.compareAndSet(null, new CelebornIOException(e))
             }
           }
diff --git 
a/client-spark/spark-3/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleReader.scala
 
b/client-spark/spark-3/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleReader.scala
index 43cb22efd..45f918c18 100644
--- 
a/client-spark/spark-3/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleReader.scala
+++ 
b/client-spark/spark-3/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleReader.scala
@@ -97,10 +97,10 @@ class CelebornShuffleReader[K, C](
               streams.put(partitionId, inputStream)
             } catch {
               case e: IOException =>
-                logInfo("Exception caught when readPartition!", e)
+                logError(s"Exception caught when readPartition $partitionId!", 
e)
                 exceptionRef.compareAndSet(null, e)
               case e: Throwable =>
-                logInfo("Non IOException caught when readPartition!", e)
+                logError(s"Non IOException caught when readPartition 
$partitionId!", e)
                 exceptionRef.compareAndSet(null, new CelebornIOException(e))
             }
           }