[incubator-celeborn] branch celeborn-755 updated: [CELEBORN-755] Support to decide whether to compress shuffle data through configuration

[kerwinzhang]

This is an automated email from the ASF dual-hosted git repository.

kerwinzhang pushed a commit to branch celeborn-755
in repository https://gitbox.apache.org/repos/asf/incubator-celeborn.git


The following commit(s) were added to refs/heads/celeborn-755 by this push:
     new b5283ce77 [CELEBORN-755] Support to decide whether to compress shuffle 
data through configuration
b5283ce77 is described below

commit b5283ce77159f4a23f1e5718534d1b8bcfe7619a
Author: xiyu.zk <xiyu...@alibaba-inc.com>
AuthorDate: Fri Jun 30 20:59:30 2023 +0800

    [CELEBORN-755] Support to decide whether to compress shuffle data through 
configuration
---
 .../src/main/java/org/apache/celeborn/client/read/RssInputStream.java   | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git 
a/client/src/main/java/org/apache/celeborn/client/read/RssInputStream.java 
b/client/src/main/java/org/apache/celeborn/client/read/RssInputStream.java
index 089cf28e6..bcc639780 100644
--- a/client/src/main/java/org/apache/celeborn/client/read/RssInputStream.java
+++ b/client/src/main/java/org/apache/celeborn/client/read/RssInputStream.java
@@ -554,7 +554,7 @@ public abstract class RssInputStream extends InputStream {
               }
               limit = decompressor.decompress(compressedBuf, rawDataBuf, 0);
             } else {
-              limit = rawDataBuf.length;
+              limit = size;
             }
             position = 0;
             hasData = true;