This is an automated email from the ASF dual-hosted git repository.

zuston pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/uniffle.git


The following commit(s) were added to refs/heads/master by this push:
     new 5671a05b1 fix(spark): decompression time is always 0 when overlapping 
decompression is enabled (#2647)
5671a05b1 is described below

commit 5671a05b113a09065ebd5fb51bc4d492353b9283
Author: Junfan Zhang <[email protected]>
AuthorDate: Wed Oct 22 15:36:04 2025 +0800

    fix(spark): decompression time is always 0 when overlapping decompression 
is enabled (#2647)
    
    ### What changes were proposed in this pull request?
    
    This PR is to fix the decompression time is always 0 when overlapping 
decompression is enabled
    
    ### Why are the changes needed?
    
    When the overlapping decompression is enabled, the decompression time is 
always zero.
    
    <img width="1915" height="576" alt="image" 
src="https://github.com/user-attachments/assets/098a95ff-6a75-4a50-80bb-b7cbef1f5d25";
 />
    
    
    ### Does this PR introduce _any_ user-facing change?
    
    No.
    
    ### How was this patch tested?
    
    Internal job tests.
---
 .../java/org/apache/spark/shuffle/reader/RssShuffleDataIterator.java     | 1 +
 1 file changed, 1 insertion(+)

diff --git 
a/client-spark/common/src/main/java/org/apache/spark/shuffle/reader/RssShuffleDataIterator.java
 
b/client-spark/common/src/main/java/org/apache/spark/shuffle/reader/RssShuffleDataIterator.java
index c7e4a7559..646807d2b 100644
--- 
a/client-spark/common/src/main/java/org/apache/spark/shuffle/reader/RssShuffleDataIterator.java
+++ 
b/client-spark/common/src/main/java/org/apache/spark/shuffle/reader/RssShuffleDataIterator.java
@@ -150,6 +150,7 @@ public class RssShuffleDataIterator<K, C> extends 
AbstractIterator<Product2<K, C
         } else {
           decompressed = shuffleBlock.getByteBuffer();
           unCompressedBytesLength += shuffleBlock.getUncompressLength();
+          decompressTime += getBufferDuration;
         }
         long uncompressionDuration = System.currentTimeMillis() - 
startUncompression;
         uncompressionDuration += getBufferDuration;

Reply via email to