This is an automated email from the ASF dual-hosted git repository.
zuston pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/uniffle.git
The following commit(s) were added to refs/heads/master by this push:
new 5671a05b1 fix(spark): decompression time is always 0 when overlapping
decompression is enabled (#2647)
5671a05b1 is described below
commit 5671a05b113a09065ebd5fb51bc4d492353b9283
Author: Junfan Zhang <[email protected]>
AuthorDate: Wed Oct 22 15:36:04 2025 +0800
fix(spark): decompression time is always 0 when overlapping decompression
is enabled (#2647)
### What changes were proposed in this pull request?
This PR is to fix the decompression time is always 0 when overlapping
decompression is enabled
### Why are the changes needed?
When the overlapping decompression is enabled, the decompression time is
always zero.
<img width="1915" height="576" alt="image"
src="https://github.com/user-attachments/assets/098a95ff-6a75-4a50-80bb-b7cbef1f5d25"
/>
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Internal job tests.
---
.../java/org/apache/spark/shuffle/reader/RssShuffleDataIterator.java | 1 +
1 file changed, 1 insertion(+)
diff --git
a/client-spark/common/src/main/java/org/apache/spark/shuffle/reader/RssShuffleDataIterator.java
b/client-spark/common/src/main/java/org/apache/spark/shuffle/reader/RssShuffleDataIterator.java
index c7e4a7559..646807d2b 100644
---
a/client-spark/common/src/main/java/org/apache/spark/shuffle/reader/RssShuffleDataIterator.java
+++
b/client-spark/common/src/main/java/org/apache/spark/shuffle/reader/RssShuffleDataIterator.java
@@ -150,6 +150,7 @@ public class RssShuffleDataIterator<K, C> extends
AbstractIterator<Product2<K, C
} else {
decompressed = shuffleBlock.getByteBuffer();
unCompressedBytesLength += shuffleBlock.getUncompressLength();
+ decompressTime += getBufferDuration;
}
long uncompressionDuration = System.currentTimeMillis() -
startUncompression;
uncompressionDuration += getBufferDuration;