This is an automated email from the ASF dual-hosted git repository.
rexxiong pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/celeborn.git
The following commit(s) were added to refs/heads/main by this push:
new e78c9b8ab [CELEBORN-1721][FOLLOWUP] Fix the problem of getting
partition location in ShuffleClientImpl during soft split
e78c9b8ab is described below
commit e78c9b8ab5239db7b4670e037ac9c6566ebc823d
Author: xinyuwang1 <[email protected]>
AuthorDate: Sat Feb 8 09:40:32 2025 +0800
[CELEBORN-1721][FOLLOWUP] Fix the problem of getting partition location in
ShuffleClientImpl during soft split
### What changes were proposed in this pull request?
Fix the problem of getting partition location in ShuffleClientImpl during
soft split.
### Why are the changes needed?
bug fix
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
CI.
Closes #3092 from littlexyw/CELEBORN-1721-FOLLOWUP.
Authored-by: xinyuwang1 <[email protected]>
Signed-off-by: Shuang <[email protected]>
---
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git
a/client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java
b/client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java
index 8dbccb00b..106d77c21 100644
--- a/client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java
+++ b/client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java
@@ -1489,7 +1489,7 @@ public class ShuffleClientImpl extends ShuffleClient {
partitionIds[partitionIndex],
StatusCode.fromValue(statusCodeList.get(i).byteValue())));
if (statusCodeList.get(i) ==
StatusCode.SOFT_SPLIT.getValue()) {
- PartitionLocation loc = batches.get(i).loc;
+ PartitionLocation loc = batches.get(partitionIndex).loc;
if (!newerPartitionLocationExists(
reducePartitionMap.get(shuffleId), loc.getId(),
loc.getEpoch(), false)) {
ReviveRequest reviveRequest =
