This is an automated email from the ASF dual-hosted git repository.
roryqi pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-uniffle.git
The following commit(s) were added to refs/heads/master by this push:
new d60d675d [#669] improvement: refresh application when reading memory
data (#741)
d60d675d is described below
commit d60d675d38c833b99b012a1f4c726a012ce93463
Author: xianjingfeng <[email protected]>
AuthorDate: Sun Mar 19 19:15:51 2023 +0800
[#669] improvement: refresh application when reading memory data (#741)
### What changes were proposed in this pull request?
Refresh application when reading memory data.
### Why are the changes needed?
In the current logic, application will not be refreshed when reading memory
data. In this case, If timeout occurs when spark driver sends heartbeat to
shuffle server, the application will be expired.
Fix: #669
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
No need,
---
server/src/main/java/org/apache/uniffle/server/ShuffleTaskManager.java | 1 +
1 file changed, 1 insertion(+)
diff --git
a/server/src/main/java/org/apache/uniffle/server/ShuffleTaskManager.java
b/server/src/main/java/org/apache/uniffle/server/ShuffleTaskManager.java
index 4095cedf..c7a964fd 100644
--- a/server/src/main/java/org/apache/uniffle/server/ShuffleTaskManager.java
+++ b/server/src/main/java/org/apache/uniffle/server/ShuffleTaskManager.java
@@ -453,6 +453,7 @@ public class ShuffleTaskManager {
public ShuffleDataResult getInMemoryShuffleData(
String appId, Integer shuffleId, Integer partitionId, long blockId, int
readBufferSize,
Roaring64NavigableMap expectedTaskIds) {
+ refreshAppId(appId);
return shuffleBufferManager.getShuffleData(appId,
shuffleId, partitionId, blockId, readBufferSize, expectedTaskIds);
}