This is an automated email from the ASF dual-hosted git repository.
fchen pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/incubator-celeborn.git
The following commit(s) were added to refs/heads/main by this push:
new 98cb941c8 [CELEBORN-1142] clear shuffleIdCache in shutdown method of
ShuffleClientImpl
98cb941c8 is described below
commit 98cb941c844023bf946bc215c91b4ddcf587aa28
Author: jiaoqingbo <[email protected]>
AuthorDate: Tue Nov 28 20:54:24 2023 +0800
[CELEBORN-1142] clear shuffleIdCache in shutdown method of ShuffleClientImpl
### What changes were proposed in this pull request?
As Title
### Why are the changes needed?
As Title
### Does this PR introduce _any_ user-facing change?
NO
### How was this patch tested?
PASS GA
Closes #2114 from jiaoqingbo/1142.
Authored-by: jiaoqingbo <[email protected]>
Signed-off-by: Fu Chen <[email protected]>
---
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java | 2 ++
1 file changed, 2 insertions(+)
diff --git
a/client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java
b/client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java
index b1a377517..fe7a403ef 100644
--- a/client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java
+++ b/client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java
@@ -1676,6 +1676,8 @@ public class ShuffleClientImpl extends ShuffleClient {
if (null != lifecycleManagerRef) {
lifecycleManagerRef = null;
}
+
+ shuffleIdCache.clear();
pushExcludedWorkers.clear();
fetchExcludedWorkers.clear();
logger.warn("Shuffle client has been shutdown!");