This is an automated email from the ASF dual-hosted git repository.
rexxiong pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/celeborn.git
The following commit(s) were added to refs/heads/main by this push:
new 2962c1149 [CELEBORN-1823] Remove unused
remote-shuffle.job.min.memory-per-partition and
remote-shuffle.job.min.memory-per-gate
2962c1149 is described below
commit 2962c11493808940585ded7c52682145f7500e48
Author: SteNicholas <[email protected]>
AuthorDate: Tue Jan 7 20:58:52 2025 +0800
[CELEBORN-1823] Remove unused remote-shuffle.job.min.memory-per-partition
and remote-shuffle.job.min.memory-per-gate
### What changes were proposed in this pull request?
Remove unused plugin config `remote-shuffle.job.min.memory-per-partition`
and `remote-shuffle.job.min.memory-per-gate`.
### Why are the changes needed?
`remote-shuffle.job.min.memory-per-partition` and
`remote-shuffle.job.min.memory-per-gate` are not alternative for
`CelebornConf`. Therefore, `remote-shuffle.job.min.memory-per-partition` and
`remote-shuffle.job.min.memory-per-gate` could be removed.
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
CI.
Closes #3053 from SteNicholas/CELEBORN-1823.
Authored-by: SteNicholas <[email protected]>
Signed-off-by: Shuang <[email protected]>
---
.../main/java/org/apache/celeborn/plugin/flink/utils/FlinkUtils.java | 2 --
1 file changed, 2 deletions(-)
diff --git
a/client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/utils/FlinkUtils.java
b/client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/utils/FlinkUtils.java
index 7c7d1cf81..370eac644 100644
---
a/client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/utils/FlinkUtils.java
+++
b/client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/utils/FlinkUtils.java
@@ -32,8 +32,6 @@ public class FlinkUtils {
private static final JobID ZERO_JOB_ID = new JobID(0, 0);
public static final Set<String> pluginConfNames =
ImmutableSet.of(
- "remote-shuffle.job.min.memory-per-partition",
- "remote-shuffle.job.min.memory-per-gate",
"remote-shuffle.job.concurrent-readings-per-gate",
"remote-shuffle.job.memory-per-partition",
"remote-shuffle.job.memory-per-gate",
