(celeborn) branch main updated: [CELEBORN-1504][FOLLOWUP] Start test nodes in random ports to allow multiple builds run in the same ci server

[ethanfeng]

This is an automated email from the ASF dual-hosted git repository.

ethanfeng pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/celeborn.git


The following commit(s) were added to refs/heads/main by this push:
     new 8b54ed8c3 [CELEBORN-1504][FOLLOWUP] Start test nodes in random ports 
to allow multiple builds run in the same ci server
8b54ed8c3 is described below

commit 8b54ed8c34b5a88c7c22f6f94b4184ed438ce972
Author: SteNicholas <programg...@163.com>
AuthorDate: Mon Nov 11 16:55:14 2024 +0800

    [CELEBORN-1504][FOLLOWUP] Start test nodes in random ports to allow 
multiple builds run in the same ci server
    
    ### What changes were proposed in this pull request?
    
    Start test nodes in random ports to allow multiple builds run in the same 
ci server, which improves the test implementations so that it starts test nodes 
in random ports instead of using the hardcoded ones.
    
    Follow up #2619.
    
    ### Why are the changes needed?
    
    The test nodes are started in the hard coded ports, this prevents to run 
multiple builds in the same CI/CD server at present.
    
    Bump the changes of #2237.
    
    ### Does this PR introduce _any_ user-facing change?
    
    No.
    
    ### How was this patch tested?
    
    `RemoteShuffleMasterSuiteJ`
    
    Closes #2902 from SteNicholas/CELEBORN-1504.
    
    Authored-by: SteNicholas <programg...@163.com>
    Signed-off-by: mingji <fengmingxiao....@alibaba-inc.com>
---
 ...emoteShuffleMasterTest.java => RemoteShuffleMasterSuiteJ.java} | 8 ++++++--
 1 file changed, 6 insertions(+), 2 deletions(-)

diff --git 
a/client-flink/flink-1.16/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleMasterTest.java
 
b/client-flink/flink-1.16/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleMasterSuiteJ.java
similarity index 97%
rename from 
client-flink/flink-1.16/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleMasterTest.java
rename to 
client-flink/flink-1.16/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleMasterSuiteJ.java
index 079cbc5b1..8b474e56c 100644
--- 
a/client-flink/flink-1.16/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleMasterTest.java
+++ 
b/client-flink/flink-1.16/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleMasterSuiteJ.java
@@ -53,17 +53,21 @@ import org.slf4j.Logger;
 import org.slf4j.LoggerFactory;
 
 import org.apache.celeborn.common.CelebornConf;
+import org.apache.celeborn.common.util.Utils$;
 import org.apache.celeborn.plugin.flink.utils.FlinkUtils;
 
-public class RemoteShuffleMasterTest {
+public class RemoteShuffleMasterSuiteJ {
 
-  private static final Logger LOG = 
LoggerFactory.getLogger(RemoteShuffleMasterTest.class);
+  private static final Logger LOG = 
LoggerFactory.getLogger(RemoteShuffleMasterSuiteJ.class);
   private RemoteShuffleMaster remoteShuffleMaster;
   private Configuration configuration;
 
   @Before
   public void setUp() {
     configuration = new Configuration();
+    int startPort = Utils$.MODULE$.selectRandomPort(1024, 65535);
+    configuration.setInteger("celeborn.master.port", startPort);
+    configuration.setString("celeborn.master.endpoints", "localhost:" + 
startPort);
     remoteShuffleMaster = createShuffleMaster(configuration);
   }