This is an automated email from the ASF dual-hosted git repository.
nicholasjiang pushed a commit to branch branch-0.4
in repository https://gitbox.apache.org/repos/asf/celeborn.git
The following commit(s) were added to refs/heads/branch-0.4 by this push:
new ed6d00b4b [CELEBORN-1399][FOLLOWUP] MR CelebornMapOutputCollector
should check exception after flush
ed6d00b4b is described below
commit ed6d00b4b08d8b05063a1425251d0d25ef6c6cc3
Author: lifulong <[email protected]>
AuthorDate: Wed Apr 24 18:15:11 2024 +0800
[CELEBORN-1399][FOLLOWUP] MR CelebornMapOutputCollector should check
exception after flush
### What changes were proposed in this pull request?
Fix compilation error on `WordCountTest` for MR of branch-0.4.
### Why are the changes needed?
MR `WordCountTest` compiles error, which should be fixed.
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
No.
Closes #2479 from lifulong/CELEBORN-1399-FOLLOWUP.
Authored-by: lifulong <[email protected]>
Signed-off-by: SteNicholas <[email protected]>
---
.../src/test/scala/org/apache/celeborn/tests/mr/WordCountTest.scala | 4 +---
1 file changed, 1 insertion(+), 3 deletions(-)
diff --git
a/tests/mr-it/src/test/scala/org/apache/celeborn/tests/mr/WordCountTest.scala
b/tests/mr-it/src/test/scala/org/apache/celeborn/tests/mr/WordCountTest.scala
index e1b89e269..b469bf070 100644
---
a/tests/mr-it/src/test/scala/org/apache/celeborn/tests/mr/WordCountTest.scala
+++
b/tests/mr-it/src/test/scala/org/apache/celeborn/tests/mr/WordCountTest.scala
@@ -177,9 +177,7 @@ class WordCountTest extends AnyFunSuite with Logging with
MiniClusterFeature
conf.set("mapreduce.job.user.classpath.first", "true")
conf.set("mapreduce.job.reduce.slowstart.completedmaps", "1")
- conf.set(
- "mapreduce.celeborn.master.endpoints",
- s"errorhost:${master.conf.get(CelebornConf.MASTER_PORT)}")
+ conf.set("mapreduce.celeborn.master.endpoints", "errorhost:9097")
conf.set(
MRJobConfig.MAP_OUTPUT_COLLECTOR_CLASS_ATTR,
"org.apache.hadoop.mapred.CelebornMapOutputCollector")
