This is an automated email from the ASF dual-hosted git repository.
fchen pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/incubator-celeborn.git
The following commit(s) were added to refs/heads/main by this push:
new 640007100 [CELEBORN-1019][FOLLOWUP] Remove duplicate line
640007100 is described below
commit 640007100a2a166b42c2d4886ac149994154b7d6
Author: Jiaan Geng <[email protected]>
AuthorDate: Mon Oct 16 13:48:36 2023 +0800
[CELEBORN-1019][FOLLOWUP] Remove duplicate line
### What changes were proposed in this pull request?
https://github.com/apache/incubator-celeborn/pull/1968 introduced duplicate
lines of code, this is my fault.
### Why are the changes needed?
Remove duplicate line.
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
N/A
Closes #1990 from beliefer/CELEBORN-1019_followup.
Authored-by: Jiaan Geng <[email protected]>
Signed-off-by: Fu Chen <[email protected]>
---
.../src/test/scala/org/apache/celeborn/tests/spark/SkewJoinSuite.scala | 1 -
1 file changed, 1 deletion(-)
diff --git
a/tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/SkewJoinSuite.scala
b/tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/SkewJoinSuite.scala
index 4074d9fd6..6cfbd227a 100644
---
a/tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/SkewJoinSuite.scala
+++
b/tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/SkewJoinSuite.scala
@@ -57,7 +57,6 @@ class SkewJoinSuite extends AnyFunSuite
.set("spark.sql.adaptive.advisoryPartitionSizeInBytes", "12MB")
.set("spark.serializer", "org.apache.spark.serializer.KryoSerializer")
.set("spark.sql.adaptive.autoBroadcastJoinThreshold", "-1")
- .set("spark.sql.adaptive.autoBroadcastJoinThreshold", "-1")
.set(SQLConf.PARQUET_COMPRESSION.key, "gzip")
.set(s"spark.${CelebornConf.SHUFFLE_COMPRESSION_CODEC.key}",
codec.name)
.set(s"spark.${CelebornConf.SHUFFLE_RANGE_READ_FILTER_ENABLED.key}",
"true")