This is an automated email from the ASF dual-hosted git repository.

fchen pushed a commit to branch branch-0.3
in repository https://gitbox.apache.org/repos/asf/incubator-celeborn.git


The following commit(s) were added to refs/heads/branch-0.3 by this push:
     new c79f3a5b8 [CELEBORN-1019][FOLLOWUP] Remove duplicate line
c79f3a5b8 is described below

commit c79f3a5b83e696a4f8feb8a2e51aa63c99b8b004
Author: Jiaan Geng <[email protected]>
AuthorDate: Mon Oct 16 13:48:36 2023 +0800

    [CELEBORN-1019][FOLLOWUP] Remove duplicate line
    
    ### What changes were proposed in this pull request?
    https://github.com/apache/incubator-celeborn/pull/1968 introduced duplicate 
lines of code, this is my fault.
    
    ### Why are the changes needed?
    Remove duplicate line.
    
    ### Does this PR introduce _any_ user-facing change?
    No
    
    ### How was this patch tested?
    N/A
    
    Closes #1990 from beliefer/CELEBORN-1019_followup.
    
    Authored-by: Jiaan Geng <[email protected]>
    Signed-off-by: Fu Chen <[email protected]>
    (cherry picked from commit 640007100a2a166b42c2d4886ac149994154b7d6)
    Signed-off-by: Fu Chen <[email protected]>
---
 .../src/test/scala/org/apache/celeborn/tests/spark/SkewJoinSuite.scala   | 1 -
 1 file changed, 1 deletion(-)

diff --git 
a/tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/SkewJoinSuite.scala
 
b/tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/SkewJoinSuite.scala
index 1de82fb20..b28ba0291 100644
--- 
a/tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/SkewJoinSuite.scala
+++ 
b/tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/SkewJoinSuite.scala
@@ -57,7 +57,6 @@ class SkewJoinSuite extends AnyFunSuite
         .set("spark.sql.adaptive.advisoryPartitionSizeInBytes", "12MB")
         .set("spark.serializer", "org.apache.spark.serializer.KryoSerializer")
         .set("spark.sql.adaptive.autoBroadcastJoinThreshold", "-1")
-        .set("spark.sql.adaptive.autoBroadcastJoinThreshold", "-1")
         .set(SQLConf.PARQUET_COMPRESSION.key, "gzip")
         .set(s"spark.${CelebornConf.SHUFFLE_COMPRESSION_CODEC.key}", 
codec.name)
         .set(s"spark.${CelebornConf.SHUFFLE_RANGE_READ_FILTER_ENABLED.key}", 
"true")

Reply via email to