[GitHub] [spark] AmplabJenkins removed a comment on pull request #29128: [SPARK-32329][TESTS] Rename HADOOP2_MODULE_PROFILES to HADOOP_MODULE_PROFILES

AmplabJenkins removed a comment on pull request #29128: URL: https://github.com/apache/spark/pull/29128#issuecomment-659543719 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] gatorsmile edited a comment on pull request #29097: [SPARK-32299] [SQL] Decide SMJ Join Orientation adaptively

gatorsmile edited a comment on pull request #29097: URL: https://github.com/apache/spark/pull/29097#issuecomment-659540108 That also depends on the data values, right? Not always faster. This is an automated message from the

[GitHub] [spark] gatorsmile edited a comment on pull request #29097: [SPARK-32299] [SQL] Decide SMJ Join Orientation adaptively

gatorsmile edited a comment on pull request #29097: URL: https://github.com/apache/spark/pull/29097#issuecomment-659540108 The performance number? That also depends on the data, right? This is an automated message from the Ap

[GitHub] [spark] srowen commented on pull request #29128: [SPARK-32329][TESTS] Rename HADOOP2_MODULE_PROFILES to HADOOP_MODULE_PROFILES

srowen commented on pull request #29128: URL: https://github.com/apache/spark/pull/29128#issuecomment-659541476 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

[GitHub] [spark] huaxingao commented on pull request #29112: [SPARK-32310][ML][PySpark] ML params default value parity in classification, regression, clustering and fpm

huaxingao commented on pull request #29112: URL: https://github.com/apache/spark/pull/29112#issuecomment-659541013 @srowen If it's OK with you, I will merge after test passes so I can finish the 2nd part. I will merge to both 3.0.1 and master.

[GitHub] [spark] gatorsmile commented on pull request #29097: [SPARK-32299] [SQL] Decide SMJ Join Orientation adaptively

gatorsmile commented on pull request #29097: URL: https://github.com/apache/spark/pull/29097#issuecomment-659540108 performance number? This is an automated message from the Apache Git Service. To respond to the message, plea

[GitHub] [spark] gengliangwang commented on a change in pull request #29101: [SPARK-32302][SQL] Partially push down disjunctive predicates through Join/Partitions

gengliangwang commented on a change in pull request #29101: URL: https://github.com/apache/spark/pull/29101#discussion_r455927181 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/predicates.scala ## @@ -201,126 +201,51 @@ trait PredicateHelpe

[GitHub] [spark] gengliangwang commented on a change in pull request #29101: [SPARK-32302][SQL] Partially push down disjunctive predicates through Join/Partitions

gengliangwang commented on a change in pull request #29101: URL: https://github.com/apache/spark/pull/29101#discussion_r455927181 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/predicates.scala ## @@ -201,126 +201,51 @@ trait PredicateHelpe

[GitHub] [spark] AmplabJenkins commented on pull request #29101: [SPARK-32302][SQL] Partially push down disjunctive predicates through Join/Partitions

AmplabJenkins commented on pull request #29101: URL: https://github.com/apache/spark/pull/29101#issuecomment-659539412 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29101: [SPARK-32302][SQL] Partially push down disjunctive predicates through Join/Partitions

AmplabJenkins removed a comment on pull request #29101: URL: https://github.com/apache/spark/pull/29101#issuecomment-659539412 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] dongjoon-hyun commented on pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

dongjoon-hyun commented on pull request #27366: URL: https://github.com/apache/spark/pull/27366#issuecomment-659538228 Thank you, @MaxGekk and @HyukjinKwon ! This is an automated message from the Apache Git Service. To respon

[GitHub] [spark] gengliangwang commented on a change in pull request #29101: [SPARK-32302][SQL] Partially push down disjunctive predicates through Join/Partitions

gengliangwang commented on a change in pull request #29101: URL: https://github.com/apache/spark/pull/29101#discussion_r455928673 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/PushExtraPredicateThroughJoin.scala ## @@ -0,0 +1,111 @@ +/* + *

[GitHub] [spark] dongjoon-hyun commented on pull request #29106: [SPARK-32307][SQL] ScalaUDF's canonicalized expression should exclude inputEncoders

dongjoon-hyun commented on pull request #29106: URL: https://github.com/apache/spark/pull/29106#issuecomment-659536944 Thank you for clarification! This is an automated message from the Apache Git Service. To respond to the m

[GitHub] [spark] gengliangwang commented on a change in pull request #29101: [SPARK-32302][SQL] Partially push down disjunctive predicates through Join/Partitions

gengliangwang commented on a change in pull request #29101: URL: https://github.com/apache/spark/pull/29101#discussion_r455928673 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/PushExtraPredicateThroughJoin.scala ## @@ -0,0 +1,111 @@ +/* + *

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29112: [SPARK-32310][ML][PySpark] ML params default value parity in classification, regression, clustering and fpm

AmplabJenkins removed a comment on pull request #29112: URL: https://github.com/apache/spark/pull/29112#issuecomment-659535138 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] gengliangwang commented on a change in pull request #29101: [SPARK-32302][SQL] Partially push down disjunctive predicates through Join/Partitions

gengliangwang commented on a change in pull request #29101: URL: https://github.com/apache/spark/pull/29101#discussion_r455927181 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/predicates.scala ## @@ -201,126 +201,51 @@ trait PredicateHelpe

[GitHub] [spark] AmplabJenkins commented on pull request #29112: [SPARK-32310][ML][PySpark] ML params default value parity in classification, regression, clustering and fpm

AmplabJenkins commented on pull request #29112: URL: https://github.com/apache/spark/pull/29112#issuecomment-659535138 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29112: [SPARK-32310][ML][PySpark] ML params default value parity in classification, regression, clustering and fpm

SparkQA commented on pull request #29112: URL: https://github.com/apache/spark/pull/29112#issuecomment-659534524 **[Test build #125992 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125992/testReport)** for PR 29112 at commit [`4bc1053`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29128: [SPARK-32329][TESTS] Rename HADOOP2_MODULE_PROFILES to HADOOP_MODULE_PROFILES

AmplabJenkins removed a comment on pull request #29128: URL: https://github.com/apache/spark/pull/29128#issuecomment-659532563 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/125

[GitHub] [spark] AmplabJenkins commented on pull request #29128: [SPARK-32329][TESTS] Rename HADOOP2_MODULE_PROFILES to HADOOP_MODULE_PROFILES

AmplabJenkins commented on pull request #29128: URL: https://github.com/apache/spark/pull/29128#issuecomment-659532557 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] huaxingao commented on a change in pull request #29112: [SPARK-32310][ML][PySpark] ML params default value parity in classification, regression, clustering and fpm

huaxingao commented on a change in pull request #29112: URL: https://github.com/apache/spark/pull/29112#discussion_r455923815 ## File path: mllib/src/main/scala/org/apache/spark/ml/classification/FMClassifier.scala ## @@ -85,7 +85,6 @@ class FMClassifier @Since("3.0.0") (

[GitHub] [spark] SparkQA removed a comment on pull request #29128: [SPARK-32329][TESTS] Rename HADOOP2_MODULE_PROFILES to HADOOP_MODULE_PROFILES

SparkQA removed a comment on pull request #29128: URL: https://github.com/apache/spark/pull/29128#issuecomment-659435721 **[Test build #125981 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125981/testReport)** for PR 29128 at commit [`5f7fe1b`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29128: [SPARK-32329][TESTS] Rename HADOOP2_MODULE_PROFILES to HADOOP_MODULE_PROFILES

AmplabJenkins removed a comment on pull request #29128: URL: https://github.com/apache/spark/pull/29128#issuecomment-659532557 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] SparkQA commented on pull request #29128: [SPARK-32329][TESTS] Rename HADOOP2_MODULE_PROFILES to HADOOP_MODULE_PROFILES

SparkQA commented on pull request #29128: URL: https://github.com/apache/spark/pull/29128#issuecomment-659531872 **[Test build #125981 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125981/testReport)** for PR 29128 at commit [`5f7fe1b`](https://github.co

[GitHub] [spark] gengliangwang commented on a change in pull request #29133: [WIP][SPARK-32253][INFRA] Make readability better in the test result logs

gengliangwang commented on a change in pull request #29133: URL: https://github.com/apache/spark/pull/29133#discussion_r455923173 ## File path: project/SparkBuild.scala ## @@ -1027,6 +1027,11 @@ object TestSettings { }.getOrElse(Nil): _*), // Show full stack trace a

[GitHub] [spark] huaxingao commented on a change in pull request #29112: [SPARK-32310][ML][PySpark] ML params default value parity in classification, regression, clustering and fpm

huaxingao commented on a change in pull request #29112: URL: https://github.com/apache/spark/pull/29112#discussion_r455922564 ## File path: mllib/src/main/scala/org/apache/spark/ml/clustering/BisectingKMeans.scala ## @@ -68,6 +68,12 @@ private[clustering] trait BisectingKMeans

[GitHub] [spark] SparkQA commented on pull request #29133: [WIP][SPARK-32253][INFRA] Make readability better in the test result logs

SparkQA commented on pull request #29133: URL: https://github.com/apache/spark/pull/29133#issuecomment-659530106 **[Test build #125991 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125991/testReport)** for PR 29133 at commit [`3590262`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29125: [SPARK-32018][SQL][3.0] UnsafeRow.setDecimal should set null with overflowed value

AmplabJenkins removed a comment on pull request #29125: URL: https://github.com/apache/spark/pull/29125#issuecomment-659527858 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/125

[GitHub] [spark] RussellSpitzer commented on a change in pull request #28617: [SPARK-31694][SQL] Add SupportsPartitions Catalog APIs on DataSourceV2

RussellSpitzer commented on a change in pull request #28617: URL: https://github.com/apache/spark/pull/28617#discussion_r455919676 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/connector/catalog/TablePartition.java ## @@ -0,0 +1,54 @@ +/* + * Licensed to the Ap

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29125: [SPARK-32018][SQL][3.0] UnsafeRow.setDecimal should set null with overflowed value

AmplabJenkins removed a comment on pull request #29125: URL: https://github.com/apache/spark/pull/29125#issuecomment-659527846 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins commented on pull request #29125: [SPARK-32018][SQL][3.0] UnsafeRow.setDecimal should set null with overflowed value

AmplabJenkins commented on pull request #29125: URL: https://github.com/apache/spark/pull/29125#issuecomment-659527846 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #29125: [SPARK-32018][SQL][3.0] UnsafeRow.setDecimal should set null with overflowed value

SparkQA removed a comment on pull request #29125: URL: https://github.com/apache/spark/pull/29125#issuecomment-659365406 **[Test build #125965 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125965/testReport)** for PR 29125 at commit [`7268c05`](https://gi

[GitHub] [spark] SparkQA commented on pull request #29125: [SPARK-32018][SQL][3.0] UnsafeRow.setDecimal should set null with overflowed value

SparkQA commented on pull request #29125: URL: https://github.com/apache/spark/pull/29125#issuecomment-659526832 **[Test build #125965 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125965/testReport)** for PR 29125 at commit [`7268c05`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29133: [WIP][SPARK-32253][INFRA] Make readability better in the test result logs

AmplabJenkins removed a comment on pull request #29133: URL: https://github.com/apache/spark/pull/29133#issuecomment-659526442 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] cloud-fan commented on a change in pull request #28852: [SPARK-30616][SQL] Introduce TTL config option for SQL Metadata Cache

cloud-fan commented on a change in pull request #28852: URL: https://github.com/apache/spark/pull/28852#discussion_r455917399 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/FileIndexSuite.scala ## @@ -488,6 +489,30 @@ class FileIndexSuite exte

[GitHub] [spark] AmplabJenkins commented on pull request #29133: [WIP][SPARK-32253][INFRA] Make readability better in the test result logs

AmplabJenkins commented on pull request #29133: URL: https://github.com/apache/spark/pull/29133#issuecomment-659526442 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] huaxingao commented on pull request #29115: [SPARK-32315][ML] Provide an explanation error message when calling require

huaxingao commented on pull request #29115: URL: https://github.com/apache/spark/pull/29115#issuecomment-659525707 Merged to master. Thanks @dzlab This is an automated message from the Apache Git Service. To respond to the m

[GitHub] [spark] RussellSpitzer commented on a change in pull request #28617: [SPARK-31694][SQL] Add SupportsPartitions Catalog APIs on DataSourceV2

RussellSpitzer commented on a change in pull request #28617: URL: https://github.com/apache/spark/pull/28617#discussion_r455916473 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/connector/catalog/SupportsPartitions.java ## @@ -0,0 +1,105 @@ +/* + * Licensed to t

[GitHub] [spark] sap1ens commented on a change in pull request #28852: [SPARK-30616][SQL] Introduce TTL config option for SQL Metadata Cache

sap1ens commented on a change in pull request #28852: URL: https://github.com/apache/spark/pull/28852#discussion_r455915039 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/FileIndexSuite.scala ## @@ -488,6 +489,30 @@ class FileIndexSuite extend

[GitHub] [spark] cloud-fan commented on a change in pull request #29101: [SPARK-32302][SQL] Partially push down disjunctive predicates through Join/Partitions

cloud-fan commented on a change in pull request #29101: URL: https://github.com/apache/spark/pull/29101#discussion_r455914574 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/PushExtraPredicateThroughJoin.scala ## @@ -0,0 +1,111 @@ +/* + * Lice

[GitHub] [spark] huaxingao closed pull request #29115: [SPARK-32315][ML] Provide an explanation error message when calling require

huaxingao closed pull request #29115: URL: https://github.com/apache/spark/pull/29115 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[GitHub] [spark] tgravescs commented on pull request #29067: [SPARK-32274][SQL] Make SQL cache serialization pluggable

tgravescs commented on pull request #29067: URL: https://github.com/apache/spark/pull/29067#issuecomment-659523306 ok, sorry, I misunderstood, I thought you were referencing different discussion. I can file a jira for that and we can discuss if dsv2 can be leveraged. -

[GitHub] [spark] cloud-fan commented on a change in pull request #29101: [SPARK-32302][SQL] Partially push down disjunctive predicates through Join/Partitions

cloud-fan commented on a change in pull request #29101: URL: https://github.com/apache/spark/pull/29101#discussion_r455912591 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/PushExtraPredicateThroughJoin.scala ## @@ -0,0 +1,111 @@ +/* + * Lice

[GitHub] [spark] cloud-fan commented on a change in pull request #29101: [SPARK-32302][SQL] Partially push down disjunctive predicates through Join/Partitions

cloud-fan commented on a change in pull request #29101: URL: https://github.com/apache/spark/pull/29101#discussion_r455912079 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/PushExtraPredicateThroughJoin.scala ## @@ -0,0 +1,111 @@ +/* + * Lice

[GitHub] [spark] huaxingao commented on pull request #29095: [SPARK-32298][ML] tree models prediction optimization

huaxingao commented on pull request #29095: URL: https://github.com/apache/spark/pull/29095#issuecomment-659521274 LGTM This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

[GitHub] [spark] cloud-fan commented on a change in pull request #29101: [SPARK-32302][SQL] Partially push down disjunctive predicates through Join/Partitions

cloud-fan commented on a change in pull request #29101: URL: https://github.com/apache/spark/pull/29101#discussion_r455910402 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/predicates.scala ## @@ -201,126 +201,51 @@ trait PredicateHelper ex

[GitHub] [spark] cloud-fan commented on a change in pull request #29101: [SPARK-32302][SQL] Partially push down disjunctive predicates through Join/Partitions

cloud-fan commented on a change in pull request #29101: URL: https://github.com/apache/spark/pull/29101#discussion_r455909513 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/predicates.scala ## @@ -201,126 +201,51 @@ trait PredicateHelper ex

[GitHub] [spark] cloud-fan commented on a change in pull request #29101: [SPARK-32302][SQL] Partially push down disjunctive predicates through Join/Partitions

cloud-fan commented on a change in pull request #29101: URL: https://github.com/apache/spark/pull/29101#discussion_r455909295 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/predicates.scala ## @@ -201,126 +201,51 @@ trait PredicateHelper ex

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29101: [SPARK-32302][SQL] Partially push down disjunctive predicates through Join/Partitions

AmplabJenkins removed a comment on pull request #29101: URL: https://github.com/apache/spark/pull/29101#issuecomment-659517685 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29133: [SPARK-32253][INFRA] Make readability better in the test result logs

AmplabJenkins removed a comment on pull request #29133: URL: https://github.com/apache/spark/pull/29133#issuecomment-659517695 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] cloud-fan commented on a change in pull request #29101: [SPARK-32302][SQL] Partially push down disjunctive predicates through Join/Partitions

cloud-fan commented on a change in pull request #29101: URL: https://github.com/apache/spark/pull/29101#discussion_r455907856 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/predicates.scala ## @@ -201,126 +201,51 @@ trait PredicateHelper ex

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29101: [SPARK-32302][SQL] Partially push down disjunctive predicates through Join/Partitions

AmplabJenkins removed a comment on pull request #29101: URL: https://github.com/apache/spark/pull/29101#issuecomment-659517680 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins commented on pull request #29133: [SPARK-32253][INFRA] Make readability better in the test result logs

AmplabJenkins commented on pull request #29133: URL: https://github.com/apache/spark/pull/29133#issuecomment-659517695 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #29101: [SPARK-32302][SQL] Partially push down disjunctive predicates through Join/Partitions

AmplabJenkins commented on pull request #29101: URL: https://github.com/apache/spark/pull/29101#issuecomment-659517680 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29133: [SPARK-32253][INFRA] Make readability better in the test result logs

SparkQA commented on pull request #29133: URL: https://github.com/apache/spark/pull/29133#issuecomment-659516918 **[Test build #125989 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125989/testReport)** for PR 29133 at commit [`663e5a7`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #29101: [SPARK-32302][SQL] Partially push down disjunctive predicates through Join/Partitions

SparkQA commented on pull request #29101: URL: https://github.com/apache/spark/pull/29101#issuecomment-659516963 **[Test build #125990 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125990/testReport)** for PR 29101 at commit [`543bd69`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #29064: [SPARK-32272][SQL] Add SQL standard command SET TIME ZONE

AmplabJenkins commented on pull request #29064: URL: https://github.com/apache/spark/pull/29064#issuecomment-659514335 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29064: [SPARK-32272][SQL] Add SQL standard command SET TIME ZONE

AmplabJenkins removed a comment on pull request #29064: URL: https://github.com/apache/spark/pull/29064#issuecomment-659514335 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #29064: [SPARK-32272][SQL] Add SQL standard command SET TIME ZONE

SparkQA removed a comment on pull request #29064: URL: https://github.com/apache/spark/pull/29064#issuecomment-659322070 **[Test build #125963 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125963/testReport)** for PR 29064 at commit [`a4c60f3`](https://gi

[GitHub] [spark] SparkQA commented on pull request #29064: [SPARK-32272][SQL] Add SQL standard command SET TIME ZONE

SparkQA commented on pull request #29064: URL: https://github.com/apache/spark/pull/29064#issuecomment-659513052 **[Test build #125963 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125963/testReport)** for PR 29064 at commit [`a4c60f3`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29101: [SPARK-32302][SQL] Partially push down disjunctive predicates through Join/Partitions

AmplabJenkins removed a comment on pull request #29101: URL: https://github.com/apache/spark/pull/29101#issuecomment-659509973 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29101: [SPARK-32302][SQL] Partially push down disjunctive predicates through Join/Partitions

AmplabJenkins removed a comment on pull request #29101: URL: https://github.com/apache/spark/pull/29101#issuecomment-659509985 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/125

[GitHub] [spark] SparkQA removed a comment on pull request #29101: [SPARK-32302][SQL] Partially push down disjunctive predicates through Join/Partitions

SparkQA removed a comment on pull request #29101: URL: https://github.com/apache/spark/pull/29101#issuecomment-659508726 **[Test build #125988 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125988/testReport)** for PR 29101 at commit [`cb16660`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #29101: [SPARK-32302][SQL] Partially push down disjunctive predicates through Join/Partitions

AmplabJenkins commented on pull request #29101: URL: https://github.com/apache/spark/pull/29101#issuecomment-659509973 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29101: [SPARK-32302][SQL] Partially push down disjunctive predicates through Join/Partitions

SparkQA commented on pull request #29101: URL: https://github.com/apache/spark/pull/29101#issuecomment-659509955 **[Test build #125988 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125988/testReport)** for PR 29101 at commit [`cb16660`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29101: [SPARK-32302][SQL] Partially push down disjunctive predicates through Join/Partitions

AmplabJenkins removed a comment on pull request #29101: URL: https://github.com/apache/spark/pull/29101#issuecomment-659508536 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #29101: [SPARK-32302][SQL] Partially push down disjunctive predicates through Join/Partitions

SparkQA removed a comment on pull request #29101: URL: https://github.com/apache/spark/pull/29101#issuecomment-659507337 **[Test build #125987 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125987/testReport)** for PR 29101 at commit [`bfa2bc4`](https://gi

[GitHub] [spark] SparkQA commented on pull request #29101: [SPARK-32302][SQL] Partially push down disjunctive predicates through Join/Partitions

SparkQA commented on pull request #29101: URL: https://github.com/apache/spark/pull/29101#issuecomment-659508504 **[Test build #125987 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125987/testReport)** for PR 29101 at commit [`bfa2bc4`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #29101: [SPARK-32302][SQL] Partially push down disjunctive predicates through Join/Partitions

AmplabJenkins commented on pull request #29101: URL: https://github.com/apache/spark/pull/29101#issuecomment-659508536 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29101: [SPARK-32302][SQL] Partially push down disjunctive predicates through Join/Partitions

SparkQA commented on pull request #29101: URL: https://github.com/apache/spark/pull/29101#issuecomment-659508726 **[Test build #125988 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125988/testReport)** for PR 29101 at commit [`cb16660`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29021: [WIP][SPARK-32201][SQL] More general skew join pattern matching

AmplabJenkins removed a comment on pull request #29021: URL: https://github.com/apache/spark/pull/29021#issuecomment-659507102 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #29101: [SPARK-32302][SQL] Partially push down disjunctive predicates through Join/Partitions

SparkQA commented on pull request #29101: URL: https://github.com/apache/spark/pull/29101#issuecomment-659507337 **[Test build #125987 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125987/testReport)** for PR 29101 at commit [`bfa2bc4`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #29021: [WIP][SPARK-32201][SQL] More general skew join pattern matching

AmplabJenkins commented on pull request #29021: URL: https://github.com/apache/spark/pull/29021#issuecomment-659507102 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #29021: [WIP][SPARK-32201][SQL] More general skew join pattern matching

SparkQA removed a comment on pull request #29021: URL: https://github.com/apache/spark/pull/29021#issuecomment-659313226 **[Test build #125961 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125961/testReport)** for PR 29021 at commit [`973d87e`](https://gi

[GitHub] [spark] SparkQA commented on pull request #29021: [WIP][SPARK-32201][SQL] More general skew join pattern matching

SparkQA commented on pull request #29021: URL: https://github.com/apache/spark/pull/29021#issuecomment-659505826 **[Test build #125961 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125961/testReport)** for PR 29021 at commit [`973d87e`](https://github.co

[GitHub] [spark] venkata91 commented on pull request #28287: [SPARK-31418][SCHEDULER] Request more executors in case of dynamic allocation is enabled and a task becomes unschedulable due to spark's bl

venkata91 commented on pull request #28287: URL: https://github.com/apache/spark/pull/28287#issuecomment-659503642 @tgravescs it seems like it again failed somewhere in pyspark module. Not sure if this is transient or not. T

[GitHub] [spark] turboFei commented on pull request #29000: [SPARK-27194][SPARK-29302][SQL] Fix commit collision in dynamic partition overwrite mode

turboFei commented on pull request #29000: URL: https://github.com/apache/spark/pull/29000#issuecomment-659501117 > gentle ping @cloud-fan @dongjoon-hyun @SparkQA to retest this pr You can push a new commit(like two commits, the second one revert the first one) to trigger jenkins jo

[GitHub] [spark] warrenzhu25 commented on pull request #29113: [SPARK-32314][SHS] Add config to control whether log old format of stacktrace

warrenzhu25 commented on pull request #29113: URL: https://github.com/apache/spark/pull/29113#issuecomment-659500227 @sarutak @gengliangwang could you help take a look? This is an automated message from the Apache Git Service

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29101: [SPARK-32302][SQL] Partially push down disjunctive predicates through Join/Partitions

AmplabJenkins removed a comment on pull request #29101: URL: https://github.com/apache/spark/pull/29101#issuecomment-659499113 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29101: [SPARK-32302][SQL] Partially push down disjunctive predicates through Join/Partitions

AmplabJenkins commented on pull request #29101: URL: https://github.com/apache/spark/pull/29101#issuecomment-659499113 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] xkrogen commented on a change in pull request #28874: [SPARK-32036] Replace references to blacklist/whitelist language with more appropriate terminology, excluding the blacklisting fe

xkrogen commented on a change in pull request #28874: URL: https://github.com/apache/spark/pull/28874#discussion_r455884917 ## File path: python/pyspark/cloudpickle.py ## @@ -87,8 +87,8 @@ PY2 = True PY2_WRAPPER_DESCRIPTOR_TYPE = type(object.__init__) PY2_METHOD_

[GitHub] [spark] gengliangwang commented on a change in pull request #29101: [SPARK-32302][SQL] Partially push down disjunctive predicates through Join/Partitions

gengliangwang commented on a change in pull request #29101: URL: https://github.com/apache/spark/pull/29101#discussion_r455882868 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/PushExtraPredicateThroughJoin.scala ## @@ -0,0 +1,113 @@ +/* + *

[GitHub] [spark] AmplabJenkins commented on pull request #29089: [SPARK-32276][SQL] Remove redundant sorts before repartition nodes

AmplabJenkins commented on pull request #29089: URL: https://github.com/apache/spark/pull/29089#issuecomment-659489525 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29089: [SPARK-32276][SQL] Remove redundant sorts before repartition nodes

AmplabJenkins removed a comment on pull request #29089: URL: https://github.com/apache/spark/pull/29089#issuecomment-659489525 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #29089: [SPARK-32276][SQL] Remove redundant sorts before repartition nodes

SparkQA commented on pull request #29089: URL: https://github.com/apache/spark/pull/29089#issuecomment-659488828 **[Test build #125986 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125986/testReport)** for PR 29089 at commit [`0545b09`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28977: [WIP] Add all hive.execution suite in the parallel test group

AmplabJenkins removed a comment on pull request #28977: URL: https://github.com/apache/spark/pull/28977#issuecomment-659487631 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28977: [WIP] Add all hive.execution suite in the parallel test group

AmplabJenkins commented on pull request #28977: URL: https://github.com/apache/spark/pull/28977#issuecomment-659487631 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #28977: [WIP] Add all hive.execution suite in the parallel test group

SparkQA removed a comment on pull request #28977: URL: https://github.com/apache/spark/pull/28977#issuecomment-659367884 **[Test build #125966 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125966/testReport)** for PR 28977 at commit [`0556b4b`](https://gi

[GitHub] [spark] SparkQA commented on pull request #28977: [WIP] Add all hive.execution suite in the parallel test group

SparkQA commented on pull request #28977: URL: https://github.com/apache/spark/pull/28977#issuecomment-659486466 **[Test build #125966 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125966/testReport)** for PR 28977 at commit [`0556b4b`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29135: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

AmplabJenkins removed a comment on pull request #29135: URL: https://github.com/apache/spark/pull/29135#issuecomment-659484626 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29135: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

AmplabJenkins commented on pull request #29135: URL: https://github.com/apache/spark/pull/29135#issuecomment-659484626 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29135: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

SparkQA commented on pull request #29135: URL: https://github.com/apache/spark/pull/29135#issuecomment-659483788 **[Test build #125985 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125985/testReport)** for PR 29135 at commit [`4f9c7e6`](https://github.com

[GitHub] [spark] beliefer closed pull request #29051: [WIP][SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

beliefer closed pull request #29051: URL: https://github.com/apache/spark/pull/29051 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [spark] beliefer closed pull request #27428: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

beliefer closed pull request #27428: URL: https://github.com/apache/spark/pull/27428 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28874: [SPARK-32036] Replace references to blacklist/whitelist language with more appropriate terminology, excluding the blacklistin

HyukjinKwon commented on a change in pull request #28874: URL: https://github.com/apache/spark/pull/28874#discussion_r455868322 ## File path: python/pyspark/cloudpickle.py ## @@ -87,8 +87,8 @@ PY2 = True PY2_WRAPPER_DESCRIPTOR_TYPE = type(object.__init__) PY2_MET

[GitHub] [spark] beliefer opened a new pull request #29135: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

beliefer opened a new pull request #29135: URL: https://github.com/apache/spark/pull/29135 ### What changes were proposed in this pull request? This PR is related to https://github.com/apache/spark/pull/26656. https://github.com/apache/spark/pull/26656 only support use FILTER clause on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29125: [SPARK-32018][SQL][3.0] UnsafeRow.setDecimal should set null with overflowed value

AmplabJenkins removed a comment on pull request #29125: URL: https://github.com/apache/spark/pull/29125#issuecomment-659480246 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29125: [SPARK-32018][SQL][3.0] UnsafeRow.setDecimal should set null with overflowed value

AmplabJenkins commented on pull request #29125: URL: https://github.com/apache/spark/pull/29125#issuecomment-659480246 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #29125: [SPARK-32018][SQL][3.0] UnsafeRow.setDecimal should set null with overflowed value

SparkQA removed a comment on pull request #29125: URL: https://github.com/apache/spark/pull/29125#issuecomment-659320372 **[Test build #125962 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125962/testReport)** for PR 29125 at commit [`7268c05`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29134: [SPARK-32332][SQL] Support columnar exchanges when AQE is enabled

AmplabJenkins removed a comment on pull request #29134: URL: https://github.com/apache/spark/pull/29134#issuecomment-659474574 Can one of the admins verify this patch? This is an automated message from the Apache Git Service.

<    1   2   3   4   5   6   7   8   9   10   >