[GitHub] [spark] dongjoon-hyun opened a new pull request #30635: [SPARK-33675][INFRA][2.4][FOLLOWUP] Set GIT_REF to branch-2.4

dongjoon-hyun opened a new pull request #30635: URL: https://github.com/apache/spark/pull/30635 ### What changes were proposed in this pull request? ### Why are the changes needed? ### Does this PR introduce _any_ user-facing change? ###

[GitHub] [spark] SparkQA removed a comment on pull request #30631: [SPARK-33680][SQL][TESTS] Fix PrunePartitionSuiteBase/BucketedReadWithHiveSupportSuite not to depend on the default conf

SparkQA removed a comment on pull request #30631: URL: https://github.com/apache/spark/pull/30631#issuecomment-739612085 **[Test build #132310 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132310/testReport)** for PR 30631 at commit

[GitHub] [spark] SparkQA commented on pull request #30631: [SPARK-33680][SQL][TESTS] Fix PrunePartitionSuiteBase/BucketedReadWithHiveSupportSuite not to depend on the default conf

SparkQA commented on pull request #30631: URL: https://github.com/apache/spark/pull/30631#issuecomment-739620691 **[Test build #132310 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132310/testReport)** for PR 30631 at commit

[GitHub] [spark] sarutak opened a new pull request #30634: [SPARK-33684][BUILD] Upgrade httpclient from 4.5.6 to 4.5.13

sarutak opened a new pull request #30634: URL: https://github.com/apache/spark/pull/30634 ### What changes were proposed in this pull request? This PR upgrades `commons.httpclient` from `4.5.6` to `4.5.13`. 4.5.6 is released over 2 years ago and now we can use more stable

[GitHub] [spark] SparkQA commented on pull request #30532: [MINOR] Spelling sql not core

SparkQA commented on pull request #30532: URL: https://github.com/apache/spark/pull/30532#issuecomment-739618863 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36909/

[GitHub] [spark] dongjoon-hyun closed pull request #30633: [SPARK-33683][INFRA] Remove -Djava.version=11 from Scala 2.13 build in GitHub Actions

dongjoon-hyun closed pull request #30633: URL: https://github.com/apache/spark/pull/30633 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] sarutak opened a new pull request #30633: [SPARK-33683][BUILD] Remove -Djava.version=11 from Scala 2.13 build in GitHub Actions

sarutak opened a new pull request #30633: URL: https://github.com/apache/spark/pull/30633 ### What changes were proposed in this pull request? This PR removes `-Djava.version=11` from the build command for Scala 2.13 in the GitHub Actions' job. In the GitHub Actions' job, the

[GitHub] [spark] imback82 commented on a change in pull request #30598: [SPARK-33654][SQL] Migrate CACHE TABLE to use UnresolvedRelation to resolve identifier

imback82 commented on a change in pull request #30598: URL: https://github.com/apache/spark/pull/30598#discussion_r537180016 ## File path: sql/core/src/test/scala/org/apache/spark/sql/connector/DataSourceV2SQLSuite.scala ## @@ -2587,15 +2588,11 @@ class DataSourceV2SQLSuite

[GitHub] [spark] SparkQA commented on pull request #29122: [SPARK-32320][PYSPARK] Remove mutable default arguments

SparkQA commented on pull request #29122: URL: https://github.com/apache/spark/pull/29122#issuecomment-739616690 **[Test build #132313 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132313/testReport)** for PR 29122 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30632: [SPARK-33681][K8S][TESTS][3.0] Increase K8s IT timeout to 3 minutes

AmplabJenkins removed a comment on pull request #30632: URL: https://github.com/apache/spark/pull/30632#issuecomment-739615624 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36908/

[GitHub] [spark] zhengruifeng commented on pull request #29122: [SPARK-32320][PYSPARK] Remove mutable default arguments

zhengruifeng commented on pull request #29122: URL: https://github.com/apache/spark/pull/29122#issuecomment-739615643 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins commented on pull request #30632: [SPARK-33681][K8S][TESTS][3.0] Increase K8s IT timeout to 3 minutes

AmplabJenkins commented on pull request #30632: URL: https://github.com/apache/spark/pull/30632#issuecomment-739615624 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36908/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30623: [SPARK-33675][INFRA] Add GitHub Action job to publish snapshot

AmplabJenkins removed a comment on pull request #30623: URL: https://github.com/apache/spark/pull/30623#issuecomment-739614200 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36907/

[GitHub] [spark] AmplabJenkins commented on pull request #30623: [SPARK-33675][INFRA] Add GitHub Action job to publish snapshot

AmplabJenkins commented on pull request #30623: URL: https://github.com/apache/spark/pull/30623#issuecomment-739614200 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36907/

[GitHub] [spark] SparkQA commented on pull request #30623: [SPARK-33675][INFRA] Add GitHub Action job to publish snapshot

SparkQA commented on pull request #30623: URL: https://github.com/apache/spark/pull/30623#issuecomment-739614190 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36907/

[GitHub] [spark] AngersZhuuuu commented on pull request #29966: [SPARK-33084][CORE][SQL] Add jar support ivy path

AngersZh commented on pull request #29966: URL: https://github.com/apache/spark/pull/29966#issuecomment-739614011 > Thanks for this work, @AngersZh . Btw, are you planning to support a `ivy` schema in `--packages`, too? Currently we support `--packages` with maven as

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30631: [SPARK-33680][SQL][TESTS] Fix PrunePartitionSuiteBase/BucketedReadWithHiveSupportSuite not to depend on the default conf

AmplabJenkins removed a comment on pull request #30631: URL: https://github.com/apache/spark/pull/30631#issuecomment-739613650 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36906/

[GitHub] [spark] SparkQA commented on pull request #30631: [SPARK-33680][SQL][TESTS] Fix PrunePartitionSuiteBase/BucketedReadWithHiveSupportSuite not to depend on the default conf

SparkQA commented on pull request #30631: URL: https://github.com/apache/spark/pull/30631#issuecomment-739613640 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36906/

[GitHub] [spark] AmplabJenkins commented on pull request #30631: [SPARK-33680][SQL][TESTS] Fix PrunePartitionSuiteBase/BucketedReadWithHiveSupportSuite not to depend on the default conf

AmplabJenkins commented on pull request #30631: URL: https://github.com/apache/spark/pull/30631#issuecomment-739613650 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36906/

[GitHub] [spark] maropu commented on a change in pull request #30577: [SPARK-33621][SQL] Add a way to inject data source rewrite rules

maropu commented on a change in pull request #30577: URL: https://github.com/apache/spark/pull/30577#discussion_r537175295 ## File path: sql/core/src/main/scala/org/apache/spark/sql/SparkSessionExtensions.scala ## @@ -199,6 +199,21 @@ class SparkSessionExtensions {

[GitHub] [spark] SparkQA commented on pull request #30532: [MINOR] Spelling sql not core

SparkQA commented on pull request #30532: URL: https://github.com/apache/spark/pull/30532#issuecomment-739612345 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36909/

[GitHub] [spark] SparkQA commented on pull request #30628: [SPARK-33679][SQL] Enable spark.sql.adaptive.enabled by default

SparkQA commented on pull request #30628: URL: https://github.com/apache/spark/pull/30628#issuecomment-739612251 **[Test build #132311 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132311/testReport)** for PR 30628 at commit

[GitHub] [spark] SparkQA commented on pull request #30631: [SPARK-33680][SQL][TESTS] Fix PrunePartitionSuiteBase/BucketedReadWithHiveSupportSuite not to depend on the default conf

SparkQA commented on pull request #30631: URL: https://github.com/apache/spark/pull/30631#issuecomment-739612085 **[Test build #132310 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132310/testReport)** for PR 30631 at commit

[GitHub] [spark] SparkQA commented on pull request #30559: [SPARK-33617][SQL] Add default parallelism configuration for Spark SQL queries

SparkQA commented on pull request #30559: URL: https://github.com/apache/spark/pull/30559#issuecomment-739611989 **[Test build #132312 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132312/testReport)** for PR 30559 at commit

[GitHub] [spark] dongjoon-hyun commented on pull request #30630: [SPARK-33675][INFRA][3.0] Add GitHub Action job to publish snapshot

dongjoon-hyun commented on pull request #30630: URL: https://github.com/apache/spark/pull/30630#issuecomment-739611973 Thank you! This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30632: [SPARK-33681][K8S][TESTS][3.0] Increase K8s IT timeout to 3 minutes

AmplabJenkins removed a comment on pull request #30632: URL: https://github.com/apache/spark/pull/30632#issuecomment-739611733 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132308/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30629: [SPARK-33675][INFRA][2.4] Add GitHub Action job to publish snapshot

AmplabJenkins removed a comment on pull request #30629: URL: https://github.com/apache/spark/pull/30629#issuecomment-739611734 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132304/

[GitHub] [spark] dongjoon-hyun commented on pull request #30629: [SPARK-33675][INFRA][2.4] Add GitHub Action job to publish snapshot

dongjoon-hyun commented on pull request #30629: URL: https://github.com/apache/spark/pull/30629#issuecomment-739611889 Thank you! This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins commented on pull request #30629: [SPARK-33675][INFRA][2.4] Add GitHub Action job to publish snapshot

AmplabJenkins commented on pull request #30629: URL: https://github.com/apache/spark/pull/30629#issuecomment-739611734 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132304/

[GitHub] [spark] AmplabJenkins commented on pull request #30632: [SPARK-33681][K8S][TESTS][3.0] Increase K8s IT timeout to 3 minutes

AmplabJenkins commented on pull request #30632: URL: https://github.com/apache/spark/pull/30632#issuecomment-739611733 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132308/

[GitHub] [spark] maropu commented on a change in pull request #30625: [SPARK-33677][SQL] Skip LikeSimplification rule if escape is a wildcard character

maropu commented on a change in pull request #30625: URL: https://github.com/apache/spark/pull/30625#discussion_r537173246 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/expressions.scala ## @@ -543,13 +543,14 @@ object LikeSimplification

[GitHub] [spark] HyukjinKwon commented on pull request #30618: [SPARK-33670][SQL] Verify the partition provider is Hive in v1 SHOW TABLE EXTENDED

HyukjinKwon commented on pull request #30618: URL: https://github.com/apache/spark/pull/30618#issuecomment-739609702 @MaxGekk it has a conflict with branch-3.0 and I didn't bother to port back since it's a error message change only. But feel free to open a PR to backport if you feel it's

[GitHub] [spark] HyukjinKwon edited a comment on pull request #30618: [SPARK-33670][SQL] Verify the partition provider is Hive in v1 SHOW TABLE EXTENDED

HyukjinKwon edited a comment on pull request #30618: URL: https://github.com/apache/spark/pull/30618#issuecomment-739609335 Merged to master, branch-3.1. This is an automated message from the Apache Git Service. To respond

[GitHub] [spark] HyukjinKwon commented on pull request #30618: [SPARK-33670][SQL] Verify the partition provider is Hive in v1 SHOW TABLE EXTENDED

HyukjinKwon commented on pull request #30618: URL: https://github.com/apache/spark/pull/30618#issuecomment-739609335 Merged to master, branch-3.1 and branch-3.0. This is an automated message from the Apache Git Service. To

[GitHub] [spark] HyukjinKwon closed pull request #30618: [SPARK-33670][SQL] Verify the partition provider is Hive in v1 SHOW TABLE EXTENDED

HyukjinKwon closed pull request #30618: URL: https://github.com/apache/spark/pull/30618 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] HyukjinKwon commented on pull request #30559: [SPARK-33617][SQL] Add default parallelism configuration for Spark SQL queries

HyukjinKwon commented on pull request #30559: URL: https://github.com/apache/spark/pull/30559#issuecomment-739608987 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] dongjoon-hyun commented on pull request #30632: [SPARK-33681][K8S][TESTS][3.0] Increase K8s IT timeout to 3 minutes

dongjoon-hyun commented on pull request #30632: URL: https://github.com/apache/spark/pull/30632#issuecomment-739608729 Thank you, @HyukjinKwon ! This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] HyukjinKwon closed pull request #30632: [SPARK-33681][K8S][TESTS][3.0] Increase K8s IT timeout to 3 minutes

HyukjinKwon closed pull request #30632: URL: https://github.com/apache/spark/pull/30632 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] HyukjinKwon commented on pull request #30632: [SPARK-33681][K8S][TESTS][3.0] Increase K8s IT timeout to 3 minutes

HyukjinKwon commented on pull request #30632: URL: https://github.com/apache/spark/pull/30632#issuecomment-739607256 Merged to branch-3.0 and branch-2.4. This is an automated message from the Apache Git Service. To respond

[GitHub] [spark] SparkQA commented on pull request #30623: [SPARK-33675][INFRA] Add GitHub Action job to publish snapshot

SparkQA commented on pull request #30623: URL: https://github.com/apache/spark/pull/30623#issuecomment-739607145 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36907/

[GitHub] [spark] SparkQA commented on pull request #30631: [SPARK-33680][SQL][TESTS] Fix PrunePartitionSuiteBase/BucketedReadWithHiveSupportSuite not to depend on the default conf

SparkQA commented on pull request #30631: URL: https://github.com/apache/spark/pull/30631#issuecomment-739607053 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36906/

[GitHub] [spark] HyukjinKwon closed pull request #30630: [SPARK-33675][INFRA][3.0] Add GitHub Action job to publish snapshot

HyukjinKwon closed pull request #30630: URL: https://github.com/apache/spark/pull/30630 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] HyukjinKwon closed pull request #30629: [SPARK-33675][INFRA][2.4] Add GitHub Action job to publish snapshot

HyukjinKwon closed pull request #30629: URL: https://github.com/apache/spark/pull/30629 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] HyukjinKwon edited a comment on pull request #30623: [SPARK-33675][INFRA] Add GitHub Action job to publish snapshot

HyukjinKwon edited a comment on pull request #30623: URL: https://github.com/apache/spark/pull/30623#issuecomment-739605537 Merged to master and branch-3.1. This is an automated message from the Apache Git Service. To

[GitHub] [spark] HyukjinKwon commented on pull request #30629: [SPARK-33675][INFRA][2.4] Add GitHub Action job to publish snapshot

HyukjinKwon commented on pull request #30629: URL: https://github.com/apache/spark/pull/30629#issuecomment-739606172 Merged to branch-2.4. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] HyukjinKwon commented on pull request #30630: [SPARK-33675][INFRA][3.0] Add GitHub Action job to publish snapshot

HyukjinKwon commented on pull request #30630: URL: https://github.com/apache/spark/pull/30630#issuecomment-739606116 Merged to branch-3.0. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] HyukjinKwon closed pull request #30623: [SPARK-33675][INFRA] Add GitHub Action job to publish snapshot

HyukjinKwon closed pull request #30623: URL: https://github.com/apache/spark/pull/30623 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] SparkQA removed a comment on pull request #30632: [SPARK-33681][K8S][TESTS][3.0] Increase K8s IT timeout to 3 minutes

SparkQA removed a comment on pull request #30632: URL: https://github.com/apache/spark/pull/30632#issuecomment-739599687 **[Test build #132308 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132308/testReport)** for PR 30632 at commit

[GitHub] [spark] HyukjinKwon commented on pull request #30623: [SPARK-33675][INFRA] Add GitHub Action job to publish snapshot

HyukjinKwon commented on pull request #30623: URL: https://github.com/apache/spark/pull/30623#issuecomment-739605537 Merged to master. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] SparkQA commented on pull request #30632: [SPARK-33681][K8S][TESTS][3.0] Increase K8s IT timeout to 3 minutes

SparkQA commented on pull request #30632: URL: https://github.com/apache/spark/pull/30632#issuecomment-739604775 **[Test build #132308 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132308/testReport)** for PR 30632 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #30629: [SPARK-33675][INFRA][2.4] Add GitHub Action job to publish snapshot

SparkQA removed a comment on pull request #30629: URL: https://github.com/apache/spark/pull/30629#issuecomment-739578884 **[Test build #132304 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132304/testReport)** for PR 30629 at commit

[GitHub] [spark] SparkQA commented on pull request #30629: [SPARK-33675][INFRA][2.4] Add GitHub Action job to publish snapshot

SparkQA commented on pull request #30629: URL: https://github.com/apache/spark/pull/30629#issuecomment-739603713 **[Test build #132304 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132304/testReport)** for PR 30629 at commit

[GitHub] [spark] dongjoon-hyun commented on pull request #30632: [SPARK-33681][K8S][TESTS][3.0] Increase K8s IT timeout to 3 minutes

dongjoon-hyun commented on pull request #30632: URL: https://github.com/apache/spark/pull/30632#issuecomment-739602302 Could you review this, @ScrapCodes ? This is an automated message from the Apache Git Service. To respond

[GitHub] [spark] HyukjinKwon closed pull request #30608: [SPARK-33663][SQL] Uncaching should not be called on non-existing temp views.

HyukjinKwon closed pull request #30608: URL: https://github.com/apache/spark/pull/30608 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] HyukjinKwon commented on pull request #30608: [SPARK-33663][SQL] Uncaching should not be called on non-existing temp views.

HyukjinKwon commented on pull request #30608: URL: https://github.com/apache/spark/pull/30608#issuecomment-739601211 Merged to master and branch-3.1. This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] github-actions[bot] closed pull request #28947: [SPARK-32129][SQL] Support AQE skew join with Union

github-actions[bot] closed pull request #28947: URL: https://github.com/apache/spark/pull/28947 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [spark] github-actions[bot] closed pull request #25651: [SPARK-28948][SQL] Support passing all Table metadata in TableProvider

github-actions[bot] closed pull request #25651: URL: https://github.com/apache/spark/pull/25651 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [spark] github-actions[bot] commented on pull request #29243: [SPARK-32444][SQL] Infer filters from DPP

github-actions[bot] commented on pull request #29243: URL: https://github.com/apache/spark/pull/29243#issuecomment-739601194 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue

[GitHub] [spark] HyukjinKwon removed a comment on pull request #30610: [SPARK-33664][SQL] Migrate ALTER TABLE ... RENAME TO to use UnresolvedTableOrView to resolve identifier

HyukjinKwon removed a comment on pull request #30610: URL: https://github.com/apache/spark/pull/30610#issuecomment-739600949 Merged to master and branch-3.1. This is an automated message from the Apache Git Service. To

[GitHub] [spark] HyukjinKwon commented on pull request #30610: [SPARK-33664][SQL] Migrate ALTER TABLE ... RENAME TO to use UnresolvedTableOrView to resolve identifier

HyukjinKwon commented on pull request #30610: URL: https://github.com/apache/spark/pull/30610#issuecomment-739600949 Merged to master and branch-3.1. This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] SparkQA commented on pull request #30532: [MINOR] Spelling sql not core

SparkQA commented on pull request #30532: URL: https://github.com/apache/spark/pull/30532#issuecomment-739601079 **[Test build #132309 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132309/testReport)** for PR 30532 at commit

[GitHub] [spark] maropu commented on pull request #30532: [MINOR] Spelling sql not core

maropu commented on pull request #30532: URL: https://github.com/apache/spark/pull/30532#issuecomment-739600333 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] maropu commented on pull request #30584: [SPARK-33472][SQL][FOLLOW-UP] Update RemoveRedundantSorts comment

maropu commented on pull request #30584: URL: https://github.com/apache/spark/pull/30584#issuecomment-739599709 Thanks for the update, @allisonwang-db This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] SparkQA commented on pull request #30632: [SPARK-33681][K8S][TESTS][3.0] Increase K8s IT timeout to 3 minutes

SparkQA commented on pull request #30632: URL: https://github.com/apache/spark/pull/30632#issuecomment-739599687 **[Test build #132308 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132308/testReport)** for PR 30632 at commit

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30631: [SPARK-33680][SQL][TESTS] Fix PrunePartitionSuiteBase/BucketedReadWithHiveSupportSuite not to depend on the default conf

dongjoon-hyun commented on a change in pull request #30631: URL: https://github.com/apache/spark/pull/30631#discussion_r537163061 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/sources/BucketedReadWithHiveSupportSuite.scala ## @@ -18,11 +18,18 @@ package

[GitHub] [spark] maropu commented on a change in pull request #30631: [SPARK-33680][SQL][TESTS] Fix PrunePartitionSuiteBase/BucketedReadWithHiveSupportSuite not to depend on the default conf

maropu commented on a change in pull request #30631: URL: https://github.com/apache/spark/pull/30631#discussion_r537162565 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/sources/BucketedReadWithHiveSupportSuite.scala ## @@ -18,11 +18,18 @@ package

[GitHub] [spark] dongjoon-hyun opened a new pull request #30632: [SPARK-33681][K8S][TESTS][3.0] Increase K8s IT timeout to 3 minutes

dongjoon-hyun opened a new pull request #30632: URL: https://github.com/apache/spark/pull/30632 ### What changes were proposed in this pull request? ### Why are the changes needed? ### Does this PR introduce _any_ user-facing change? ###

[GitHub] [spark] SparkQA commented on pull request #30623: [SPARK-33675][INFRA] Add GitHub Action job to publish snapshot

SparkQA commented on pull request #30623: URL: https://github.com/apache/spark/pull/30623#issuecomment-739597281 **[Test build #132307 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132307/testReport)** for PR 30623 at commit

[GitHub] [spark] SparkQA commented on pull request #30631: [SPARK-33680][SQL][TESTS] Fix PrunePartitionSuiteBase/BucketedReadWithHiveSupportSuite not to depend on the default conf

SparkQA commented on pull request #30631: URL: https://github.com/apache/spark/pull/30631#issuecomment-739597038 **[Test build #132306 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132306/testReport)** for PR 30631 at commit

[GitHub] [spark] maropu commented on pull request #29966: [SPARK-33084][CORE][SQL] Add jar support ivy path

maropu commented on pull request #29966: URL: https://github.com/apache/spark/pull/29966#issuecomment-739596538 Thanks for this work, @AngersZh . Btw, are you planning to support a `ivy` schema in `--packages`, too?

[GitHub] [spark] maropu commented on pull request #29966: [SPARK-33084][CORE][SQL] Add jar support ivy path

maropu commented on pull request #29966: URL: https://github.com/apache/spark/pull/29966#issuecomment-739596092 > @maropu are there any more blockers from your side? I'd love to get this into the 3.1 release if possible. I'm neutral on this, but we don't basically merge a new

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30623: [SPARK-33675][INFRA] Add GitHub Action job to publish snapshot

AmplabJenkins removed a comment on pull request #30623: URL: https://github.com/apache/spark/pull/30623#issuecomment-739595753 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132302/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30629: [SPARK-33675][INFRA][2.4] Add GitHub Action job to publish snapshot

AmplabJenkins removed a comment on pull request #30629: URL: https://github.com/apache/spark/pull/30629#issuecomment-739595752 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36905/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30628: [SPARK-33679][SQL] Enable spark.sql.adaptive.enabled by default

AmplabJenkins removed a comment on pull request #30628: URL: https://github.com/apache/spark/pull/30628#issuecomment-739595750 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132303/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30630: [SPARK-33675][INFRA][3.0] Add GitHub Action job to publish snapshot

AmplabJenkins removed a comment on pull request #30630: URL: https://github.com/apache/spark/pull/30630#issuecomment-739595748 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36904/

[GitHub] [spark] AmplabJenkins commented on pull request #30629: [SPARK-33675][INFRA][2.4] Add GitHub Action job to publish snapshot

AmplabJenkins commented on pull request #30629: URL: https://github.com/apache/spark/pull/30629#issuecomment-739595752 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36905/

[GitHub] [spark] AmplabJenkins commented on pull request #30623: [SPARK-33675][INFRA] Add GitHub Action job to publish snapshot

AmplabJenkins commented on pull request #30623: URL: https://github.com/apache/spark/pull/30623#issuecomment-739595753 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132302/

[GitHub] [spark] AmplabJenkins commented on pull request #30628: [SPARK-33679][SQL] Enable spark.sql.adaptive.enabled by default

AmplabJenkins commented on pull request #30628: URL: https://github.com/apache/spark/pull/30628#issuecomment-739595750 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132303/

[GitHub] [spark] AmplabJenkins commented on pull request #30630: [SPARK-33675][INFRA][3.0] Add GitHub Action job to publish snapshot

AmplabJenkins commented on pull request #30630: URL: https://github.com/apache/spark/pull/30630#issuecomment-739595748 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36904/

[GitHub] [spark] SparkQA commented on pull request #30630: [SPARK-33675][INFRA][3.0] Add GitHub Action job to publish snapshot

SparkQA commented on pull request #30630: URL: https://github.com/apache/spark/pull/30630#issuecomment-739595401 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36904/

[GitHub] [spark] dongjoon-hyun commented on pull request #30631: [SPARK-33680][SQL][TESTS] Fix PrunePartitionSuiteBase/BucketedReadWithHiveSupportSuite not to depend on the default conf

dongjoon-hyun commented on pull request #30631: URL: https://github.com/apache/spark/pull/30631#issuecomment-739593803 Could you review this, @maropu and @viirya ? This is an automated message from the Apache Git Service. To

[GitHub] [spark] dongjoon-hyun opened a new pull request #30631: [SPARK-33680][SQL][TESTS] Fix PrunePartitionSuiteBase/BucketedReadWithHiveSupportSuite not to depend on the default conf

dongjoon-hyun opened a new pull request #30631: URL: https://github.com/apache/spark/pull/30631 ### What changes were proposed in this pull request? This PR updates `PrunePartitionSuiteBase/BucketedReadWithHiveSupportSuite` to have the require conf explicitly. ### Why are the

[GitHub] [spark] HyukjinKwon commented on pull request #30628: [SPARK-33679][SQL] Enable spark.sql.adaptive.enabled by default

HyukjinKwon commented on pull request #30628: URL: https://github.com/apache/spark/pull/30628#issuecomment-739591280 I'm okay with this. WDYT @maryannxue, @cloud-fan and @gatorsmile? This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #30629: [SPARK-33675][INFRA][2.4] Add GitHub Action job to publish snapshot

SparkQA commented on pull request #30629: URL: https://github.com/apache/spark/pull/30629#issuecomment-739590984 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36905/

[GitHub] [spark] SparkQA commented on pull request #30630: [SPARK-33675][INFRA][3.0] Add GitHub Action job to publish snapshot

SparkQA commented on pull request #30630: URL: https://github.com/apache/spark/pull/30630#issuecomment-739590470 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36904/

[GitHub] [spark] SparkQA removed a comment on pull request #30623: [SPARK-33675][INFRA] Add GitHub Action job to publish snapshot

SparkQA removed a comment on pull request #30623: URL: https://github.com/apache/spark/pull/30623#issuecomment-739568714 **[Test build #132302 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132302/testReport)** for PR 30623 at commit

[GitHub] [spark] maropu commented on a change in pull request #30586: [SPARK-33641][SQL] Invalidate new char/varchar types in public APIs that produce incorrect results

maropu commented on a change in pull request #30586: URL: https://github.com/apache/spark/pull/30586#discussion_r537154858 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -2954,6 +2954,15 @@ object SQLConf { .booleanConf

[GitHub] [spark] SparkQA commented on pull request #30623: [SPARK-33675][INFRA] Add GitHub Action job to publish snapshot

SparkQA commented on pull request #30623: URL: https://github.com/apache/spark/pull/30623#issuecomment-739590212 **[Test build #132302 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132302/testReport)** for PR 30623 at commit

[GitHub] [spark] dongjoon-hyun commented on pull request #30628: [SPARK-33679][SQL] Enable spark.sql.adaptive.enabled by default

dongjoon-hyun commented on pull request #30628: URL: https://github.com/apache/spark/pull/30628#issuecomment-739588646 BTW, I'll fix the following five failure in another PR because the test should not depend on the default configuration. ![Screen Shot 2020-12-06 at 3 57 57

[GitHub] [spark] SparkQA commented on pull request #30629: [SPARK-33675][INFRA][2.4] Add GitHub Action job to publish snapshot

SparkQA commented on pull request #30629: URL: https://github.com/apache/spark/pull/30629#issuecomment-739588595 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36905/

[GitHub] [spark] dongjoon-hyun commented on pull request #30628: [SPARK-33679][SQL] Enable spark.sql.adaptive.enabled by default

dongjoon-hyun commented on pull request #30628: URL: https://github.com/apache/spark/pull/30628#issuecomment-739588516 Yep, @viirya . I totally agree with you. This is an automated message from the Apache Git Service. To

[GitHub] [spark] dongjoon-hyun commented on pull request #30628: [SPARK-33679][SQL] Enable spark.sql.adaptive.enabled by default

dongjoon-hyun commented on pull request #30628: URL: https://github.com/apache/spark/pull/30628#issuecomment-739588430 Thank you, @maropu . Sure, I'll. The reason why I didn't put it here is that this PR is not a final one. Although we have enough time, we can revert this from Apache

[GitHub] [spark] viirya commented on pull request #30628: [SPARK-33679][SQL] Enable spark.sql.adaptive.enabled by default

viirya commented on pull request #30628: URL: https://github.com/apache/spark/pull/30628#issuecomment-739588249 I think it is okay. As this is for 3.2, we still can change it if we have new concern later. This is an

[GitHub] [spark] SparkQA removed a comment on pull request #30628: [SPARK-33679][SQL] Enable spark.sql.adaptive.enabled by default

SparkQA removed a comment on pull request #30628: URL: https://github.com/apache/spark/pull/30628#issuecomment-739576229 **[Test build #132303 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132303/testReport)** for PR 30628 at commit

[GitHub] [spark] SparkQA commented on pull request #30628: [SPARK-33679][SQL] Enable spark.sql.adaptive.enabled by default

SparkQA commented on pull request #30628: URL: https://github.com/apache/spark/pull/30628#issuecomment-739588056 **[Test build #132303 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132303/testReport)** for PR 30628 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30628: [SPARK-33679][SQL] Enable spark.sql.adaptive.enabled by default

AmplabJenkins removed a comment on pull request #30628: URL: https://github.com/apache/spark/pull/30628#issuecomment-739587638 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36903/

[GitHub] [spark] AmplabJenkins commented on pull request #30628: [SPARK-33679][SQL] Enable spark.sql.adaptive.enabled by default

AmplabJenkins commented on pull request #30628: URL: https://github.com/apache/spark/pull/30628#issuecomment-739587638 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36903/

[GitHub] [spark] maropu commented on pull request #30628: [SPARK-33679][SQL] Enable spark.sql.adaptive.enabled by default

maropu commented on pull request #30628: URL: https://github.com/apache/spark/pull/30628#issuecomment-739586439 Looks fine. I think It would be nicer to write something about this default behaviour change in the v3.2 release note or somewhere so that users can quickly notice it.

[GitHub] [spark] SparkQA commented on pull request #30630: [SPARK-33675][INFRA][3.0] Add GitHub Action job to publish snapshot

SparkQA commented on pull request #30630: URL: https://github.com/apache/spark/pull/30630#issuecomment-739585064 **[Test build #132305 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132305/testReport)** for PR 30630 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30517: [DO-NOT-MERGE][test-maven] Test compatibility for Parquet 1.11.1, Avro 1.10.1 and Hive 2.3.8

AmplabJenkins removed a comment on pull request #30517: URL: https://github.com/apache/spark/pull/30517#issuecomment-739584460 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132294/

<    1   2   3   4   5   6   >