[GitHub] [spark] AmplabJenkins removed a comment on pull request #30559: [SPARK-33617][SQL] Add default parallelism configuration for Spark SQL queries

2020-12-06 Thread GitBox
AmplabJenkins removed a comment on pull request #30559: URL: https://github.com/apache/spark/pull/30559#issuecomment-739521054 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36894/

[GitHub] [spark] AmplabJenkins commented on pull request #30559: [SPARK-33617][SQL] Add default parallelism configuration for Spark SQL queries

2020-12-06 Thread GitBox
AmplabJenkins commented on pull request #30559: URL: https://github.com/apache/spark/pull/30559#issuecomment-739521054 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36894/

[GitHub] [spark] AmplabJenkins commented on pull request #29642: [SPARK-32792][SQL] Improve InSet filter pushdown

2020-12-06 Thread GitBox
AmplabJenkins commented on pull request #29642: URL: https://github.com/apache/spark/pull/29642#issuecomment-739521014 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36896/

[GitHub] [spark] SparkQA commented on pull request #29642: [SPARK-32792][SQL] Improve InSet filter pushdown

2020-12-06 Thread GitBox
SparkQA commented on pull request #29642: URL: https://github.com/apache/spark/pull/29642#issuecomment-739521006 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36896/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30517: [DO-NOT-MERGE][test-maven] Test compatibility for Parquet 1.11.1, Avro 1.10.1 and Hive 2.3.8

2020-12-06 Thread GitBox
AmplabJenkins removed a comment on pull request #30517: URL: https://github.com/apache/spark/pull/30517#issuecomment-739519958 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36893/

[GitHub] [spark] SparkQA commented on pull request #30517: [DO-NOT-MERGE][test-maven] Test compatibility for Parquet 1.11.1, Avro 1.10.1 and Hive 2.3.8

2020-12-06 Thread GitBox
SparkQA commented on pull request #30517: URL: https://github.com/apache/spark/pull/30517#issuecomment-739519951 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36893/

[GitHub] [spark] AmplabJenkins commented on pull request #30517: [DO-NOT-MERGE][test-maven] Test compatibility for Parquet 1.11.1, Avro 1.10.1 and Hive 2.3.8

2020-12-06 Thread GitBox
AmplabJenkins commented on pull request #30517: URL: https://github.com/apache/spark/pull/30517#issuecomment-739519958 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36893/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30625: [SPARK-33677][SQL] Skip LikeSimplification rule if escape is a wildcard character

2020-12-06 Thread GitBox
AmplabJenkins removed a comment on pull request #30625: URL: https://github.com/apache/spark/pull/30625#issuecomment-739518721 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36891/

[GitHub] [spark] AmplabJenkins commented on pull request #30625: [SPARK-33677][SQL] Skip LikeSimplification rule if escape is a wildcard character

2020-12-06 Thread GitBox
AmplabJenkins commented on pull request #30625: URL: https://github.com/apache/spark/pull/30625#issuecomment-739518721 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36891/

[GitHub] [spark] SparkQA commented on pull request #29642: [SPARK-32792][SQL] Improve InSet filter pushdown

2020-12-06 Thread GitBox
SparkQA commented on pull request #29642: URL: https://github.com/apache/spark/pull/29642#issuecomment-739516555 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36896/

[GitHub] [spark] SparkQA commented on pull request #30517: [DO-NOT-MERGE][test-maven] Test compatibility for Parquet 1.11.1, Avro 1.10.1 and Hive 2.3.8

2020-12-06 Thread GitBox
SparkQA commented on pull request #30517: URL: https://github.com/apache/spark/pull/30517#issuecomment-739516081 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36895/

[GitHub] [spark] SparkQA commented on pull request #30625: [SPARK-33677][SQL] Skip LikeSimplification rule if escape is a wildcard character

2020-12-06 Thread GitBox
SparkQA commented on pull request #30625: URL: https://github.com/apache/spark/pull/30625#issuecomment-739513597 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36891/

[GitHub] [spark] SparkQA commented on pull request #30331: [SPARK-33128][SQL] Remove EXCEPT, INTERSECT, MINUS, UNION from strictNonReserved

2020-12-06 Thread GitBox
SparkQA commented on pull request #30331: URL: https://github.com/apache/spark/pull/30331#issuecomment-739512341 **[Test build #132296 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132296/testReport)** for PR 30331 at commit

[GitHub] [spark] wangyum commented on pull request #30621: [SPARK-33674] [TEST] Show Slowpoke notifications in SBT tests

2020-12-06 Thread GitBox
wangyum commented on pull request #30621: URL: https://github.com/apache/spark/pull/30621#issuecomment-739511784 Merged to master. This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30624: [SPARK-33676][SQL] Require exact matching of partition spec to the schema in V2 `ALTER TABLE .. ADD/DROP PARTITION`

2020-12-06 Thread GitBox
AmplabJenkins removed a comment on pull request #30624: URL: https://github.com/apache/spark/pull/30624#issuecomment-739511589 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36892/

[GitHub] [spark] wangyum closed pull request #30621: [SPARK-33674] [TEST] Show Slowpoke notifications in SBT tests

2020-12-06 Thread GitBox
wangyum closed pull request #30621: URL: https://github.com/apache/spark/pull/30621 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [spark] SparkQA commented on pull request #30624: [SPARK-33676][SQL] Require exact matching of partition spec to the schema in V2 `ALTER TABLE .. ADD/DROP PARTITION`

2020-12-06 Thread GitBox
SparkQA commented on pull request #30624: URL: https://github.com/apache/spark/pull/30624#issuecomment-739511583 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36892/

[GitHub] [spark] AmplabJenkins commented on pull request #30624: [SPARK-33676][SQL] Require exact matching of partition spec to the schema in V2 `ALTER TABLE .. ADD/DROP PARTITION`

2020-12-06 Thread GitBox
AmplabJenkins commented on pull request #30624: URL: https://github.com/apache/spark/pull/30624#issuecomment-739511589 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36892/

[GitHub] [spark] SparkQA commented on pull request #29642: [SPARK-32792][SQL] Improve InSet filter pushdown

2020-12-06 Thread GitBox
SparkQA commented on pull request #29642: URL: https://github.com/apache/spark/pull/29642#issuecomment-739511388 **[Test build #132295 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132295/testReport)** for PR 29642 at commit

[GitHub] [spark] SparkQA commented on pull request #30517: [DO-NOT-MERGE][test-maven] Test compatibility for Parquet 1.11.1, Avro 1.10.1 and Hive 2.3.8

2020-12-06 Thread GitBox
SparkQA commented on pull request #30517: URL: https://github.com/apache/spark/pull/30517#issuecomment-739511299 **[Test build #132294 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132294/testReport)** for PR 30517 at commit

[GitHub] [spark] SparkQA commented on pull request #30559: [SPARK-33617][SQL] Add default parallelism configuration for Spark SQL queries

2020-12-06 Thread GitBox
SparkQA commented on pull request #30559: URL: https://github.com/apache/spark/pull/30559#issuecomment-739511266 **[Test build #132293 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132293/testReport)** for PR 30559 at commit

[GitHub] [spark] wangyum commented on pull request #30517: [DO-NOT-MERGE][test-maven] Test compatibility for Parquet 1.11.1, Avro 1.10.1 and Hive 2.3.8

2020-12-06 Thread GitBox
wangyum commented on pull request #30517: URL: https://github.com/apache/spark/pull/30517#issuecomment-739509750 retest this please. This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] SparkQA commented on pull request #30625: [SPARK-33677][SQL] Skip LikeSimplification rule if escape is a wildcard character

2020-12-06 Thread GitBox
SparkQA commented on pull request #30625: URL: https://github.com/apache/spark/pull/30625#issuecomment-739509156 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36891/

[GitHub] [spark] SparkQA commented on pull request #30517: [DO-NOT-MERGE][test-maven] Test compatibility for Parquet 1.11.1, Avro 1.10.1 and Hive 2.3.8

2020-12-06 Thread GitBox
SparkQA commented on pull request #30517: URL: https://github.com/apache/spark/pull/30517#issuecomment-739508188 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36893/

[GitHub] [spark] wangyum commented on a change in pull request #30600: [SPARK-33655][SQL] Improve performance of processing FETCH_PRIOR

2020-12-06 Thread GitBox
wangyum commented on a change in pull request #30600: URL: https://github.com/apache/spark/pull/30600#discussion_r537046807 ## File path: sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/SparkExecuteStatementOperation.scala ## @@ -148,43 +142,10 @@

[GitHub] [spark] SparkQA commented on pull request #30624: [SPARK-33676][SQL] Require exact matching of partition spec to the schema in V2 `ALTER TABLE .. ADD/DROP PARTITION`

2020-12-06 Thread GitBox
SparkQA commented on pull request #30624: URL: https://github.com/apache/spark/pull/30624#issuecomment-739508039 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36892/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30586: [SPARK-33641][SQL] Invalidate new char/varchar types in public APIs that produce incorrect results

2020-12-06 Thread GitBox
AmplabJenkins removed a comment on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-739503762 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36890/

[GitHub] [spark] AmplabJenkins commented on pull request #30586: [SPARK-33641][SQL] Invalidate new char/varchar types in public APIs that produce incorrect results

2020-12-06 Thread GitBox
AmplabJenkins commented on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-739503762 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36890/

[GitHub] [spark] SparkQA commented on pull request #30586: [SPARK-33641][SQL] Invalidate new char/varchar types in public APIs that produce incorrect results

2020-12-06 Thread GitBox
SparkQA commented on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-739503755 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36890/

[GitHub] [spark] SparkQA commented on pull request #30625: [SPARK-33677][SQL] Skip LikeSimplification rule if escape is a wildcard character

2020-12-06 Thread GitBox
SparkQA commented on pull request #30625: URL: https://github.com/apache/spark/pull/30625#issuecomment-739503318 **[Test build #132290 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132290/testReport)** for PR 30625 at commit

[GitHub] [spark] SparkQA commented on pull request #30517: [DO-NOT-MERGE][test-maven] Test compatibility for Parquet 1.11.1, Avro 1.10.1 and Hive 2.3.8

2020-12-06 Thread GitBox
SparkQA commented on pull request #30517: URL: https://github.com/apache/spark/pull/30517#issuecomment-739503305 **[Test build #132292 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132292/testReport)** for PR 30517 at commit

[GitHub] [spark] SparkQA commented on pull request #30624: [SPARK-33676][SQL] Require exact matching of partition spec to the schema in V2 `ALTER TABLE .. ADD/DROP PARTITION`

2020-12-06 Thread GitBox
SparkQA commented on pull request #30624: URL: https://github.com/apache/spark/pull/30624#issuecomment-739503273 **[Test build #132291 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132291/testReport)** for PR 30624 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30517: [DO-NOT-MERGE][test-maven] Test compatibility for Parquet 1.11.1, Avro 1.10.1 and Hive 2.3.8

2020-12-06 Thread GitBox
AmplabJenkins removed a comment on pull request #30517: URL: https://github.com/apache/spark/pull/30517#issuecomment-739502842 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132282/

[GitHub] [spark] AmplabJenkins commented on pull request #30624: [SPARK-33676][SQL] Require exact matching of partition spec to the schema in V2 `ALTER TABLE .. ADD/DROP PARTITION`

2020-12-06 Thread GitBox
AmplabJenkins commented on pull request #30624: URL: https://github.com/apache/spark/pull/30624#issuecomment-739502840 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132287/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30624: [SPARK-33676][SQL] Require exact matching of partition spec to the schema in V2 `ALTER TABLE .. ADD/DROP PARTITION`

2020-12-06 Thread GitBox
AmplabJenkins removed a comment on pull request #30624: URL: https://github.com/apache/spark/pull/30624#issuecomment-739502840 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132287/

[GitHub] [spark] AmplabJenkins commented on pull request #30517: [DO-NOT-MERGE][test-maven] Test compatibility for Parquet 1.11.1, Avro 1.10.1 and Hive 2.3.8

2020-12-06 Thread GitBox
AmplabJenkins commented on pull request #30517: URL: https://github.com/apache/spark/pull/30517#issuecomment-739502842 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132282/

[GitHub] [spark] MaxGekk commented on pull request #30624: [SPARK-33676][SQL] Require exact matching of partition spec to the schema in V2 `ALTER TABLE .. ADD/DROP PARTITION`

2020-12-06 Thread GitBox
MaxGekk commented on pull request #30624: URL: https://github.com/apache/spark/pull/30624#issuecomment-739502680 Jenkins, retest this, please This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] SparkQA removed a comment on pull request #30624: [SPARK-33676][SQL] Require exact matching of partition spec to the schema in V2 `ALTER TABLE .. ADD/DROP PARTITION`

2020-12-06 Thread GitBox
SparkQA removed a comment on pull request #30624: URL: https://github.com/apache/spark/pull/30624#issuecomment-739477577 **[Test build #132287 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132287/testReport)** for PR 30624 at commit

[GitHub] [spark] SparkQA commented on pull request #30624: [SPARK-33676][SQL] Require exact matching of partition spec to the schema in V2 `ALTER TABLE .. ADD/DROP PARTITION`

2020-12-06 Thread GitBox
SparkQA commented on pull request #30624: URL: https://github.com/apache/spark/pull/30624#issuecomment-739502345 **[Test build #132287 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132287/testReport)** for PR 30624 at commit

[GitHub] [spark] wangyum commented on pull request #30517: [DO-NOT-MERGE][test-maven] Test compatibility for Parquet 1.11.1, Avro 1.10.1 and Hive 2.3.8

2020-12-06 Thread GitBox
wangyum commented on pull request #30517: URL: https://github.com/apache/spark/pull/30517#issuecomment-739500874 retest this please. This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] SparkQA commented on pull request #30586: [SPARK-33641][SQL] Invalidate new char/varchar types in public APIs that produce incorrect results

2020-12-06 Thread GitBox
SparkQA commented on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-739500517 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36890/

[GitHub] [spark] luluorta commented on pull request #30625: [SPARK-33677][SQL] Skip LikeSimplification rule if escape is a wildcard character

2020-12-06 Thread GitBox
luluorta commented on pull request #30625: URL: https://github.com/apache/spark/pull/30625#issuecomment-739499601 cc @cloud-fan @leanken This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] luluorta opened a new pull request #30625: [SPARK-33677][SQL] Skip LikeSimplification rule if escape is a wildcard character

2020-12-06 Thread GitBox
luluorta opened a new pull request #30625: URL: https://github.com/apache/spark/pull/30625 ### What changes were proposed in this pull request? This PR makes LikeSimplification rule be skipped if escape is a wildcard character cause it does not correctly handle this case. ###

[GitHub] [spark] HyukjinKwon commented on pull request #30622: [SPARK-33256][PYTHON][DOCS] Clarify PySpark follows NumPy documentation style

2020-12-06 Thread GitBox
HyukjinKwon commented on pull request #30622: URL: https://github.com/apache/spark/pull/30622#issuecomment-739498180 That's a good idea. We should also better have one way to link classes e.g.) :py:class vs :class:. I'm sure we can have many things to clarify, and this is just the minimum

[GitHub] [spark] SparkQA commented on pull request #30586: [SPARK-33641][SQL] Invalidate new char/varchar types in public APIs that produce incorrect results

2020-12-06 Thread GitBox
SparkQA commented on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-739496271 **[Test build #132289 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132289/testReport)** for PR 30586 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30623: [SPARK-33675][INFRA] Add GitHub Action job to publish snapshot

2020-12-06 Thread GitBox
AmplabJenkins removed a comment on pull request #30623: URL: https://github.com/apache/spark/pull/30623#issuecomment-739495930 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132288/

[GitHub] [spark] AmplabJenkins commented on pull request #30623: [SPARK-33675][INFRA] Add GitHub Action job to publish snapshot

2020-12-06 Thread GitBox
AmplabJenkins commented on pull request #30623: URL: https://github.com/apache/spark/pull/30623#issuecomment-739495930 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132288/

[GitHub] [spark] zero323 commented on pull request #30622: [SPARK-33256][PYTHON][DOCS] Clarify PySpark follows NumPy documentation style

2020-12-06 Thread GitBox
zero323 commented on pull request #30622: URL: https://github.com/apache/spark/pull/30622#issuecomment-739493866 Thanks for working on this @HyukjinKwon! Looks good, but I wonder if we should add a note about `versionadded` / `since`? It can mess up the formatting in different

[GitHub] [spark] yaooqinn commented on pull request #30586: [SPARK-33641][SQL] Invalidate new char/varchar types in public APIs that produce incorrect results

2020-12-06 Thread GitBox
yaooqinn commented on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-739493842 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] SparkQA removed a comment on pull request #30623: [SPARK-33675][INFRA] Add GitHub Action job to publish snapshot

2020-12-06 Thread GitBox
SparkQA removed a comment on pull request #30623: URL: https://github.com/apache/spark/pull/30623#issuecomment-739477549 **[Test build #132288 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132288/testReport)** for PR 30623 at commit

[GitHub] [spark] SparkQA commented on pull request #30623: [SPARK-33675][INFRA] Add GitHub Action job to publish snapshot

2020-12-06 Thread GitBox
SparkQA commented on pull request #30623: URL: https://github.com/apache/spark/pull/30623#issuecomment-739491644 **[Test build #132288 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132288/testReport)** for PR 30623 at commit

[GitHub] [spark] dongjoon-hyun edited a comment on pull request #30623: [SPARK-33675][INFRA] Add GitHub Action job to publish snapshot

2020-12-06 Thread GitBox
dongjoon-hyun edited a comment on pull request #30623: URL: https://github.com/apache/spark/pull/30623#issuecomment-739486697 BTW, Apache Infra team finished the setup. ([INFRA-21167](https://issues.apache.org/jira/browse/INFRA-21167)). This PR is ready.

[GitHub] [spark] dongjoon-hyun commented on pull request #30623: [SPARK-33675][INFRA] Add GitHub Action job to publish snapshot

2020-12-06 Thread GitBox
dongjoon-hyun commented on pull request #30623: URL: https://github.com/apache/spark/pull/30623#issuecomment-739486697 BTW, Apache Infra team finished the setup. (INFRA-21167). This PR is ready. This is an automated message

[GitHub] [spark] dongjoon-hyun commented on pull request #30623: [SPARK-33675][INFRA] Add GitHub Action job to publish snapshot

2020-12-06 Thread GitBox
dongjoon-hyun commented on pull request #30623: URL: https://github.com/apache/spark/pull/30623#issuecomment-739486467 Thanks for information. Yes, we need an official one. This is an automated message from the Apache Git

[GitHub] [spark] HyukjinKwon edited a comment on pull request #30623: [SPARK-33675][INFRA] Add GitHub Action job to publish snapshot

2020-12-06 Thread GitBox
HyukjinKwon edited a comment on pull request #30623: URL: https://github.com/apache/spark/pull/30623#issuecomment-739486269 Oh actually @wangyum managed to do it with GitHub packages in his fork. Maybe we could take a look and see if we can leverage that. Will take a close look tomorrow

[GitHub] [spark] HyukjinKwon commented on pull request #30623: [SPARK-33675][INFRA] Add GitHub Action job to publish snapshot

2020-12-06 Thread GitBox
HyukjinKwon commented on pull request #30623: URL: https://github.com/apache/spark/pull/30623#issuecomment-739486269 Oh actually @wangyum managed to do it with GitHub packages maybe we could take a look and see if we can leverage that. Will take a close look tomorrow but I support this

[GitHub] [spark] dongjoon-hyun commented on pull request #30615: [SPARK-33667][SQL] Respect the `spark.sql.caseSensitive` config while resolving partition spec in v1 `SHOW PARTITIONS`

2020-12-06 Thread GitBox
dongjoon-hyun commented on pull request #30615: URL: https://github.com/apache/spark/pull/30615#issuecomment-739486186 Merged to master/3.1. Could you make a backport for branch-3.0 and branch-2.4, @MaxGekk ? This is an

[GitHub] [spark] dongjoon-hyun closed pull request #30615: [SPARK-33667][SQL] Respect the `spark.sql.caseSensitive` config while resolving partition spec in v1 `SHOW PARTITIONS`

2020-12-06 Thread GitBox
dongjoon-hyun closed pull request #30615: URL: https://github.com/apache/spark/pull/30615 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] HyukjinKwon commented on pull request #30622: [SPARK-33256][PYTHON][DOCS] Clarify PySpark follows NumPy documentation style

2020-12-06 Thread GitBox
HyukjinKwon commented on pull request #30622: URL: https://github.com/apache/spark/pull/30622#issuecomment-739485965 Thanks @dongjoon-hyun! This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30618: [SPARK-33670][SQL] Verify the partition provider is Hive in v1 SHOW TABLE EXTENDED

2020-12-06 Thread GitBox
AmplabJenkins removed a comment on pull request #30618: URL: https://github.com/apache/spark/pull/30618#issuecomment-739485386 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132284/

[GitHub] [spark] AmplabJenkins commented on pull request #30618: [SPARK-33670][SQL] Verify the partition provider is Hive in v1 SHOW TABLE EXTENDED

2020-12-06 Thread GitBox
AmplabJenkins commented on pull request #30618: URL: https://github.com/apache/spark/pull/30618#issuecomment-739485386 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132284/

[GitHub] [spark] SparkQA removed a comment on pull request #30618: [SPARK-33670][SQL] Verify the partition provider is Hive in v1 SHOW TABLE EXTENDED

2020-12-06 Thread GitBox
SparkQA removed a comment on pull request #30618: URL: https://github.com/apache/spark/pull/30618#issuecomment-739462762 **[Test build #132284 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132284/testReport)** for PR 30618 at commit

[GitHub] [spark] SparkQA commented on pull request #30618: [SPARK-33670][SQL] Verify the partition provider is Hive in v1 SHOW TABLE EXTENDED

2020-12-06 Thread GitBox
SparkQA commented on pull request #30618: URL: https://github.com/apache/spark/pull/30618#issuecomment-739485144 **[Test build #132284 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132284/testReport)** for PR 30618 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30608: [SPARK-33663][SQL] Uncaching should not be called on non-existing temp views.

2020-12-06 Thread GitBox
AmplabJenkins removed a comment on pull request #30608: URL: https://github.com/apache/spark/pull/30608#issuecomment-739485026 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132286/

[GitHub] [spark] AmplabJenkins commented on pull request #30608: [SPARK-33663][SQL] Uncaching should not be called on non-existing temp views.

2020-12-06 Thread GitBox
AmplabJenkins commented on pull request #30608: URL: https://github.com/apache/spark/pull/30608#issuecomment-739485026 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132286/

[GitHub] [spark] SparkQA removed a comment on pull request #30608: [SPARK-33663][SQL] Uncaching should not be called on non-existing temp views.

2020-12-06 Thread GitBox
SparkQA removed a comment on pull request #30608: URL: https://github.com/apache/spark/pull/30608#issuecomment-739462779 **[Test build #132286 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132286/testReport)** for PR 30608 at commit

[GitHub] [spark] SparkQA commented on pull request #30608: [SPARK-33663][SQL] Uncaching should not be called on non-existing temp views.

2020-12-06 Thread GitBox
SparkQA commented on pull request #30608: URL: https://github.com/apache/spark/pull/30608#issuecomment-739484800 **[Test build #132286 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132286/testReport)** for PR 30608 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30615: [SPARK-33667][SQL] Respect the `spark.sql.caseSensitive` config while resolving partition spec in v1 `SHOW PARTITIONS`

2020-12-06 Thread GitBox
AmplabJenkins removed a comment on pull request #30615: URL: https://github.com/apache/spark/pull/30615#issuecomment-739484577 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132285/

[GitHub] [spark] AmplabJenkins commented on pull request #30615: [SPARK-33667][SQL] Respect the `spark.sql.caseSensitive` config while resolving partition spec in v1 `SHOW PARTITIONS`

2020-12-06 Thread GitBox
AmplabJenkins commented on pull request #30615: URL: https://github.com/apache/spark/pull/30615#issuecomment-739484577 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132285/

[GitHub] [spark] SparkQA removed a comment on pull request #30615: [SPARK-33667][SQL] Respect the `spark.sql.caseSensitive` config while resolving partition spec in v1 `SHOW PARTITIONS`

2020-12-06 Thread GitBox
SparkQA removed a comment on pull request #30615: URL: https://github.com/apache/spark/pull/30615#issuecomment-739462767 **[Test build #132285 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132285/testReport)** for PR 30615 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30624: [SPARK-33676][SQL] Require exact matching of partition spec to the schema in V2 `ALTER TABLE .. ADD/DROP PARTITION`

2020-12-06 Thread GitBox
AmplabJenkins removed a comment on pull request #30624: URL: https://github.com/apache/spark/pull/30624#issuecomment-739484365 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36889/

[GitHub] [spark] SparkQA commented on pull request #30615: [SPARK-33667][SQL] Respect the `spark.sql.caseSensitive` config while resolving partition spec in v1 `SHOW PARTITIONS`

2020-12-06 Thread GitBox
SparkQA commented on pull request #30615: URL: https://github.com/apache/spark/pull/30615#issuecomment-739484403 **[Test build #132285 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132285/testReport)** for PR 30615 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #30624: [SPARK-33676][SQL] Require exact matching of partition spec to the schema in V2 `ALTER TABLE .. ADD/DROP PARTITION`

2020-12-06 Thread GitBox
AmplabJenkins commented on pull request #30624: URL: https://github.com/apache/spark/pull/30624#issuecomment-739484365 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36889/

[GitHub] [spark] SparkQA commented on pull request #30624: [SPARK-33676][SQL] Require exact matching of partition spec to the schema in V2 `ALTER TABLE .. ADD/DROP PARTITION`

2020-12-06 Thread GitBox
SparkQA commented on pull request #30624: URL: https://github.com/apache/spark/pull/30624#issuecomment-739484361 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36889/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30623: [SPARK-33675][INFRA] Add GitHub Action job to publish snapshot

2020-12-06 Thread GitBox
AmplabJenkins removed a comment on pull request #30623: URL: https://github.com/apache/spark/pull/30623#issuecomment-739483250 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36888/

[GitHub] [spark] AmplabJenkins commented on pull request #30623: [SPARK-33675][INFRA] Add GitHub Action job to publish snapshot

2020-12-06 Thread GitBox
AmplabJenkins commented on pull request #30623: URL: https://github.com/apache/spark/pull/30623#issuecomment-739483250 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36888/

[GitHub] [spark] SparkQA commented on pull request #30624: [SPARK-33676][SQL] Require exact matching of partition spec to the schema in V2 `ALTER TABLE .. ADD/DROP PARTITION`

2020-12-06 Thread GitBox
SparkQA commented on pull request #30624: URL: https://github.com/apache/spark/pull/30624#issuecomment-739481570 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36889/

[GitHub] [spark] SparkQA commented on pull request #30623: [SPARK-33675][INFRA] Add GitHub Action job to publish snapshot

2020-12-06 Thread GitBox
SparkQA commented on pull request #30623: URL: https://github.com/apache/spark/pull/30623#issuecomment-739479942 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36888/

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30559: [SPARK-33617][SQL] Add default parallelism configuration for Spark SQL queries

2020-12-06 Thread GitBox
dongjoon-hyun commented on a change in pull request #30559: URL: https://github.com/apache/spark/pull/30559#discussion_r536998420 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -386,6 +386,14 @@ object SQLConf { .booleanConf

[GitHub] [spark] dongjoon-hyun commented on pull request #30577: [SPARK-33621][SQL] Add a way to inject data source rewrite rules

2020-12-06 Thread GitBox
dongjoon-hyun commented on pull request #30577: URL: https://github.com/apache/spark/pull/30577#issuecomment-739477716 Gentle ping, @aokolnychyi . > Will do today, @dongjoon-hyun! This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #30624: [SPARK-33676][SQL] Require exact matching of partition spec to the schema in V2 `ALTER TABLE .. ADD/DROP PARTITION`

2020-12-06 Thread GitBox
SparkQA commented on pull request #30624: URL: https://github.com/apache/spark/pull/30624#issuecomment-739477577 **[Test build #132287 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132287/testReport)** for PR 30624 at commit

[GitHub] [spark] SparkQA commented on pull request #30623: [SPARK-33675][INFRA] Add GitHub Action job to publish snapshot

2020-12-06 Thread GitBox
SparkQA commented on pull request #30623: URL: https://github.com/apache/spark/pull/30623#issuecomment-739477549 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] dongjoon-hyun edited a comment on pull request #30206: [SPARK-33261][K8S] Add a developer API for custom feature steps

2020-12-06 Thread GitBox
dongjoon-hyun edited a comment on pull request #30206: URL: https://github.com/apache/spark/pull/30206#issuecomment-739477332 Since we have an agreement, could you resolve the conflict to proceed further, @holdenk ? Also, please update the PR according to the existing comments.

[GitHub] [spark] dongjoon-hyun commented on pull request #30206: [SPARK-33261][K8S] Add a developer API for custom feature steps

2020-12-06 Thread GitBox
dongjoon-hyun commented on pull request #30206: URL: https://github.com/apache/spark/pull/30206#issuecomment-739477332 Since we have an agreement, could you resolve the conflict to proceed further, @holdenk ? This is an

[GitHub] [spark] MaxGekk opened a new pull request #30624: [SPARK-33676][SQL] Require exact matching of partition spec to the schema in V2 `ALTER TABLE .. ADD/DROP PARTITION`

2020-12-06 Thread GitBox
MaxGekk opened a new pull request #30624: URL: https://github.com/apache/spark/pull/30624 ### What changes were proposed in this pull request? Check that partitions specs passed to v2 `ALTER TABLE .. ADD/DROP PARTITION` are exactly matched to the partition schema (all partition fields

[GitHub] [spark] dongjoon-hyun closed pull request #30622: [SPARK-33256][PYTHON][DOCS] Clarify PySpark follows NumPy documentation style

2020-12-06 Thread GitBox
dongjoon-hyun closed pull request #30622: URL: https://github.com/apache/spark/pull/30622 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] dongjoon-hyun closed pull request #30597: [SPARK-33652][SQL] DSv2: DeleteFrom should refresh cache

2020-12-06 Thread GitBox
dongjoon-hyun closed pull request #30597: URL: https://github.com/apache/spark/pull/30597 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] dongjoon-hyun opened a new pull request #30623: [SPARK-33675][INFRA] Add GitHub Action job to publish snapshot

2020-12-06 Thread GitBox
dongjoon-hyun opened a new pull request #30623: URL: https://github.com/apache/spark/pull/30623 ### What changes were proposed in this pull request? ### Why are the changes needed? ### Does this PR introduce _any_ user-facing change? ### How was

[GitHub] [spark] dongjoon-hyun edited a comment on pull request #30613: [WIP][SPARK-33666][SQL][TEST] Use a dedicate JVM for HiveThriftHttpServerSuite

2020-12-06 Thread GitBox
dongjoon-hyun edited a comment on pull request #30613: URL: https://github.com/apache/spark/pull/30613#issuecomment-739471403 Thanks so much. I closed this PR for now. I'll try to find a better solution. This is an automated

[GitHub] [spark] dongjoon-hyun edited a comment on pull request #30613: [WIP][SPARK-33666][SQL][TEST] Use a dedicate JVM for HiveThriftHttpServerSuite

2020-12-06 Thread GitBox
dongjoon-hyun edited a comment on pull request #30613: URL: https://github.com/apache/spark/pull/30613#issuecomment-739471403 Thanks so much. I closed this PR for now. This is an automated message from the Apache Git

[GitHub] [spark] dongjoon-hyun commented on pull request #30613: [WIP][SPARK-33666][SQL][TEST] Use a dedicate JVM for HiveThriftHttpServerSuite

2020-12-06 Thread GitBox
dongjoon-hyun commented on pull request #30613: URL: https://github.com/apache/spark/pull/30613#issuecomment-739471403 Thanks. I closed this PR for now. This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] dongjoon-hyun closed pull request #30613: [WIP][SPARK-33666][SQL][TEST] Use a dedicate JVM for HiveThriftHttpServerSuite

2020-12-06 Thread GitBox
dongjoon-hyun closed pull request #30613: URL: https://github.com/apache/spark/pull/30613 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

<    1   2   3   4   5   6