[GitHub] [spark] AmplabJenkins commented on pull request #29247: [SPARK-32446][SHS] Add percentile distribution REST API of peak memory metrics for all executors

2020-12-04 Thread GitBox
AmplabJenkins commented on pull request #29247: URL: https://github.com/apache/spark/pull/29247#issuecomment-738949370 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36838/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30606: [SPARK-33662][BUILD] Setting version to 3.2.0-SNAPSHOT

2020-12-04 Thread GitBox
AmplabJenkins removed a comment on pull request #30606: URL: https://github.com/apache/spark/pull/30606#issuecomment-738947653 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36837/

[GitHub] [spark] SparkQA commented on pull request #30606: [SPARK-33662][BUILD] Setting version to 3.2.0-SNAPSHOT

2020-12-04 Thread GitBox
SparkQA commented on pull request #30606: URL: https://github.com/apache/spark/pull/30606#issuecomment-738947633 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36837/

[GitHub] [spark] AmplabJenkins commented on pull request #30606: [SPARK-33662][BUILD] Setting version to 3.2.0-SNAPSHOT

2020-12-04 Thread GitBox
AmplabJenkins commented on pull request #30606: URL: https://github.com/apache/spark/pull/30606#issuecomment-738947653 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36837/

[GitHub] [spark] SparkQA commented on pull request #30312: [SPARK-32917][SHUFFLE][CORE] Adds support for executors to push shuffle blocks after successful map task completion

2020-12-04 Thread GitBox
SparkQA commented on pull request #30312: URL: https://github.com/apache/spark/pull/30312#issuecomment-738945639 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36842/

[GitHub] [spark] SparkQA commented on pull request #30598: [SPARK-33654][SQL] Migrate CACHE TABLE to use UnresolvedRelation to resolve identifier

2020-12-04 Thread GitBox
SparkQA commented on pull request #30598: URL: https://github.com/apache/spark/pull/30598#issuecomment-738943896 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36841/

[GitHub] [spark] xkrogen commented on pull request #29966: [SPARK-33084][CORE][SQL] Add jar support ivy path

2020-12-04 Thread GitBox
xkrogen commented on pull request #29966: URL: https://github.com/apache/spark/pull/29966#issuecomment-738936950 @maropu are there any more blockers from your side? I'd love to get this into the 3.1 release if possible. Last re-ping to @HeartSaVioR @srowen @gaborgsomogyi in case

[GitHub] [spark] SparkQA commented on pull request #30607: [MINOR][INFRA][3.1] Update branch name from master to branch-3.1 GitHub Action

2020-12-04 Thread GitBox
SparkQA commented on pull request #30607: URL: https://github.com/apache/spark/pull/30607#issuecomment-738936445 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36839/

[GitHub] [spark] SparkQA commented on pull request #29247: [SPARK-32446][SHS] Add percentile distribution REST API of peak memory metrics for all executors

2020-12-04 Thread GitBox
SparkQA commented on pull request #29247: URL: https://github.com/apache/spark/pull/29247#issuecomment-738932590 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36838/

[GitHub] [spark] SparkQA commented on pull request #30606: [SPARK-33662][BUILD] Setting version to 3.2.0-SNAPSHOT

2020-12-04 Thread GitBox
SparkQA commented on pull request #30606: URL: https://github.com/apache/spark/pull/30606#issuecomment-738931237 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36837/

[GitHub] [spark] dongjoon-hyun commented on pull request #30607: [MINOR][INFRA][3.1] Update branch name from master to branch-3.1 GitHub Action

2020-12-04 Thread GitBox
dongjoon-hyun commented on pull request #30607: URL: https://github.com/apache/spark/pull/30607#issuecomment-738929633 cc @srowen and @tgravescs , too This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] imback82 commented on a change in pull request #30598: [SPARK-33654][SQL] Migrate CACHE TABLE to use UnresolvedRelation to resolve identifier

2020-12-04 Thread GitBox
imback82 commented on a change in pull request #30598: URL: https://github.com/apache/spark/pull/30598#discussion_r536275320 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/v2Commands.scala ## @@ -706,3 +705,13 @@ case class

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30586: [SPARK-33641][SQL] Invalidate new char/varchar types in public APIs that produce incorrect results

2020-12-04 Thread GitBox
AmplabJenkins removed a comment on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738921094 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132236/

[GitHub] [spark] AmplabJenkins commented on pull request #30586: [SPARK-33641][SQL] Invalidate new char/varchar types in public APIs that produce incorrect results

2020-12-04 Thread GitBox
AmplabJenkins commented on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738921094 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132236/

[GitHub] [spark] SparkQA removed a comment on pull request #30586: [SPARK-33641][SQL] Invalidate new char/varchar types in public APIs that produce incorrect results

2020-12-04 Thread GitBox
SparkQA removed a comment on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738817589 **[Test build #132236 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132236/testReport)** for PR 30586 at commit

[GitHub] [spark] SparkQA commented on pull request #30586: [SPARK-33641][SQL] Invalidate new char/varchar types in public APIs that produce incorrect results

2020-12-04 Thread GitBox
SparkQA commented on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738920354 **[Test build #132236 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132236/testReport)** for PR 30586 at commit

[GitHub] [spark] otterc commented on pull request #30312: [SPARK-32917][SHUFFLE][CORE] Adds support for executors to push shuffle blocks after successful map task completion

2020-12-04 Thread GitBox
otterc commented on pull request #30312: URL: https://github.com/apache/spark/pull/30312#issuecomment-738918713 I have addressed all the review comments so far. cc @Ngone51 @Victsm @mridulm @dongjoon-hyun This is an

[GitHub] [spark] otterc commented on a change in pull request #30312: [SPARK-32917][SHUFFLE][CORE] Adds support for executors to push shuffle blocks after successful map task completion

2020-12-04 Thread GitBox
otterc commented on a change in pull request #30312: URL: https://github.com/apache/spark/pull/30312#discussion_r536266305 ## File path: core/src/main/scala/org/apache/spark/internal/config/package.scala ## @@ -1992,4 +1992,32 @@ package object config {

[GitHub] [spark] otterc commented on a change in pull request #30312: [SPARK-32917][SHUFFLE][CORE] Adds support for executors to push shuffle blocks after successful map task completion

2020-12-04 Thread GitBox
otterc commented on a change in pull request #30312: URL: https://github.com/apache/spark/pull/30312#discussion_r536266187 ## File path: core/src/test/scala/org/apache/spark/shuffle/ShuffleBlockPusherSuite.scala ## @@ -0,0 +1,353 @@ +/* + * Licensed to the Apache Software

[GitHub] [spark] SparkQA commented on pull request #30312: [SPARK-32917][SHUFFLE][CORE] Adds support for executors to push shuffle blocks after successful map task completion

2020-12-04 Thread GitBox
SparkQA commented on pull request #30312: URL: https://github.com/apache/spark/pull/30312#issuecomment-738917167 **[Test build #132241 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132241/testReport)** for PR 30312 at commit

[GitHub] [spark] SparkQA commented on pull request #30598: [SPARK-33654][SQL] Migrate CACHE TABLE to use UnresolvedRelation to resolve identifier

2020-12-04 Thread GitBox
SparkQA commented on pull request #30598: URL: https://github.com/apache/spark/pull/30598#issuecomment-738917096 **[Test build #132240 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132240/testReport)** for PR 30598 at commit

[GitHub] [spark] SparkQA commented on pull request #30607: [MINOR][INFRA][3.1] Update branch name from master to branch-3.1 GitHub Action

2020-12-04 Thread GitBox
SparkQA commented on pull request #30607: URL: https://github.com/apache/spark/pull/30607#issuecomment-738911867 **[Test build #132239 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132239/testReport)** for PR 30607 at commit

[GitHub] [spark] dongjoon-hyun opened a new pull request #30607: [MINOR][INFRA][3.1] Update branch name from master to branch-3.1 GitHub Action

2020-12-04 Thread GitBox
dongjoon-hyun opened a new pull request #30607: URL: https://github.com/apache/spark/pull/30607 … ### What changes were proposed in this pull request? ### Why are the changes needed? ### Does this PR introduce _any_ user-facing change?

[GitHub] [spark] SparkQA commented on pull request #29247: [SPARK-32446][SHS] Add percentile distribution REST API of peak memory metrics for all executors

2020-12-04 Thread GitBox
SparkQA commented on pull request #29247: URL: https://github.com/apache/spark/pull/29247#issuecomment-738910126 **[Test build #132238 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132238/testReport)** for PR 29247 at commit

[GitHub] [spark] SparkQA commented on pull request #30606: [SPARK-33662][BUILD] Setting version to 3.2.0-SNAPSHOT

2020-12-04 Thread GitBox
SparkQA commented on pull request #30606: URL: https://github.com/apache/spark/pull/30606#issuecomment-738909278 **[Test build #132237 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132237/testReport)** for PR 30606 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #30586: [SPARK-33641][SQL] Invalidate new char/varchar types in public APIs that produce incorrect results

2020-12-04 Thread GitBox
AmplabJenkins commented on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738907319 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132233/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30586: [SPARK-33641][SQL] Invalidate new char/varchar types in public APIs that produce incorrect results

2020-12-04 Thread GitBox
AmplabJenkins removed a comment on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738907319 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132233/

[GitHub] [spark] dongjoon-hyun commented on pull request #30606: [SPARK-33662][BUILD] Setting version to 3.2.0-SNAPSHOT

2020-12-04 Thread GitBox
dongjoon-hyun commented on pull request #30606: URL: https://github.com/apache/spark/pull/30606#issuecomment-738902264 Thank you, @tgravescs ! This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] aokolnychyi commented on pull request #30577: [SPARK-33621][SQL] Add a way to inject data source rewrite rules

2020-12-04 Thread GitBox
aokolnychyi commented on pull request #30577: URL: https://github.com/apache/spark/pull/30577#issuecomment-738901186 Will do today, @dongjoon-hyun! This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] SparkQA commented on pull request #30586: [SPARK-33641][SQL] Invalidate new char/varchar types in public APIs that produce incorrect results

2020-12-04 Thread GitBox
SparkQA commented on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738899280 **[Test build #132233 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132233/testReport)** for PR 30586 at commit

[GitHub] [spark] dongjoon-hyun commented on pull request #30606: [SPARK-33662][BUILD] Setting version to 3.2.0-SNAPSHOT

2020-12-04 Thread GitBox
dongjoon-hyun commented on pull request #30606: URL: https://github.com/apache/spark/pull/30606#issuecomment-738899088 Thank you, @srowen ! This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] rdblue commented on a change in pull request #29066: [SPARK-23889][SQL] DataSourceV2: required sorting and clustering for writes

2020-12-04 Thread GitBox
rdblue commented on a change in pull request #29066: URL: https://github.com/apache/spark/pull/29066#discussion_r536246244 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/V2Writes.scala ## @@ -0,0 +1,187 @@ +/* + * Licensed to the Apache

[GitHub] [spark] SparkQA removed a comment on pull request #30586: [SPARK-33641][SQL] Invalidate new char/varchar types in public APIs that produce incorrect results

2020-12-04 Thread GitBox
SparkQA removed a comment on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738810804 **[Test build #132233 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132233/testReport)** for PR 30586 at commit

[GitHub] [spark] dongjoon-hyun opened a new pull request #30606: [SPARK-33662][BUILD] Setting version to 3.2.0-SNAPSHOT

2020-12-04 Thread GitBox
dongjoon-hyun opened a new pull request #30606: URL: https://github.com/apache/spark/pull/30606 ### What changes were proposed in this pull request? This PR aims to update `master` branch version to 3.2.0-SNAPSHOT. ### Why are the changes needed? Start to prepare Apache

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30586: [SPARK-33641][SQL] Invalidate new char/varchar types in public APIs that produce incorrect results

2020-12-04 Thread GitBox
AmplabJenkins removed a comment on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738875420 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36833/

[GitHub] [spark] AmplabJenkins commented on pull request #30586: [SPARK-33641][SQL] Invalidate new char/varchar types in public APIs that produce incorrect results

2020-12-04 Thread GitBox
AmplabJenkins commented on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738875420 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36833/

[GitHub] [spark] SparkQA commented on pull request #30586: [SPARK-33641][SQL] Invalidate new char/varchar types in public APIs that produce incorrect results

2020-12-04 Thread GitBox
SparkQA commented on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738861449 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36833/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30586: [SPARK-33641][SQL] Invalidate new char/varchar types in public APIs that produce incorrect results

2020-12-04 Thread GitBox
AmplabJenkins removed a comment on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738855172 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36836/

[GitHub] [spark] SparkQA commented on pull request #30586: [SPARK-33641][SQL] Invalidate new char/varchar types in public APIs that produce incorrect results

2020-12-04 Thread GitBox
SparkQA commented on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738855146 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36836/

[GitHub] [spark] AmplabJenkins commented on pull request #30586: [SPARK-33641][SQL] Invalidate new char/varchar types in public APIs that produce incorrect results

2020-12-04 Thread GitBox
AmplabJenkins commented on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738855172 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36836/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30532: [MINOR] Spelling sql not core

2020-12-04 Thread GitBox
AmplabJenkins removed a comment on pull request #30532: URL: https://github.com/apache/spark/pull/30532#issuecomment-738852452 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36834/

[GitHub] [spark] SparkQA commented on pull request #30532: [MINOR] Spelling sql not core

2020-12-04 Thread GitBox
SparkQA commented on pull request #30532: URL: https://github.com/apache/spark/pull/30532#issuecomment-738852430 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36834/

[GitHub] [spark] AmplabJenkins commented on pull request #30532: [MINOR] Spelling sql not core

2020-12-04 Thread GitBox
AmplabJenkins commented on pull request #30532: URL: https://github.com/apache/spark/pull/30532#issuecomment-738852452 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36834/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29642: [SPARK-32792][SQL] Improve InSet filter pushdown

2020-12-04 Thread GitBox
AmplabJenkins removed a comment on pull request #29642: URL: https://github.com/apache/spark/pull/29642#issuecomment-738852315 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36835/

[GitHub] [spark] AmplabJenkins commented on pull request #29642: [SPARK-32792][SQL] Improve InSet filter pushdown

2020-12-04 Thread GitBox
AmplabJenkins commented on pull request #29642: URL: https://github.com/apache/spark/pull/29642#issuecomment-738852315 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36835/

[GitHub] [spark] SparkQA commented on pull request #29642: [SPARK-32792][SQL] Improve InSet filter pushdown

2020-12-04 Thread GitBox
SparkQA commented on pull request #29642: URL: https://github.com/apache/spark/pull/29642#issuecomment-738852288 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36835/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30573: [SPARK-26341][CORE]Expose executor memory metrics at the stage level, in the Stages tab

2020-12-04 Thread GitBox
AmplabJenkins removed a comment on pull request #30573: URL: https://github.com/apache/spark/pull/30573#issuecomment-738849848 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132231/

[GitHub] [spark] AmplabJenkins commented on pull request #30573: [SPARK-26341][CORE]Expose executor memory metrics at the stage level, in the Stages tab

2020-12-04 Thread GitBox
AmplabJenkins commented on pull request #30573: URL: https://github.com/apache/spark/pull/30573#issuecomment-738849848 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132231/

[GitHub] [spark] SparkQA removed a comment on pull request #30573: [SPARK-26341][CORE]Expose executor memory metrics at the stage level, in the Stages tab

2020-12-04 Thread GitBox
SparkQA removed a comment on pull request #30573: URL: https://github.com/apache/spark/pull/30573#issuecomment-738790016 **[Test build #132231 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132231/testReport)** for PR 30573 at commit

[GitHub] [spark] SparkQA commented on pull request #30573: [SPARK-26341][CORE]Expose executor memory metrics at the stage level, in the Stages tab

2020-12-04 Thread GitBox
SparkQA commented on pull request #30573: URL: https://github.com/apache/spark/pull/30573#issuecomment-738848987 **[Test build #132231 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132231/testReport)** for PR 30573 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30604: [SPARK-33571][SQL][DOCS][3.0] Add a ref to INT96 config from the doc for `spark.sql.legacy.parquet.datetimeRebaseModeInWrite/Re

2020-12-04 Thread GitBox
AmplabJenkins removed a comment on pull request #30604: URL: https://github.com/apache/spark/pull/30604#issuecomment-738848186 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36832/

[GitHub] [spark] AmplabJenkins commented on pull request #30604: [SPARK-33571][SQL][DOCS][3.0] Add a ref to INT96 config from the doc for `spark.sql.legacy.parquet.datetimeRebaseModeInWrite/Read`

2020-12-04 Thread GitBox
AmplabJenkins commented on pull request #30604: URL: https://github.com/apache/spark/pull/30604#issuecomment-738848186 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36832/

[GitHub] [spark] AmplabJenkins commented on pull request #30605: [SPARK-33660][DOCS][SS] Fix Kafka Headers Documentation

2020-12-04 Thread GitBox
AmplabJenkins commented on pull request #30605: URL: https://github.com/apache/spark/pull/30605#issuecomment-738843494 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30573: [SPARK-26341][CORE]Expose executor memory metrics at the stage level, in the Stages tab

2020-12-04 Thread GitBox
AmplabJenkins removed a comment on pull request #30573: URL: https://github.com/apache/spark/pull/30573#issuecomment-738842630 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36831/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30586: [SPARK-33641][SQL] Invalidate new char/varchar types in public APIs that produce incorrect results

2020-12-04 Thread GitBox
AmplabJenkins removed a comment on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738842627 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132223/

[GitHub] [spark] SparkQA commented on pull request #30586: [SPARK-33641][SQL] Invalidate new char/varchar types in public APIs that produce incorrect results

2020-12-04 Thread GitBox
SparkQA commented on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738843021 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36833/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30595: [SPARK-33651][SQL] Allow CREATE EXTERNAL TABLE with LOCATION for data source tables

2020-12-04 Thread GitBox
AmplabJenkins removed a comment on pull request #30595: URL: https://github.com/apache/spark/pull/30595#issuecomment-738842629 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132229/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30532: [MINOR] Spelling sql not core

2020-12-04 Thread GitBox
AmplabJenkins removed a comment on pull request #30532: URL: https://github.com/apache/spark/pull/30532#issuecomment-738842628 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132234/

[GitHub] [spark] AmplabJenkins commented on pull request #30595: [SPARK-33651][SQL] Allow CREATE EXTERNAL TABLE with LOCATION for data source tables

2020-12-04 Thread GitBox
AmplabJenkins commented on pull request #30595: URL: https://github.com/apache/spark/pull/30595#issuecomment-738842629 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132229/

[GitHub] [spark] AmplabJenkins commented on pull request #30573: [SPARK-26341][CORE]Expose executor memory metrics at the stage level, in the Stages tab

2020-12-04 Thread GitBox
AmplabJenkins commented on pull request #30573: URL: https://github.com/apache/spark/pull/30573#issuecomment-738842630 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36831/

[GitHub] [spark] AmplabJenkins commented on pull request #30532: [MINOR] Spelling sql not core

2020-12-04 Thread GitBox
AmplabJenkins commented on pull request #30532: URL: https://github.com/apache/spark/pull/30532#issuecomment-738842628 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132234/

[GitHub] [spark] AmplabJenkins commented on pull request #30586: [SPARK-33641][SQL] Invalidate new char/varchar types in public APIs that produce incorrect results

2020-12-04 Thread GitBox
AmplabJenkins commented on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738842627 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132223/

[GitHub] [spark] SparkQA commented on pull request #30586: [SPARK-33641][SQL] Invalidate new char/varchar types in public APIs that produce incorrect results

2020-12-04 Thread GitBox
SparkQA commented on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738840567 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36836/

[GitHub] [spark] SparkQA removed a comment on pull request #30595: [SPARK-33651][SQL] Allow CREATE EXTERNAL TABLE with LOCATION for data source tables

2020-12-04 Thread GitBox
SparkQA removed a comment on pull request #30595: URL: https://github.com/apache/spark/pull/30595#issuecomment-738763117 **[Test build #132229 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132229/testReport)** for PR 30595 at commit

[GitHub] [spark] SparkQA commented on pull request #30595: [SPARK-33651][SQL] Allow CREATE EXTERNAL TABLE with LOCATION for data source tables

2020-12-04 Thread GitBox
SparkQA commented on pull request #30595: URL: https://github.com/apache/spark/pull/30595#issuecomment-738839321 **[Test build #132229 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132229/testReport)** for PR 30595 at commit

[GitHub] [spark] SparkQA commented on pull request #29642: [SPARK-32792][SQL] Improve InSet filter pushdown

2020-12-04 Thread GitBox
SparkQA commented on pull request #29642: URL: https://github.com/apache/spark/pull/29642#issuecomment-738835079 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36835/

[GitHub] [spark] SparkQA commented on pull request #30532: [MINOR] Spelling sql not core

2020-12-04 Thread GitBox
SparkQA commented on pull request #30532: URL: https://github.com/apache/spark/pull/30532#issuecomment-738834470 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36834/

[GitHub] [spark] Gschiavon commented on pull request #30605: [SPARK-33660][DOCS][SS] Fix Kafka Headers Documentation

2020-12-04 Thread GitBox
Gschiavon commented on pull request #30605: URL: https://github.com/apache/spark/pull/30605#issuecomment-738831816 @HeartSaVioR This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [spark] Gschiavon opened a new pull request #30605: [SPARK-33660][DOCS][SS] Fix Kafka Headers Documentation

2020-12-04 Thread GitBox
Gschiavon opened a new pull request #30605: URL: https://github.com/apache/spark/pull/30605 ### What changes were proposed in this pull request? Update kafka headers documentation, type is not longer a map but an array

[GitHub] [spark] SparkQA removed a comment on pull request #30532: [MINOR] Spelling sql not core

2020-12-04 Thread GitBox
SparkQA removed a comment on pull request #30532: URL: https://github.com/apache/spark/pull/30532#issuecomment-738811025 **[Test build #132234 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132234/testReport)** for PR 30532 at commit

[GitHub] [spark] SparkQA commented on pull request #30532: [MINOR] Spelling sql not core

2020-12-04 Thread GitBox
SparkQA commented on pull request #30532: URL: https://github.com/apache/spark/pull/30532#issuecomment-738828479 **[Test build #132234 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132234/testReport)** for PR 30532 at commit

[GitHub] [spark] SparkQA commented on pull request #30573: [SPARK-26341][CORE]Expose executor memory metrics at the stage level, in the Stages tab

2020-12-04 Thread GitBox
SparkQA commented on pull request #30573: URL: https://github.com/apache/spark/pull/30573#issuecomment-738826684 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36831/

[GitHub] [spark] SparkQA removed a comment on pull request #30586: [SPARK-33641][SQL] Invalidate new char/varchar types in public APIs that produce incorrect results

2020-12-04 Thread GitBox
SparkQA removed a comment on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738702158 **[Test build #132223 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132223/testReport)** for PR 30586 at commit

[GitHub] [spark] SparkQA commented on pull request #30586: [SPARK-33641][SQL] Invalidate new char/varchar types in public APIs that produce incorrect results

2020-12-04 Thread GitBox
SparkQA commented on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738823418 **[Test build #132223 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132223/testReport)** for PR 30586 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30573: [SPARK-26341][CORE]Expose executor memory metrics at the stage level, in the Stages tab

2020-12-04 Thread GitBox
AmplabJenkins removed a comment on pull request #30573: URL: https://github.com/apache/spark/pull/30573#issuecomment-738819598 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132230/

[GitHub] [spark] AmplabJenkins commented on pull request #30573: [SPARK-26341][CORE]Expose executor memory metrics at the stage level, in the Stages tab

2020-12-04 Thread GitBox
AmplabJenkins commented on pull request #30573: URL: https://github.com/apache/spark/pull/30573#issuecomment-738819598 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132230/

[GitHub] [spark] SparkQA removed a comment on pull request #30573: [SPARK-26341][CORE]Expose executor memory metrics at the stage level, in the Stages tab

2020-12-04 Thread GitBox
SparkQA removed a comment on pull request #30573: URL: https://github.com/apache/spark/pull/30573#issuecomment-738763184 **[Test build #132230 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132230/testReport)** for PR 30573 at commit

[GitHub] [spark] SparkQA commented on pull request #30573: [SPARK-26341][CORE]Expose executor memory metrics at the stage level, in the Stages tab

2020-12-04 Thread GitBox
SparkQA commented on pull request #30573: URL: https://github.com/apache/spark/pull/30573#issuecomment-738818930 **[Test build #132230 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132230/testReport)** for PR 30573 at commit

[GitHub] [spark] SparkQA commented on pull request #30586: [SPARK-33641][SQL] Invalidate new char/varchar types in public APIs that produce incorrect results

2020-12-04 Thread GitBox
SparkQA commented on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738817589 **[Test build #132236 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132236/testReport)** for PR 30586 at commit

[GitHub] [spark] SparkQA commented on pull request #29642: [SPARK-32792][SQL] Improve InSet filter pushdown

2020-12-04 Thread GitBox
SparkQA commented on pull request #29642: URL: https://github.com/apache/spark/pull/29642#issuecomment-738811606 **[Test build #132235 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132235/testReport)** for PR 29642 at commit

[GitHub] [spark] SparkQA commented on pull request #30532: [MINOR] Spelling sql not core

2020-12-04 Thread GitBox
SparkQA commented on pull request #30532: URL: https://github.com/apache/spark/pull/30532#issuecomment-738811025 **[Test build #132234 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132234/testReport)** for PR 30532 at commit

[GitHub] [spark] SparkQA commented on pull request #30586: [SPARK-33641][SQL] Invalidate new char/varchar types in public APIs that produce incorrect results

2020-12-04 Thread GitBox
SparkQA commented on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738810804 **[Test build #132233 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132233/testReport)** for PR 30586 at commit

[GitHub] [spark] SparkQA commented on pull request #30604: [SPARK-33571][SQL][DOCS][3.0] Add a ref to INT96 config from the doc for `spark.sql.legacy.parquet.datetimeRebaseModeInWrite/Read`

2020-12-04 Thread GitBox
SparkQA commented on pull request #30604: URL: https://github.com/apache/spark/pull/30604#issuecomment-738810829 **[Test build #132232 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132232/testReport)** for PR 30604 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30387: [SPARK-33443][SQL] LEAD/LAG should support [ IGNORE NULLS | RESPECT NULLS ]

2020-12-04 Thread GitBox
AmplabJenkins removed a comment on pull request #30387: URL: https://github.com/apache/spark/pull/30387#issuecomment-738809907 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132220/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30595: [SPARK-33651][SQL] Allow CREATE EXTERNAL TABLE with LOCATION for data source tables

2020-12-04 Thread GitBox
AmplabJenkins removed a comment on pull request #30595: URL: https://github.com/apache/spark/pull/30595#issuecomment-738809906 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36830/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30559: [SPARK-33617][SQL] Add default parallelism configuration for Spark SQL queries

2020-12-04 Thread GitBox
AmplabJenkins removed a comment on pull request #30559: URL: https://github.com/apache/spark/pull/30559#issuecomment-738809905 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132219/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30575: [SPARK-33141][SQL][FOLLOW-UP] Store the max nested view depth in AnalysisContext

2020-12-04 Thread GitBox
AmplabJenkins removed a comment on pull request #30575: URL: https://github.com/apache/spark/pull/30575#issuecomment-738809903 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132217/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30600: [SPARK-33655][SQL] Improve performance of processing FETCH_PRIOR

2020-12-04 Thread GitBox
AmplabJenkins removed a comment on pull request #30600: URL: https://github.com/apache/spark/pull/30600#issuecomment-738809909 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36828/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30573: [SPARK-26341][CORE]Expose executor memory metrics at the stage level, in the Stages tab

2020-12-04 Thread GitBox
AmplabJenkins removed a comment on pull request #30573: URL: https://github.com/apache/spark/pull/30573#issuecomment-738809908 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36829/

[GitHub] [spark] AmplabJenkins commented on pull request #30387: [SPARK-33443][SQL] LEAD/LAG should support [ IGNORE NULLS | RESPECT NULLS ]

2020-12-04 Thread GitBox
AmplabJenkins commented on pull request #30387: URL: https://github.com/apache/spark/pull/30387#issuecomment-738809907 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132220/

[GitHub] [spark] AmplabJenkins commented on pull request #30575: [SPARK-33141][SQL][FOLLOW-UP] Store the max nested view depth in AnalysisContext

2020-12-04 Thread GitBox
AmplabJenkins commented on pull request #30575: URL: https://github.com/apache/spark/pull/30575#issuecomment-738809903 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132217/

[GitHub] [spark] AmplabJenkins commented on pull request #30600: [SPARK-33655][SQL] Improve performance of processing FETCH_PRIOR

2020-12-04 Thread GitBox
AmplabJenkins commented on pull request #30600: URL: https://github.com/apache/spark/pull/30600#issuecomment-738809909 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36828/

[GitHub] [spark] AmplabJenkins commented on pull request #30573: [SPARK-26341][CORE]Expose executor memory metrics at the stage level, in the Stages tab

2020-12-04 Thread GitBox
AmplabJenkins commented on pull request #30573: URL: https://github.com/apache/spark/pull/30573#issuecomment-738809908 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36829/

[GitHub] [spark] AmplabJenkins commented on pull request #30595: [SPARK-33651][SQL] Allow CREATE EXTERNAL TABLE with LOCATION for data source tables

2020-12-04 Thread GitBox
AmplabJenkins commented on pull request #30595: URL: https://github.com/apache/spark/pull/30595#issuecomment-738809906 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36830/

[GitHub] [spark] AmplabJenkins commented on pull request #30559: [SPARK-33617][SQL] Add default parallelism configuration for Spark SQL queries

2020-12-04 Thread GitBox
AmplabJenkins commented on pull request #30559: URL: https://github.com/apache/spark/pull/30559#issuecomment-738809905 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132219/

[GitHub] [spark] SparkQA commented on pull request #30573: [SPARK-26341][CORE]Expose executor memory metrics at the stage level, in the Stages tab

2020-12-04 Thread GitBox
SparkQA commented on pull request #30573: URL: https://github.com/apache/spark/pull/30573#issuecomment-738809790 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36831/

[GitHub] [spark] SparkQA removed a comment on pull request #30559: [SPARK-33617][SQL] Add default parallelism configuration for Spark SQL queries

2020-12-04 Thread GitBox
SparkQA removed a comment on pull request #30559: URL: https://github.com/apache/spark/pull/30559#issuecomment-738671891 **[Test build #132219 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132219/testReport)** for PR 30559 at commit

[GitHub] [spark] SparkQA commented on pull request #30559: [SPARK-33617][SQL] Add default parallelism configuration for Spark SQL queries

2020-12-04 Thread GitBox
SparkQA commented on pull request #30559: URL: https://github.com/apache/spark/pull/30559#issuecomment-738806500 **[Test build #132219 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132219/testReport)** for PR 30559 at commit

[GitHub] [spark] yaooqinn commented on pull request #30586: [SPARK-33641][SQL] Invalidate new char/varchar types in public APIs that produce incorrect results

2020-12-04 Thread GitBox
yaooqinn commented on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738805019 > @yaooqinn maybe we should use `char/varchar` instead of `char-like` to be clear. updated, pr title/description and the code

[GitHub] [spark] wangyum commented on pull request #29642: [SPARK-32792][SQL] Improve InSet filter pushdown

2020-12-04 Thread GitBox
wangyum commented on pull request #29642: URL: https://github.com/apache/spark/pull/29642#issuecomment-738804876 retest this please. This is an automated message from the Apache Git Service. To respond to the message, please

<    1   2   3   4   5   6   7   8   >