[GitHub] [spark] dongjoon-hyun commented on pull request #30606: [SPARK-33662][BUILD] Setting version to 3.2.0-SNAPSHOT

2020-12-04 Thread GitBox
dongjoon-hyun commented on pull request #30606: URL: https://github.com/apache/spark/pull/30606#issuecomment-738899088 Thank you, @srowen ! This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] rdblue commented on a change in pull request #29066: [SPARK-23889][SQL] DataSourceV2: required sorting and clustering for writes

2020-12-04 Thread GitBox
rdblue commented on a change in pull request #29066: URL: https://github.com/apache/spark/pull/29066#discussion_r536246244 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/V2Writes.scala ## @@ -0,0 +1,187 @@ +/* + * Licensed to the Apache

[GitHub] [spark] AmplabJenkins commented on pull request #30586: [SPARK-33641][SQL] Invalidate new char/varchar types in public APIs that produce incorrect results

2020-12-04 Thread GitBox
AmplabJenkins commented on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738907319 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132233/

[GitHub] [spark] SparkQA commented on pull request #30312: [SPARK-32917][SHUFFLE][CORE] Adds support for executors to push shuffle blocks after successful map task completion

2020-12-04 Thread GitBox
SparkQA commented on pull request #30312: URL: https://github.com/apache/spark/pull/30312#issuecomment-738917167 **[Test build #132241 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132241/testReport)** for PR 30312 at commit

[GitHub] [spark] imback82 opened a new pull request #30608: [SPARK-33663][SQL] Uncaching should not be called on non-existing temp views.

2020-12-04 Thread GitBox
imback82 opened a new pull request #30608: URL: https://github.com/apache/spark/pull/30608 ### What changes were proposed in this pull request? This PR proposes to fix a misleading logs in the following scenario when uncaching is called on non-existing views: ```

[GitHub] [spark] SparkQA removed a comment on pull request #30604: [SPARK-33571][SQL][DOCS][3.0] Add a ref to INT96 config from the doc for `spark.sql.legacy.parquet.datetimeRebaseModeInWrite/Read`

2020-12-04 Thread GitBox
SparkQA removed a comment on pull request #30604: URL: https://github.com/apache/spark/pull/30604#issuecomment-738810829 **[Test build #132232 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132232/testReport)** for PR 30604 at commit

[GitHub] [spark] SparkQA commented on pull request #29247: [SPARK-32446][SHS] Add percentile distribution REST API of peak memory metrics for all executors

2020-12-04 Thread GitBox
SparkQA commented on pull request #29247: URL: https://github.com/apache/spark/pull/29247#issuecomment-738968447 **[Test build #132238 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132238/testReport)** for PR 29247 at commit

[GitHub] [spark] SparkQA commented on pull request #30606: [SPARK-33662][BUILD] Setting version to 3.2.0-SNAPSHOT

2020-12-04 Thread GitBox
SparkQA commented on pull request #30606: URL: https://github.com/apache/spark/pull/30606#issuecomment-738974465 **[Test build #132244 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132244/testReport)** for PR 30606 at commit

[GitHub] [spark] dongjoon-hyun commented on pull request #30606: [SPARK-33662][BUILD] Setting version to 3.2.0-SNAPSHOT

2020-12-04 Thread GitBox
dongjoon-hyun commented on pull request #30606: URL: https://github.com/apache/spark/pull/30606#issuecomment-738902264 Thank you, @tgravescs ! This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] otterc commented on a change in pull request #30312: [SPARK-32917][SHUFFLE][CORE] Adds support for executors to push shuffle blocks after successful map task completion

2020-12-04 Thread GitBox
otterc commented on a change in pull request #30312: URL: https://github.com/apache/spark/pull/30312#discussion_r536266187 ## File path: core/src/test/scala/org/apache/spark/shuffle/ShuffleBlockPusherSuite.scala ## @@ -0,0 +1,353 @@ +/* + * Licensed to the Apache Software

[GitHub] [spark] otterc commented on a change in pull request #30312: [SPARK-32917][SHUFFLE][CORE] Adds support for executors to push shuffle blocks after successful map task completion

2020-12-04 Thread GitBox
otterc commented on a change in pull request #30312: URL: https://github.com/apache/spark/pull/30312#discussion_r536266305 ## File path: core/src/main/scala/org/apache/spark/internal/config/package.scala ## @@ -1992,4 +1992,32 @@ package object config {

[GitHub] [spark] SparkQA commented on pull request #30607: [MINOR][INFRA][3.1] Update branch name from master to branch-3.1 GitHub Action

2020-12-04 Thread GitBox
SparkQA commented on pull request #30607: URL: https://github.com/apache/spark/pull/30607#issuecomment-738936445 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36839/

[GitHub] [spark] SparkQA commented on pull request #30598: [SPARK-33654][SQL] Migrate CACHE TABLE to use UnresolvedRelation to resolve identifier

2020-12-04 Thread GitBox
SparkQA commented on pull request #30598: URL: https://github.com/apache/spark/pull/30598#issuecomment-738943896 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36841/

[GitHub] [spark] SparkQA commented on pull request #30608: [SPARK-33663][SQL] Uncaching should not be called on non-existing temp views.

2020-12-04 Thread GitBox
SparkQA commented on pull request #30608: URL: https://github.com/apache/spark/pull/30608#issuecomment-738970418 **[Test build #132243 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132243/testReport)** for PR 30608 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29247: [SPARK-32446][SHS] Add percentile distribution REST API of peak memory metrics for all executors

2020-12-04 Thread GitBox
AmplabJenkins removed a comment on pull request #29247: URL: https://github.com/apache/spark/pull/29247#issuecomment-738970185 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132238/

[GitHub] [spark] AmplabJenkins commented on pull request #30598: [SPARK-33654][SQL] Migrate CACHE TABLE to use UnresolvedRelation to resolve identifier

2020-12-04 Thread GitBox
AmplabJenkins commented on pull request #30598: URL: https://github.com/apache/spark/pull/30598#issuecomment-738970180 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30604: [SPARK-33571][SQL][DOCS][3.0] Add a ref to INT96 config from the doc for `spark.sql.legacy.parquet.datetimeRebaseModeInWrite/Read`

2020-12-04 Thread GitBox
AmplabJenkins commented on pull request #30604: URL: https://github.com/apache/spark/pull/30604#issuecomment-738970186 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132232/

[GitHub] [spark] AmplabJenkins commented on pull request #30312: [SPARK-32917][SHUFFLE][CORE] Adds support for executors to push shuffle blocks after successful map task completion

2020-12-04 Thread GitBox
AmplabJenkins commented on pull request #30312: URL: https://github.com/apache/spark/pull/30312#issuecomment-738970184 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36842/

[GitHub] [spark] AmplabJenkins commented on pull request #29247: [SPARK-32446][SHS] Add percentile distribution REST API of peak memory metrics for all executors

2020-12-04 Thread GitBox
AmplabJenkins commented on pull request #29247: URL: https://github.com/apache/spark/pull/29247#issuecomment-738970185 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132238/

[GitHub] [spark] AmplabJenkins commented on pull request #30586: [SPARK-33641][SQL] Invalidate new char/varchar types in public APIs that produce incorrect results

2020-12-04 Thread GitBox
AmplabJenkins commented on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738875420 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36833/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30586: [SPARK-33641][SQL] Invalidate new char/varchar types in public APIs that produce incorrect results

2020-12-04 Thread GitBox
AmplabJenkins removed a comment on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738875420 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36833/

[GitHub] [spark] SparkQA commented on pull request #30586: [SPARK-33641][SQL] Invalidate new char/varchar types in public APIs that produce incorrect results

2020-12-04 Thread GitBox
SparkQA commented on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738899280 **[Test build #132233 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132233/testReport)** for PR 30586 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30586: [SPARK-33641][SQL] Invalidate new char/varchar types in public APIs that produce incorrect results

2020-12-04 Thread GitBox
AmplabJenkins removed a comment on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738921094 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132236/

[GitHub] [spark] AmplabJenkins commented on pull request #30586: [SPARK-33641][SQL] Invalidate new char/varchar types in public APIs that produce incorrect results

2020-12-04 Thread GitBox
AmplabJenkins commented on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738921094 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132236/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30606: [SPARK-33662][BUILD] Setting version to 3.2.0-SNAPSHOT

2020-12-04 Thread GitBox
AmplabJenkins removed a comment on pull request #30606: URL: https://github.com/apache/spark/pull/30606#issuecomment-738947653 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36837/

[GitHub] [spark] SparkQA commented on pull request #30606: [SPARK-33662][BUILD] Setting version to 3.2.0-SNAPSHOT

2020-12-04 Thread GitBox
SparkQA commented on pull request #30606: URL: https://github.com/apache/spark/pull/30606#issuecomment-738947633 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36837/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30312: [SPARK-32917][SHUFFLE][CORE] Adds support for executors to push shuffle blocks after successful map task completion

2020-12-04 Thread GitBox
AmplabJenkins removed a comment on pull request #30312: URL: https://github.com/apache/spark/pull/30312#issuecomment-738951794 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36840/

[GitHub] [spark] sunchao commented on a change in pull request #29066: [SPARK-23889][SQL] DataSourceV2: required sorting and clustering for writes

2020-12-04 Thread GitBox
sunchao commented on a change in pull request #29066: URL: https://github.com/apache/spark/pull/29066#discussion_r535526809 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/V2Writes.scala ## @@ -0,0 +1,102 @@ +/* + * Licensed to the Apache

[GitHub] [spark] SparkQA commented on pull request #30598: [SPARK-33654][SQL] Migrate CACHE TABLE to use UnresolvedRelation to resolve identifier

2020-12-04 Thread GitBox
SparkQA commented on pull request #30598: URL: https://github.com/apache/spark/pull/30598#issuecomment-738958768 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36841/

[GitHub] [spark] SparkQA removed a comment on pull request #29247: [SPARK-32446][SHS] Add percentile distribution REST API of peak memory metrics for all executors

2020-12-04 Thread GitBox
SparkQA removed a comment on pull request #29247: URL: https://github.com/apache/spark/pull/29247#issuecomment-738910126 **[Test build #132238 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132238/testReport)** for PR 29247 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30606: [SPARK-33662][BUILD] Setting version to 3.2.0-SNAPSHOT

2020-12-04 Thread GitBox
AmplabJenkins removed a comment on pull request #30606: URL: https://github.com/apache/spark/pull/30606#issuecomment-738972273 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132237/

[GitHub] [spark] AmplabJenkins commented on pull request #30606: [SPARK-33662][BUILD] Setting version to 3.2.0-SNAPSHOT

2020-12-04 Thread GitBox
AmplabJenkins commented on pull request #30606: URL: https://github.com/apache/spark/pull/30606#issuecomment-738972273 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132237/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30312: [SPARK-32917][SHUFFLE][CORE] Adds support for executors to push shuffle blocks after successful map task completion

2020-12-04 Thread GitBox
AmplabJenkins removed a comment on pull request #30312: URL: https://github.com/apache/spark/pull/30312#issuecomment-738975896 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132241/

[GitHub] [spark] SparkQA removed a comment on pull request #30609: [MINOR][SQL] Fix string interpolation in CommandUtils.scala

2020-12-04 Thread GitBox
SparkQA removed a comment on pull request #30609: URL: https://github.com/apache/spark/pull/30609#issuecomment-738970554 **[Test build #132242 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132242/testReport)** for PR 30609 at commit

[GitHub] [spark] dongjoon-hyun opened a new pull request #30606: [SPARK-33662][BUILD] Setting version to 3.2.0-SNAPSHOT

2020-12-04 Thread GitBox
dongjoon-hyun opened a new pull request #30606: URL: https://github.com/apache/spark/pull/30606 ### What changes were proposed in this pull request? This PR aims to update `master` branch version to 3.2.0-SNAPSHOT. ### Why are the changes needed? Start to prepare Apache

[GitHub] [spark] imback82 commented on a change in pull request #30598: [SPARK-33654][SQL] Migrate CACHE TABLE to use UnresolvedRelation to resolve identifier

2020-12-04 Thread GitBox
imback82 commented on a change in pull request #30598: URL: https://github.com/apache/spark/pull/30598#discussion_r536275320 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/v2Commands.scala ## @@ -706,3 +705,13 @@ case class

[GitHub] [spark] SparkQA commented on pull request #29247: [SPARK-32446][SHS] Add percentile distribution REST API of peak memory metrics for all executors

2020-12-04 Thread GitBox
SparkQA commented on pull request #29247: URL: https://github.com/apache/spark/pull/29247#issuecomment-738949338 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36838/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29247: [SPARK-32446][SHS] Add percentile distribution REST API of peak memory metrics for all executors

2020-12-04 Thread GitBox
AmplabJenkins removed a comment on pull request #29247: URL: https://github.com/apache/spark/pull/29247#issuecomment-738949370 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36838/

[GitHub] [spark] SparkQA commented on pull request #30598: [SPARK-33654][SQL] Migrate CACHE TABLE to use UnresolvedRelation to resolve identifier

2020-12-04 Thread GitBox
SparkQA commented on pull request #30598: URL: https://github.com/apache/spark/pull/30598#issuecomment-738955158 **[Test build #132240 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132240/testReport)** for PR 30598 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #30598: [SPARK-33654][SQL] Migrate CACHE TABLE to use UnresolvedRelation to resolve identifier

2020-12-04 Thread GitBox
SparkQA removed a comment on pull request #30598: URL: https://github.com/apache/spark/pull/30598#issuecomment-738917096 **[Test build #132240 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132240/testReport)** for PR 30598 at commit

[GitHub] [spark] imback82 opened a new pull request #30609: [MINOR][SQL] Fix string interpolation in CommandUtils.scala

2020-12-04 Thread GitBox
imback82 opened a new pull request #30609: URL: https://github.com/apache/spark/pull/30609 ### What changes were proposed in this pull request? This PR proposes to fix a string interpolation in `CommandUtils.scala`. Currently, the message looks like the following: ```

[GitHub] [spark] dongjoon-hyun commented on pull request #30607: [MINOR][INFRA][3.1] Update branch name from master to branch-3.1 GitHub Action

2020-12-04 Thread GitBox
dongjoon-hyun commented on pull request #30607: URL: https://github.com/apache/spark/pull/30607#issuecomment-738957030 Thank you, @srowen . Since GitHub Action is working on this PR, I'll merge this. Merged to branch-3.1.

[GitHub] [spark] AmplabJenkins commented on pull request #29642: [SPARK-32792][SQL] Improve InSet filter pushdown

2020-12-04 Thread GitBox
AmplabJenkins commented on pull request #29642: URL: https://github.com/apache/spark/pull/29642#issuecomment-738973065 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132235/

[GitHub] [spark] SparkQA removed a comment on pull request #30312: [SPARK-32917][SHUFFLE][CORE] Adds support for executors to push shuffle blocks after successful map task completion

2020-12-04 Thread GitBox
SparkQA removed a comment on pull request #30312: URL: https://github.com/apache/spark/pull/30312#issuecomment-738917167 **[Test build #132241 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132241/testReport)** for PR 30312 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #30312: [SPARK-32917][SHUFFLE][CORE] Adds support for executors to push shuffle blocks after successful map task completion

2020-12-04 Thread GitBox
AmplabJenkins commented on pull request #30312: URL: https://github.com/apache/spark/pull/30312#issuecomment-738975896 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132241/

[GitHub] [spark] SparkQA commented on pull request #30312: [SPARK-32917][SHUFFLE][CORE] Adds support for executors to push shuffle blocks after successful map task completion

2020-12-04 Thread GitBox
SparkQA commented on pull request #30312: URL: https://github.com/apache/spark/pull/30312#issuecomment-738975399 **[Test build #132241 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132241/testReport)** for PR 30312 at commit

[GitHub] [spark] imback82 opened a new pull request #30610: [SPARK-33664][SQL] Migrate ALTER TABLE ... RENAME TO to use UnresolvedTableOrView to resolve identifier

2020-12-04 Thread GitBox
imback82 opened a new pull request #30610: URL: https://github.com/apache/spark/pull/30610 ### What changes were proposed in this pull request? This PR proposes to migrate `ALTER [TABLE|ViEW] ... RENAME TO` to use `UnresolvedTableOrView` to resolve the table/view identifier.

[GitHub] [spark] aokolnychyi commented on pull request #30577: [SPARK-33621][SQL] Add a way to inject data source rewrite rules

2020-12-04 Thread GitBox
aokolnychyi commented on pull request #30577: URL: https://github.com/apache/spark/pull/30577#issuecomment-738901186 Will do today, @dongjoon-hyun! This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30586: [SPARK-33641][SQL] Invalidate new char/varchar types in public APIs that produce incorrect results

2020-12-04 Thread GitBox
AmplabJenkins removed a comment on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738907319 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132233/

[GitHub] [spark] SparkQA commented on pull request #30607: [MINOR][INFRA][3.1] Update branch name from master to branch-3.1 GitHub Action

2020-12-04 Thread GitBox
SparkQA commented on pull request #30607: URL: https://github.com/apache/spark/pull/30607#issuecomment-738911867 **[Test build #132239 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132239/testReport)** for PR 30607 at commit

[GitHub] [spark] otterc commented on pull request #30312: [SPARK-32917][SHUFFLE][CORE] Adds support for executors to push shuffle blocks after successful map task completion

2020-12-04 Thread GitBox
otterc commented on pull request #30312: URL: https://github.com/apache/spark/pull/30312#issuecomment-738918713 I have addressed all the review comments so far. cc @Ngone51 @Victsm @mridulm @dongjoon-hyun This is an

[GitHub] [spark] SparkQA commented on pull request #30607: [MINOR][INFRA][3.1] Update branch name from master to branch-3.1 GitHub Action

2020-12-04 Thread GitBox
SparkQA commented on pull request #30607: URL: https://github.com/apache/spark/pull/30607#issuecomment-738951911 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36839/

[GitHub] [spark] AmplabJenkins commented on pull request #30607: [MINOR][INFRA][3.1] Update branch name from master to branch-3.1 GitHub Action

2020-12-04 Thread GitBox
AmplabJenkins commented on pull request #30607: URL: https://github.com/apache/spark/pull/30607#issuecomment-738951938 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36839/

[GitHub] [spark] AmplabJenkins commented on pull request #30312: [SPARK-32917][SHUFFLE][CORE] Adds support for executors to push shuffle blocks after successful map task completion

2020-12-04 Thread GitBox
AmplabJenkins commented on pull request #30312: URL: https://github.com/apache/spark/pull/30312#issuecomment-738951794 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36840/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30607: [MINOR][INFRA][3.1] Update branch name from master to branch-3.1 GitHub Action

2020-12-04 Thread GitBox
AmplabJenkins removed a comment on pull request #30607: URL: https://github.com/apache/spark/pull/30607#issuecomment-738951938 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36839/

[GitHub] [spark] SparkQA commented on pull request #30604: [SPARK-33571][SQL][DOCS][3.0] Add a ref to INT96 config from the doc for `spark.sql.legacy.parquet.datetimeRebaseModeInWrite/Read`

2020-12-04 Thread GitBox
SparkQA commented on pull request #30604: URL: https://github.com/apache/spark/pull/30604#issuecomment-738960440 **[Test build #132232 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132232/testReport)** for PR 30604 at commit

[GitHub] [spark] dongjoon-hyun commented on pull request #30606: [SPARK-33662][BUILD] Setting version to 3.2.0-SNAPSHOT

2020-12-04 Thread GitBox
dongjoon-hyun commented on pull request #30606: URL: https://github.com/apache/spark/pull/30606#issuecomment-738972145 Retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] SparkQA commented on pull request #29642: [SPARK-32792][SQL] Improve InSet filter pushdown

2020-12-04 Thread GitBox
SparkQA commented on pull request #29642: URL: https://github.com/apache/spark/pull/29642#issuecomment-738971991 **[Test build #132235 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132235/testReport)** for PR 29642 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29642: [SPARK-32792][SQL] Improve InSet filter pushdown

2020-12-04 Thread GitBox
SparkQA removed a comment on pull request #29642: URL: https://github.com/apache/spark/pull/29642#issuecomment-738811606 **[Test build #132235 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132235/testReport)** for PR 29642 at commit

[GitHub] [spark] SparkQA commented on pull request #30586: [SPARK-33641][SQL] Invalidate new char/varchar types in public APIs that produce incorrect results

2020-12-04 Thread GitBox
SparkQA commented on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738920354 **[Test build #132236 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132236/testReport)** for PR 30586 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #30586: [SPARK-33641][SQL] Invalidate new char/varchar types in public APIs that produce incorrect results

2020-12-04 Thread GitBox
SparkQA removed a comment on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738817589 **[Test build #132236 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132236/testReport)** for PR 30586 at commit

[GitHub] [spark] dongjoon-hyun commented on pull request #30607: [MINOR][INFRA][3.1] Update branch name from master to branch-3.1 GitHub Action

2020-12-04 Thread GitBox
dongjoon-hyun commented on pull request #30607: URL: https://github.com/apache/spark/pull/30607#issuecomment-738929633 cc @srowen and @tgravescs , too This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] AmplabJenkins commented on pull request #29247: [SPARK-32446][SHS] Add percentile distribution REST API of peak memory metrics for all executors

2020-12-04 Thread GitBox
AmplabJenkins commented on pull request #29247: URL: https://github.com/apache/spark/pull/29247#issuecomment-738949370 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36838/

[GitHub] [spark] SparkQA commented on pull request #30609: [MINOR][SQL] Fix string interpolation in CommandUtils.scala

2020-12-04 Thread GitBox
SparkQA commented on pull request #30609: URL: https://github.com/apache/spark/pull/30609#issuecomment-738970554 **[Test build #132242 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132242/testReport)** for PR 30609 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30598: [SPARK-33654][SQL] Migrate CACHE TABLE to use UnresolvedRelation to resolve identifier

2020-12-04 Thread GitBox
AmplabJenkins removed a comment on pull request #30598: URL: https://github.com/apache/spark/pull/30598#issuecomment-738970180 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30312: [SPARK-32917][SHUFFLE][CORE] Adds support for executors to push shuffle blocks after successful map task completion

2020-12-04 Thread GitBox
AmplabJenkins removed a comment on pull request #30312: URL: https://github.com/apache/spark/pull/30312#issuecomment-738970184 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36842/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30604: [SPARK-33571][SQL][DOCS][3.0] Add a ref to INT96 config from the doc for `spark.sql.legacy.parquet.datetimeRebaseModeInWrite/Re

2020-12-04 Thread GitBox
AmplabJenkins removed a comment on pull request #30604: URL: https://github.com/apache/spark/pull/30604#issuecomment-738970186 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132232/

[GitHub] [spark] SparkQA commented on pull request #30586: [SPARK-33641][SQL] Invalidate new char/varchar types in public APIs that produce incorrect results

2020-12-04 Thread GitBox
SparkQA commented on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738974292 **[Test build #132245 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132245/testReport)** for PR 30586 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29642: [SPARK-32792][SQL] Improve InSet filter pushdown

2020-12-04 Thread GitBox
AmplabJenkins removed a comment on pull request #29642: URL: https://github.com/apache/spark/pull/29642#issuecomment-738973065 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132235/

[GitHub] [spark] yaooqinn commented on pull request #30586: [SPARK-33641][SQL] Invalidate new char/varchar types in public APIs that produce incorrect results

2020-12-04 Thread GitBox
yaooqinn commented on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738973425 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] SparkQA removed a comment on pull request #30586: [SPARK-33641][SQL] Invalidate new char/varchar types in public APIs that produce incorrect results

2020-12-04 Thread GitBox
SparkQA removed a comment on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738810804 **[Test build #132233 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132233/testReport)** for PR 30586 at commit

[GitHub] [spark] SparkQA commented on pull request #30606: [SPARK-33662][BUILD] Setting version to 3.2.0-SNAPSHOT

2020-12-04 Thread GitBox
SparkQA commented on pull request #30606: URL: https://github.com/apache/spark/pull/30606#issuecomment-738931237 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36837/

[GitHub] [spark] xkrogen commented on pull request #29966: [SPARK-33084][CORE][SQL] Add jar support ivy path

2020-12-04 Thread GitBox
xkrogen commented on pull request #29966: URL: https://github.com/apache/spark/pull/29966#issuecomment-738936950 @maropu are there any more blockers from your side? I'd love to get this into the 3.1 release if possible. Last re-ping to @HeartSaVioR @srowen @gaborgsomogyi in case

[GitHub] [spark] SparkQA commented on pull request #30312: [SPARK-32917][SHUFFLE][CORE] Adds support for executors to push shuffle blocks after successful map task completion

2020-12-04 Thread GitBox
SparkQA commented on pull request #30312: URL: https://github.com/apache/spark/pull/30312#issuecomment-738945639 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36842/

[GitHub] [spark] AmplabJenkins commented on pull request #30606: [SPARK-33662][BUILD] Setting version to 3.2.0-SNAPSHOT

2020-12-04 Thread GitBox
AmplabJenkins commented on pull request #30606: URL: https://github.com/apache/spark/pull/30606#issuecomment-738947653 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36837/

[GitHub] [spark] SparkQA commented on pull request #30312: [SPARK-32917][SHUFFLE][CORE] Adds support for executors to push shuffle blocks after successful map task completion

2020-12-04 Thread GitBox
SparkQA commented on pull request #30312: URL: https://github.com/apache/spark/pull/30312#issuecomment-738958586 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36842/

[GitHub] [spark] SparkQA commented on pull request #30609: [MINOR][SQL] Fix string interpolation in CommandUtils.scala

2020-12-04 Thread GitBox
SparkQA commented on pull request #30609: URL: https://github.com/apache/spark/pull/30609#issuecomment-738986588 **[Test build #132242 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132242/testReport)** for PR 30609 at commit

[GitHub] [spark] otterc commented on a change in pull request #30433: [SPARK-32916][SHUFFLE][test-maven][test-hadoop2.7] Ensure the number of chunks in meta file and index file are equal

2020-12-04 Thread GitBox
otterc commented on a change in pull request #30433: URL: https://github.com/apache/spark/pull/30433#discussion_r536347251 ## File path: common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/RemoteBlockPushResolver.java ## @@ -369,27 +388,19 @@ public

[GitHub] [spark] ScrapCodes opened a new pull request #30616: [SPARK-33668][k8s][Test] Fix flaky test "Verify logging configuration is picked from the provided...

2020-12-04 Thread GitBox
ScrapCodes opened a new pull request #30616: URL: https://github.com/apache/spark/pull/30616 ### What changes were proposed in this pull request? Fix flaky test "Verify logging configuration is picked from the provided SPARK_CONF_DIR/log4j.properties." ### Why

[GitHub] [spark] SparkQA commented on pull request #29247: [SPARK-32446][SHS] Add percentile distribution REST API of peak memory metrics for all executors

2020-12-04 Thread GitBox
SparkQA commented on pull request #29247: URL: https://github.com/apache/spark/pull/29247#issuecomment-738910126 **[Test build #132238 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132238/testReport)** for PR 29247 at commit

[GitHub] [spark] SparkQA commented on pull request #30606: [SPARK-33662][BUILD] Setting version to 3.2.0-SNAPSHOT

2020-12-04 Thread GitBox
SparkQA commented on pull request #30606: URL: https://github.com/apache/spark/pull/30606#issuecomment-738909278 **[Test build #132237 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132237/testReport)** for PR 30606 at commit

[GitHub] [spark] dongjoon-hyun opened a new pull request #30607: [MINOR][INFRA][3.1] Update branch name from master to branch-3.1 GitHub Action

2020-12-04 Thread GitBox
dongjoon-hyun opened a new pull request #30607: URL: https://github.com/apache/spark/pull/30607 … ### What changes were proposed in this pull request? ### Why are the changes needed? ### Does this PR introduce _any_ user-facing change?

[GitHub] [spark] SparkQA commented on pull request #30598: [SPARK-33654][SQL] Migrate CACHE TABLE to use UnresolvedRelation to resolve identifier

2020-12-04 Thread GitBox
SparkQA commented on pull request #30598: URL: https://github.com/apache/spark/pull/30598#issuecomment-738917096 **[Test build #132240 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132240/testReport)** for PR 30598 at commit

[GitHub] [spark] SparkQA commented on pull request #29247: [SPARK-32446][SHS] Add percentile distribution REST API of peak memory metrics for all executors

2020-12-04 Thread GitBox
SparkQA commented on pull request #29247: URL: https://github.com/apache/spark/pull/29247#issuecomment-738932590 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36838/

[GitHub] [spark] dongjoon-hyun commented on pull request #30606: [SPARK-33662][BUILD] Setting version to 3.2.0-SNAPSHOT

2020-12-04 Thread GitBox
dongjoon-hyun commented on pull request #30606: URL: https://github.com/apache/spark/pull/30606#issuecomment-738956210 Thank you, @gengliangwang ! This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] SparkQA removed a comment on pull request #30606: [SPARK-33662][BUILD] Setting version to 3.2.0-SNAPSHOT

2020-12-04 Thread GitBox
SparkQA removed a comment on pull request #30606: URL: https://github.com/apache/spark/pull/30606#issuecomment-738909278 **[Test build #132237 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132237/testReport)** for PR 30606 at commit

[GitHub] [spark] SparkQA commented on pull request #30606: [SPARK-33662][BUILD] Setting version to 3.2.0-SNAPSHOT

2020-12-04 Thread GitBox
SparkQA commented on pull request #30606: URL: https://github.com/apache/spark/pull/30606#issuecomment-738971551 **[Test build #132237 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132237/testReport)** for PR 30606 at commit

[GitHub] [spark] SparkQA commented on pull request #30607: [MINOR][INFRA][3.1] Update branch name from master to branch-3.1 GitHub Action

2020-12-04 Thread GitBox
SparkQA commented on pull request #30607: URL: https://github.com/apache/spark/pull/30607#issuecomment-738982543 **[Test build #132239 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132239/testReport)** for PR 30607 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #30607: [MINOR][INFRA][3.1] Update branch name from master to branch-3.1 GitHub Action

2020-12-04 Thread GitBox
SparkQA removed a comment on pull request #30607: URL: https://github.com/apache/spark/pull/30607#issuecomment-738911867 **[Test build #132239 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132239/testReport)** for PR 30607 at commit

[GitHub] [spark] imback82 commented on pull request #30608: [SPARK-33663][SQL] Uncaching should not be called on non-existing temp views.

2020-12-04 Thread GitBox
imback82 commented on pull request #30608: URL: https://github.com/apache/spark/pull/30608#issuecomment-739079855 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] SparkQA removed a comment on pull request #30610: [SPARK-33664][SQL] Migrate ALTER TABLE ... RENAME TO to use UnresolvedTableOrView to resolve identifier

2020-12-04 Thread GitBox
SparkQA removed a comment on pull request #30610: URL: https://github.com/apache/spark/pull/30610#issuecomment-73991 **[Test build #132246 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132246/testReport)** for PR 30610 at commit

[GitHub] [spark] SparkQA commented on pull request #30312: [SPARK-32917][SHUFFLE][CORE] Adds support for executors to push shuffle blocks after successful map task completion

2020-12-04 Thread GitBox
SparkQA commented on pull request #30312: URL: https://github.com/apache/spark/pull/30312#issuecomment-739084962 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36853/

[GitHub] [spark] SparkQA commented on pull request #30611: [SPARK-33141][SQL][FOLLOW-UP] Fix Scala 2.13 compilation

2020-12-04 Thread GitBox
SparkQA commented on pull request #30611: URL: https://github.com/apache/spark/pull/30611#issuecomment-739084844 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36851/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30312: [SPARK-32917][SHUFFLE][CORE] Adds support for executors to push shuffle blocks after successful map task completion

2020-12-04 Thread GitBox
AmplabJenkins removed a comment on pull request #30312: URL: https://github.com/apache/spark/pull/30312#issuecomment-739092396 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36853/

[GitHub] [spark] AmplabJenkins commented on pull request #30312: [SPARK-32917][SHUFFLE][CORE] Adds support for executors to push shuffle blocks after successful map task completion

2020-12-04 Thread GitBox
AmplabJenkins commented on pull request #30312: URL: https://github.com/apache/spark/pull/30312#issuecomment-739092396 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36853/

[GitHub] [spark] SparkQA commented on pull request #30312: [SPARK-32917][SHUFFLE][CORE] Adds support for executors to push shuffle blocks after successful map task completion

2020-12-04 Thread GitBox
SparkQA commented on pull request #30312: URL: https://github.com/apache/spark/pull/30312#issuecomment-739092383 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36853/

[GitHub] [spark] sunchao commented on a change in pull request #30597: [SPARK-33652][SQL] DSv2: DeleteFrom should refresh cache

2020-12-04 Thread GitBox
sunchao commented on a change in pull request #30597: URL: https://github.com/apache/spark/pull/30597#discussion_r536467268 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/execution/datasources/v2/DataSourceV2Relation.scala ## @@ -111,16 +111,16 @@ case class

[GitHub] [spark] SparkQA commented on pull request #30573: [SPARK-26341][WEBUI]Expose executor memory metrics at the stage level, in the Stages tab

2020-12-04 Thread GitBox
SparkQA commented on pull request #30573: URL: https://github.com/apache/spark/pull/30573#issuecomment-739098976 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36856/

[GitHub] [spark] SparkQA commented on pull request #29966: [SPARK-33084][CORE][SQL] Add jar support ivy path

2020-12-04 Thread GitBox
SparkQA commented on pull request #29966: URL: https://github.com/apache/spark/pull/29966#issuecomment-739099014 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36855/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30595: [SPARK-33651][SQL] Allow CREATE EXTERNAL TABLE with LOCATION for data source tables

2020-12-04 Thread GitBox
AmplabJenkins removed a comment on pull request #30595: URL: https://github.com/apache/spark/pull/30595#issuecomment-739100304 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132247/

  1   2   3   4   5   6   7   8   >