[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24221: [SPARK-27248][SQL] `refreshTable` should recreate cache with same cache name and storage level

dongjoon-hyun commented on a change in pull request #24221: [SPARK-27248][SQL] `refreshTable` should recreate cache with same cache name and storage level URL: https://github.com/apache/spark/pull/24221#discussion_r285422162 ## File path: sql/hive/src/test/scala/org/apache/spark/sq

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24221: [SPARK-27248][SQL] `refreshTable` should recreate cache with same cache name and storage level

dongjoon-hyun commented on a change in pull request #24221: [SPARK-27248][SQL] `refreshTable` should recreate cache with same cache name and storage level URL: https://github.com/apache/spark/pull/24221#discussion_r285422146 ## File path: sql/hive/src/test/scala/org/apache/spark/sq

[GitHub] [spark] AmplabJenkins commented on issue #24631: [MINOR][CORE] Avoid hardcoded configs

AmplabJenkins commented on issue #24631: [MINOR][CORE] Avoid hardcoded configs URL: https://github.com/apache/spark/pull/24631#issuecomment-493830153 Merged build finished. Test PASSed. This is an automated message from the Ap

[GitHub] [spark] AmplabJenkins commented on issue #24631: [MINOR][CORE] Avoid hardcoded configs

AmplabJenkins commented on issue #24631: [MINOR][CORE] Avoid hardcoded configs URL: https://github.com/apache/spark/pull/24631#issuecomment-493830155 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/Spar

[GitHub] [spark] AmplabJenkins removed a comment on issue #24631: [MINOR][CORE] Avoid hardcoded configs

AmplabJenkins removed a comment on issue #24631: [MINOR][CORE] Avoid hardcoded configs URL: https://github.com/apache/spark/pull/24631#issuecomment-493830155 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24221: [SPARK-27248][SQL] `refreshTable` should recreate cache with same cache name and storage level

dongjoon-hyun commented on a change in pull request #24221: [SPARK-27248][SQL] `refreshTable` should recreate cache with same cache name and storage level URL: https://github.com/apache/spark/pull/24221#discussion_r285422259 ## File path: sql/core/src/test/scala/org/apache/spark/sql

[GitHub] [spark] AmplabJenkins removed a comment on issue #24631: [MINOR][CORE] Avoid hardcoded configs

AmplabJenkins removed a comment on issue #24631: [MINOR][CORE] Avoid hardcoded configs URL: https://github.com/apache/spark/pull/24631#issuecomment-493830153 Merged build finished. Test PASSed. This is an automated message fr

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24221: [SPARK-27248][SQL] `refreshTable` should recreate cache with same cache name and storage level

dongjoon-hyun commented on a change in pull request #24221: [SPARK-27248][SQL] `refreshTable` should recreate cache with same cache name and storage level URL: https://github.com/apache/spark/pull/24221#discussion_r285422353 ## File path: sql/core/src/test/scala/org/apache/spark/sql

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24221: [SPARK-27248][SQL] `refreshTable` should recreate cache with same cache name and storage level

dongjoon-hyun commented on a change in pull request #24221: [SPARK-27248][SQL] `refreshTable` should recreate cache with same cache name and storage level URL: https://github.com/apache/spark/pull/24221#discussion_r285422109 ## File path: sql/hive/src/test/scala/org/apache/spark/sq

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24221: [SPARK-27248][SQL] `refreshTable` should recreate cache with same cache name and storage level

dongjoon-hyun commented on a change in pull request #24221: [SPARK-27248][SQL] `refreshTable` should recreate cache with same cache name and storage level URL: https://github.com/apache/spark/pull/24221#discussion_r285422373 ## File path: sql/core/src/test/scala/org/apache/spark/sql

[GitHub] [spark] HyukjinKwon commented on issue #24644: [SPARK-27402][INFRA][FOLLOW-UP] Exclude 'hive-thriftserver' in modules to test for hadoop3.2 for now

HyukjinKwon commented on issue #24644: [SPARK-27402][INFRA][FOLLOW-UP] Exclude 'hive-thriftserver' in modules to test for hadoop3.2 for now URL: https://github.com/apache/spark/pull/24644#issuecomment-493830628 okie profiles look good. --

[GitHub] [spark] viirya commented on a change in pull request #24644: [SPARK-27402][INFRA][FOLLOW-UP] Exclude 'hive-thriftserver' in modules to test for hadoop3.2 for now

viirya commented on a change in pull request #24644: [SPARK-27402][INFRA][FOLLOW-UP] Exclude 'hive-thriftserver' in modules to test for hadoop3.2 for now URL: https://github.com/apache/spark/pull/24644#discussion_r285423349 ## File path: dev/sparktestsupport/modules.py ##

[GitHub] [spark] dongjoon-hyun closed pull request #24641: [SPARK-27610][FOLLOW-UP][YARN] Remove duplicate declaration of plugin maven-antrun-plugin

dongjoon-hyun closed pull request #24641: [SPARK-27610][FOLLOW-UP][YARN] Remove duplicate declaration of plugin maven-antrun-plugin URL: https://github.com/apache/spark/pull/24641 This is an automated message from the Apache

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24594: [SPARK-27693][SQL] Add default catalog property

dongjoon-hyun commented on a change in pull request #24594: [SPARK-27693][SQL] Add default catalog property URL: https://github.com/apache/spark/pull/24594#discussion_r285424373 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -1

[GitHub] [spark] dongjoon-hyun commented on issue #24594: [SPARK-27693][SQL] Add default catalog property

dongjoon-hyun commented on issue #24594: [SPARK-27693][SQL] Add default catalog property URL: https://github.com/apache/spark/pull/24594#issuecomment-493834677 Retest this please. This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins commented on issue #24594: [SPARK-27693][SQL] Add default catalog property

AmplabJenkins commented on issue #24594: [SPARK-27693][SQL] Add default catalog property URL: https://github.com/apache/spark/pull/24594#issuecomment-493834935 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenki

[GitHub] [spark] AmplabJenkins commented on issue #24594: [SPARK-27693][SQL] Add default catalog property

AmplabJenkins commented on issue #24594: [SPARK-27693][SQL] Add default catalog property URL: https://github.com/apache/spark/pull/24594#issuecomment-493834930 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] AmplabJenkins removed a comment on issue #24594: [SPARK-27693][SQL] Add default catalog property

AmplabJenkins removed a comment on issue #24594: [SPARK-27693][SQL] Add default catalog property URL: https://github.com/apache/spark/pull/24594#issuecomment-493834935 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.e

[GitHub] [spark] AmplabJenkins removed a comment on issue #24594: [SPARK-27693][SQL] Add default catalog property

AmplabJenkins removed a comment on issue #24594: [SPARK-27693][SQL] Add default catalog property URL: https://github.com/apache/spark/pull/24594#issuecomment-493834930 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] SparkQA commented on issue #24594: [SPARK-27693][SQL] Add default catalog property

SparkQA commented on issue #24594: [SPARK-27693][SQL] Add default catalog property URL: https://github.com/apache/spark/pull/24594#issuecomment-493835187 **[Test build #105546 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105546/testReport)** for PR 24594

[GitHub] [spark] dongjoon-hyun closed pull request #24594: [SPARK-27693][SQL] Add default catalog property

dongjoon-hyun closed pull request #24594: [SPARK-27693][SQL] Add default catalog property URL: https://github.com/apache/spark/pull/24594 This is an automated message from the Apache Git Service. To respond to the message, p

[GitHub] [spark] SparkQA commented on issue #24644: [SPARK-27402][INFRA][FOLLOW-UP] Exclude 'hive-thriftserver' in modules to test for hadoop3.2 for now

SparkQA commented on issue #24644: [SPARK-27402][INFRA][FOLLOW-UP] Exclude 'hive-thriftserver' in modules to test for hadoop3.2 for now URL: https://github.com/apache/spark/pull/24644#issuecomment-493837230 **[Test build #105544 has finished](https://amplab.cs.berkeley.edu/jenkins/job/Spar

[GitHub] [spark] SparkQA removed a comment on issue #24644: [SPARK-27402][INFRA][FOLLOW-UP] Exclude 'hive-thriftserver' in modules to test for hadoop3.2 for now

SparkQA removed a comment on issue #24644: [SPARK-27402][INFRA][FOLLOW-UP] Exclude 'hive-thriftserver' in modules to test for hadoop3.2 for now URL: https://github.com/apache/spark/pull/24644#issuecomment-493826550 **[Test build #105544 has started](https://amplab.cs.berkeley.edu/jenkins/j

[GitHub] [spark] AmplabJenkins commented on issue #24644: [SPARK-27402][INFRA][FOLLOW-UP] Exclude 'hive-thriftserver' in modules to test for hadoop3.2 for now

AmplabJenkins commented on issue #24644: [SPARK-27402][INFRA][FOLLOW-UP] Exclude 'hive-thriftserver' in modules to test for hadoop3.2 for now URL: https://github.com/apache/spark/pull/24644#issuecomment-493837335 Test FAILed. Refer to this link for build results (access rights to CI serv

[GitHub] [spark] AmplabJenkins commented on issue #24644: [SPARK-27402][INFRA][FOLLOW-UP] Exclude 'hive-thriftserver' in modules to test for hadoop3.2 for now

AmplabJenkins commented on issue #24644: [SPARK-27402][INFRA][FOLLOW-UP] Exclude 'hive-thriftserver' in modules to test for hadoop3.2 for now URL: https://github.com/apache/spark/pull/24644#issuecomment-493837330 Merged build finished. Test FAILed. -

[GitHub] [spark] dongjoon-hyun commented on issue #24335: [SPARK-27425][SQL] Add count_if functions

dongjoon-hyun commented on issue #24335: [SPARK-27425][SQL] Add count_if functions URL: https://github.com/apache/spark/pull/24335#issuecomment-493837370 Hi, @cryeo . Did you ask the questions to the community as @HyukjinKwon recommended? I'm just wondering if the decision was made. If we

[GitHub] [spark] AmplabJenkins removed a comment on issue #24644: [SPARK-27402][INFRA][FOLLOW-UP] Exclude 'hive-thriftserver' in modules to test for hadoop3.2 for now

AmplabJenkins removed a comment on issue #24644: [SPARK-27402][INFRA][FOLLOW-UP] Exclude 'hive-thriftserver' in modules to test for hadoop3.2 for now URL: https://github.com/apache/spark/pull/24644#issuecomment-493837330 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24644: [SPARK-27402][INFRA][FOLLOW-UP] Exclude 'hive-thriftserver' in modules to test for hadoop3.2 for now

AmplabJenkins removed a comment on issue #24644: [SPARK-27402][INFRA][FOLLOW-UP] Exclude 'hive-thriftserver' in modules to test for hadoop3.2 for now URL: https://github.com/apache/spark/pull/24644#issuecomment-493837335 Test FAILed. Refer to this link for build results (access rights t

[GitHub] [spark] cxzl25 commented on a change in pull request #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative

cxzl25 commented on a change in pull request #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative URL: https://github.com/apache/spark/pull/24497#discussion_r285428024 ## File path: core/src/main/scala/org/apache/spark/ExecutorAllocationManager.

[GitHub] [spark] dongjoon-hyun commented on issue #24631: [MINOR][CORE] Avoid hardcoded configs

dongjoon-hyun commented on issue #24631: [MINOR][CORE] Avoid hardcoded configs URL: https://github.com/apache/spark/pull/24631#issuecomment-493838177 @wenxuanguan . Thank you for improving the PR. Now, this PR seems need a JIRA issue because it touches many files. Could you file a Apache Sp

[GitHub] [spark] HyukjinKwon commented on a change in pull request #24644: [SPARK-27402][INFRA][FOLLOW-UP] Exclude 'hive-thriftserver' in modules to test for hadoop3.2 for now

HyukjinKwon commented on a change in pull request #24644: [SPARK-27402][INFRA][FOLLOW-UP] Exclude 'hive-thriftserver' in modules to test for hadoop3.2 for now URL: https://github.com/apache/spark/pull/24644#discussion_r285428395 ## File path: dev/sparktestsupport/modules.py ##

[GitHub] [spark] dongjoon-hyun commented on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode

dongjoon-hyun commented on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode URL: https://github.com/apache/spark/pull/24637#issuecomment-493838695 cc @dbtsai -

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode

dongjoon-hyun commented on a change in pull request #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode URL: https://github.com/apache/spark/pull/24637#discussion_r285429248 ## File path: sql/catalyst/src/main/scala/org/

[GitHub] [spark] jzhuge commented on issue #24594: [SPARK-27693][SQL] Add default catalog property

jzhuge commented on issue #24594: [SPARK-27693][SQL] Add default catalog property URL: https://github.com/apache/spark/pull/24594#issuecomment-493839634 Thanks @dongjoon-hyun ! This is an automated message from the Apache Git

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode

dongjoon-hyun commented on a change in pull request #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode URL: https://github.com/apache/spark/pull/24637#discussion_r285429248 ## File path: sql/catalyst/src/main/scala/org/

[GitHub] [spark] viirya commented on a change in pull request #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode

viirya commented on a change in pull request #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode URL: https://github.com/apache/spark/pull/24637#discussion_r285429526 ## File path: sql/catalyst/src/main/scala/org/apache/s

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode

dongjoon-hyun commented on a change in pull request #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode URL: https://github.com/apache/spark/pull/24637#discussion_r285429576 ## File path: sql/core/src/test/scala/org/apac

[GitHub] [spark] SparkQA commented on issue #24644: [SPARK-27402][INFRA][FOLLOW-UP] Exclude 'hive-thriftserver' in modules to test for hadoop3.2 for now

SparkQA commented on issue #24644: [SPARK-27402][INFRA][FOLLOW-UP] Exclude 'hive-thriftserver' in modules to test for hadoop3.2 for now URL: https://github.com/apache/spark/pull/24644#issuecomment-493840155 **[Test build #105545 has finished](https://amplab.cs.berkeley.edu/jenkins/job/Spar

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode

dongjoon-hyun commented on a change in pull request #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode URL: https://github.com/apache/spark/pull/24637#discussion_r285429699 ## File path: sql/core/src/test/scala/org/apac

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode

dongjoon-hyun commented on a change in pull request #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode URL: https://github.com/apache/spark/pull/24637#discussion_r285429711 ## File path: sql/catalyst/src/main/scala/org/

[GitHub] [spark] AmplabJenkins commented on issue #24644: [SPARK-27402][INFRA][FOLLOW-UP] Exclude 'hive-thriftserver' in modules to test for hadoop3.2 for now

AmplabJenkins commented on issue #24644: [SPARK-27402][INFRA][FOLLOW-UP] Exclude 'hive-thriftserver' in modules to test for hadoop3.2 for now URL: https://github.com/apache/spark/pull/24644#issuecomment-493840306 Test FAILed. Refer to this link for build results (access rights to CI serv

[GitHub] [spark] AmplabJenkins commented on issue #24644: [SPARK-27402][INFRA][FOLLOW-UP] Exclude 'hive-thriftserver' in modules to test for hadoop3.2 for now

AmplabJenkins commented on issue #24644: [SPARK-27402][INFRA][FOLLOW-UP] Exclude 'hive-thriftserver' in modules to test for hadoop3.2 for now URL: https://github.com/apache/spark/pull/24644#issuecomment-493840303 Merged build finished. Test FAILed. -

[GitHub] [spark] SparkQA removed a comment on issue #24644: [SPARK-27402][INFRA][FOLLOW-UP] Exclude 'hive-thriftserver' in modules to test for hadoop3.2 for now

SparkQA removed a comment on issue #24644: [SPARK-27402][INFRA][FOLLOW-UP] Exclude 'hive-thriftserver' in modules to test for hadoop3.2 for now URL: https://github.com/apache/spark/pull/24644#issuecomment-493827618 **[Test build #105545 has started](https://amplab.cs.berkeley.edu/jenkins/j

[GitHub] [spark] AmplabJenkins removed a comment on issue #24644: [SPARK-27402][INFRA][FOLLOW-UP] Exclude 'hive-thriftserver' in modules to test for hadoop3.2 for now

AmplabJenkins removed a comment on issue #24644: [SPARK-27402][INFRA][FOLLOW-UP] Exclude 'hive-thriftserver' in modules to test for hadoop3.2 for now URL: https://github.com/apache/spark/pull/24644#issuecomment-493840303 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24644: [SPARK-27402][INFRA][FOLLOW-UP] Exclude 'hive-thriftserver' in modules to test for hadoop3.2 for now

AmplabJenkins removed a comment on issue #24644: [SPARK-27402][INFRA][FOLLOW-UP] Exclude 'hive-thriftserver' in modules to test for hadoop3.2 for now URL: https://github.com/apache/spark/pull/24644#issuecomment-493840306 Test FAILed. Refer to this link for build results (access rights t

[GitHub] [spark] viirya commented on a change in pull request #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode

viirya commented on a change in pull request #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode URL: https://github.com/apache/spark/pull/24637#discussion_r285430439 ## File path: sql/core/src/test/scala/org/apache/spark

[GitHub] [spark] viirya commented on a change in pull request #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode

viirya commented on a change in pull request #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode URL: https://github.com/apache/spark/pull/24637#discussion_r285430503 ## File path: sql/core/src/test/scala/org/apache/spark

[GitHub] [spark] cloud-fan commented on a change in pull request #24594: [SPARK-27693][SQL] Add default catalog property

cloud-fan commented on a change in pull request #24594: [SPARK-27693][SQL] Add default catalog property URL: https://github.com/apache/spark/pull/24594#discussion_r285431212 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -1767,

[GitHub] [spark] cloud-fan commented on a change in pull request #24594: [SPARK-27693][SQL] Add default catalog property

cloud-fan commented on a change in pull request #24594: [SPARK-27693][SQL] Add default catalog property URL: https://github.com/apache/spark/pull/24594#discussion_r285431382 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -1767,

[GitHub] [spark] cloud-fan commented on a change in pull request #24233: [SPARK-26356][SQL] remove SaveMode from data source v2

cloud-fan commented on a change in pull request #24233: [SPARK-26356][SQL] remove SaveMode from data source v2 URL: https://github.com/apache/spark/pull/24233#discussion_r285431892 ## File path: sql/core/src/test/scala/org/apache/spark/sql/sources/v2/DataSourceV2Suite.scala ##

[GitHub] [spark] HyukjinKwon commented on issue #24644: [SPARK-27402][INFRA][FOLLOW-UP] Exclude 'hive-thriftserver' in modules to test for hadoop3.2 for now

HyukjinKwon commented on issue #24644: [SPARK-27402][INFRA][FOLLOW-UP] Exclude 'hive-thriftserver' in modules to test for hadoop3.2 for now URL: https://github.com/apache/spark/pull/24644#issuecomment-493843148 retest this please

[GitHub] [spark] AmplabJenkins commented on issue #24644: [SPARK-27402][INFRA][FOLLOW-UP] Exclude 'hive-thriftserver' in modules to test for hadoop3.2 for now

AmplabJenkins commented on issue #24644: [SPARK-27402][INFRA][FOLLOW-UP] Exclude 'hive-thriftserver' in modules to test for hadoop3.2 for now URL: https://github.com/apache/spark/pull/24644#issuecomment-493843572 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins commented on issue #24644: [SPARK-27402][INFRA][FOLLOW-UP] Exclude 'hive-thriftserver' in modules to test for hadoop3.2 for now

AmplabJenkins commented on issue #24644: [SPARK-27402][INFRA][FOLLOW-UP] Exclude 'hive-thriftserver' in modules to test for hadoop3.2 for now URL: https://github.com/apache/spark/pull/24644#issuecomment-493843576 Test PASSed. Refer to this link for build results (access rights to CI serv

[GitHub] [spark] AmplabJenkins removed a comment on issue #24644: [SPARK-27402][INFRA][FOLLOW-UP] Exclude 'hive-thriftserver' in modules to test for hadoop3.2 for now

AmplabJenkins removed a comment on issue #24644: [SPARK-27402][INFRA][FOLLOW-UP] Exclude 'hive-thriftserver' in modules to test for hadoop3.2 for now URL: https://github.com/apache/spark/pull/24644#issuecomment-493843572 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24644: [SPARK-27402][INFRA][FOLLOW-UP] Exclude 'hive-thriftserver' in modules to test for hadoop3.2 for now

AmplabJenkins removed a comment on issue #24644: [SPARK-27402][INFRA][FOLLOW-UP] Exclude 'hive-thriftserver' in modules to test for hadoop3.2 for now URL: https://github.com/apache/spark/pull/24644#issuecomment-493843576 Test PASSed. Refer to this link for build results (access rights t

[GitHub] [spark] SparkQA commented on issue #24644: [SPARK-27402][INFRA][FOLLOW-UP] Exclude 'hive-thriftserver' in modules to test for hadoop3.2 for now

SparkQA commented on issue #24644: [SPARK-27402][INFRA][FOLLOW-UP] Exclude 'hive-thriftserver' in modules to test for hadoop3.2 for now URL: https://github.com/apache/spark/pull/24644#issuecomment-493843871 **[Test build #105547 has started](https://amplab.cs.berkeley.edu/jenkins/job/Spark

[GitHub] [spark] dongjoon-hyun closed pull request #24596: [SPARK-27694][SQL] Support auto-updating table statistics for data source CTAS command

dongjoon-hyun closed pull request #24596: [SPARK-27694][SQL] Support auto-updating table statistics for data source CTAS command URL: https://github.com/apache/spark/pull/24596 This is an automated message from the Apache Gi

[GitHub] [spark] AmplabJenkins commented on issue #24626: [SPARK-27747][SQL] add a logical plan link in the physical plan

AmplabJenkins commented on issue #24626: [SPARK-27747][SQL] add a logical plan link in the physical plan URL: https://github.com/apache/spark/pull/24626#issuecomment-493844771 Merged build finished. Test PASSed. This is an au

[GitHub] [spark] AmplabJenkins removed a comment on issue #24626: [SPARK-27747][SQL] add a logical plan link in the physical plan

AmplabJenkins removed a comment on issue #24626: [SPARK-27747][SQL] add a logical plan link in the physical plan URL: https://github.com/apache/spark/pull/24626#issuecomment-493844775 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampl

[GitHub] [spark] AmplabJenkins removed a comment on issue #24626: [SPARK-27747][SQL] add a logical plan link in the physical plan

AmplabJenkins removed a comment on issue #24626: [SPARK-27747][SQL] add a logical plan link in the physical plan URL: https://github.com/apache/spark/pull/24626#issuecomment-493844771 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #24626: [SPARK-27747][SQL] add a logical plan link in the physical plan

AmplabJenkins commented on issue #24626: [SPARK-27747][SQL] add a logical plan link in the physical plan URL: https://github.com/apache/spark/pull/24626#issuecomment-493844775 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.be

[GitHub] [spark] SparkQA commented on issue #24626: [SPARK-27747][SQL] add a logical plan link in the physical plan

SparkQA commented on issue #24626: [SPARK-27747][SQL] add a logical plan link in the physical plan URL: https://github.com/apache/spark/pull/24626#issuecomment-493845094 **[Test build #105548 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105548/testReport)

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24601: [SPARK-27702][K8S] Allow using some alternatives for service accounts

dongjoon-hyun commented on a change in pull request #24601: [SPARK-27702][K8S] Allow using some alternatives for service accounts URL: https://github.com/apache/spark/pull/24601#discussion_r285434004 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/sc

[GitHub] [spark] maryannxue commented on issue #24626: [SPARK-27747][SQL] add a logical plan link in the physical plan

maryannxue commented on issue #24626: [SPARK-27747][SQL] add a logical plan link in the physical plan URL: https://github.com/apache/spark/pull/24626#issuecomment-493846041 LGTM, pending Jenkins. This is an automated message

[GitHub] [spark] AmplabJenkins commented on issue #24626: [SPARK-27747][SQL] add a logical plan link in the physical plan

AmplabJenkins commented on issue #24626: [SPARK-27747][SQL] add a logical plan link in the physical plan URL: https://github.com/apache/spark/pull/24626#issuecomment-493846049 Merged build finished. Test PASSed. This is an au

[GitHub] [spark] AmplabJenkins commented on issue #24626: [SPARK-27747][SQL] add a logical plan link in the physical plan

AmplabJenkins commented on issue #24626: [SPARK-27747][SQL] add a logical plan link in the physical plan URL: https://github.com/apache/spark/pull/24626#issuecomment-493846055 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.be

[GitHub] [spark] AmplabJenkins removed a comment on issue #24626: [SPARK-27747][SQL] add a logical plan link in the physical plan

AmplabJenkins removed a comment on issue #24626: [SPARK-27747][SQL] add a logical plan link in the physical plan URL: https://github.com/apache/spark/pull/24626#issuecomment-493846049 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #24626: [SPARK-27747][SQL] add a logical plan link in the physical plan

AmplabJenkins removed a comment on issue #24626: [SPARK-27747][SQL] add a logical plan link in the physical plan URL: https://github.com/apache/spark/pull/24626#issuecomment-493846055 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampl

[GitHub] [spark] SparkQA commented on issue #24626: [SPARK-27747][SQL] add a logical plan link in the physical plan

SparkQA commented on issue #24626: [SPARK-27747][SQL] add a logical plan link in the physical plan URL: https://github.com/apache/spark/pull/24626#issuecomment-493846374 **[Test build #105549 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105549/testReport)

[GitHub] [spark] dongjoon-hyun commented on issue #23992: [SPARK-27074][SQL] Hive 3.1 metastore support HiveClientImpl.runHive

dongjoon-hyun commented on issue #23992: [SPARK-27074][SQL] Hive 3.1 metastore support HiveClientImpl.runHive URL: https://github.com/apache/spark/pull/23992#issuecomment-493847124 Retest this please. This is an automated mes

[GitHub] [spark] AmplabJenkins commented on issue #23992: [SPARK-27074][SQL] Hive 3.1 metastore support HiveClientImpl.runHive

AmplabJenkins commented on issue #23992: [SPARK-27074][SQL] Hive 3.1 metastore support HiveClientImpl.runHive URL: https://github.com/apache/spark/pull/23992#issuecomment-493847375 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.

[GitHub] [spark] AmplabJenkins removed a comment on issue #23992: [SPARK-27074][SQL] Hive 3.1 metastore support HiveClientImpl.runHive

AmplabJenkins removed a comment on issue #23992: [SPARK-27074][SQL] Hive 3.1 metastore support HiveClientImpl.runHive URL: https://github.com/apache/spark/pull/23992#issuecomment-493847375 Test PASSed. Refer to this link for build results (access rights to CI server needed): https:/

[GitHub] [spark] AmplabJenkins removed a comment on issue #23992: [SPARK-27074][SQL] Hive 3.1 metastore support HiveClientImpl.runHive

AmplabJenkins removed a comment on issue #23992: [SPARK-27074][SQL] Hive 3.1 metastore support HiveClientImpl.runHive URL: https://github.com/apache/spark/pull/23992#issuecomment-493847373 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #23992: [SPARK-27074][SQL] Hive 3.1 metastore support HiveClientImpl.runHive

AmplabJenkins commented on issue #23992: [SPARK-27074][SQL] Hive 3.1 metastore support HiveClientImpl.runHive URL: https://github.com/apache/spark/pull/23992#issuecomment-493847373 Merged build finished. Test PASSed. This is

[GitHub] [spark] SparkQA commented on issue #23992: [SPARK-27074][SQL] Hive 3.1 metastore support HiveClientImpl.runHive

SparkQA commented on issue #23992: [SPARK-27074][SQL] Hive 3.1 metastore support HiveClientImpl.runHive URL: https://github.com/apache/spark/pull/23992#issuecomment-493847713 **[Test build #105550 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105550/testRe

[GitHub] [spark] dongjoon-hyun commented on issue #24597: [SPARK-27698][SQL] Add new method for getting pushed down filters in Parquet file reader

dongjoon-hyun commented on issue #24597: [SPARK-27698][SQL] Add new method for getting pushed down filters in Parquet file reader URL: https://github.com/apache/spark/pull/24597#issuecomment-493848222 Thank you for pinging me, @gengliangwang . Shall we wait for one day? Currently, after SP

[GitHub] [spark] dongjoon-hyun edited a comment on issue #24597: [SPARK-27698][SQL] Add new method for getting pushed down filters in Parquet file reader

dongjoon-hyun edited a comment on issue #24597: [SPARK-27698][SQL] Add new method for getting pushed down filters in Parquet file reader URL: https://github.com/apache/spark/pull/24597#issuecomment-493848222 Thank you for pinging me, @gengliangwang . Shall we wait for one day? Currently, a

[GitHub] [spark] cloud-fan commented on a change in pull request #24533: [SPARK-27637][Shuffle] For nettyBlockTransferService, if IOException occurred while fetching data, check whether relative execu

cloud-fan commented on a change in pull request #24533: [SPARK-27637][Shuffle] For nettyBlockTransferService, if IOException occurred while fetching data, check whether relative executor is alive before retry URL: https://github.com/apache/spark/pull/24533#discussion_r285438461 ##

[GitHub] [spark] sjrand opened a new pull request #24645: [SPARK-27773][Shuffle] add metrics for number of exceptions caught in shuffle service's TransportChannelHandler

sjrand opened a new pull request #24645: [SPARK-27773][Shuffle] add metrics for number of exceptions caught in shuffle service's TransportChannelHandler URL: https://github.com/apache/spark/pull/24645 ## What changes were proposed in this pull request? Add a metric for number of exce

[GitHub] [spark] SparkQA commented on issue #21586: [SPARK-24586][SQL] Upcast should not allow casting from string to other types

SparkQA commented on issue #21586: [SPARK-24586][SQL] Upcast should not allow casting from string to other types URL: https://github.com/apache/spark/pull/21586#issuecomment-493852150 **[Test build #105551 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/1055

[GitHub] [spark] beliefer commented on issue #24535: [SPARK-27640][SQL][SS] Avoid duplicate lookups for datasource through provider

beliefer commented on issue #24535: [SPARK-27640][SQL][SS] Avoid duplicate lookups for datasource through provider URL: https://github.com/apache/spark/pull/24535#issuecomment-493852958 > Thank you for ping me, @beliefer . However, the reviewers' comments are consistent. And, I also agree

[GitHub] [spark] AmplabJenkins commented on issue #24645: [SPARK-27773][Shuffle] add metrics for number of exceptions caught in shuffle service's TransportChannelHandler

AmplabJenkins commented on issue #24645: [SPARK-27773][Shuffle] add metrics for number of exceptions caught in shuffle service's TransportChannelHandler URL: https://github.com/apache/spark/pull/24645#issuecomment-493853040 Can one of the admins verify this patch? -

[GitHub] [spark] AmplabJenkins commented on issue #24645: [SPARK-27773][Shuffle] add metrics for number of exceptions caught in shuffle service's TransportChannelHandler

AmplabJenkins commented on issue #24645: [SPARK-27773][Shuffle] add metrics for number of exceptions caught in shuffle service's TransportChannelHandler URL: https://github.com/apache/spark/pull/24645#issuecomment-493853151 Can one of the admins verify this patch? -

[GitHub] [spark] beliefer edited a comment on issue #24535: [SPARK-27640][SQL][SS] Avoid duplicate lookups for datasource through provider

beliefer edited a comment on issue #24535: [SPARK-27640][SQL][SS] Avoid duplicate lookups for datasource through provider URL: https://github.com/apache/spark/pull/24535#issuecomment-493852958 > Thank you for ping me, @beliefer . However, the reviewers' comments are consistent. And, I also

[GitHub] [spark] AmplabJenkins commented on issue #21586: [SPARK-24586][SQL] Upcast should not allow casting from string to other types

AmplabJenkins commented on issue #21586: [SPARK-24586][SQL] Upcast should not allow casting from string to other types URL: https://github.com/apache/spark/pull/21586#issuecomment-493853421 Test PASSed. Refer to this link for build results (access rights to CI server needed): https:

[GitHub] [spark] AmplabJenkins commented on issue #21586: [SPARK-24586][SQL] Upcast should not allow casting from string to other types

AmplabJenkins commented on issue #21586: [SPARK-24586][SQL] Upcast should not allow casting from string to other types URL: https://github.com/apache/spark/pull/21586#issuecomment-493853414 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #21586: [SPARK-24586][SQL] Upcast should not allow casting from string to other types

AmplabJenkins removed a comment on issue #21586: [SPARK-24586][SQL] Upcast should not allow casting from string to other types URL: https://github.com/apache/spark/pull/21586#issuecomment-493853414 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #21586: [SPARK-24586][SQL] Upcast should not allow casting from string to other types

AmplabJenkins removed a comment on issue #21586: [SPARK-24586][SQL] Upcast should not allow casting from string to other types URL: https://github.com/apache/spark/pull/21586#issuecomment-493853421 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] beliefer edited a comment on issue #24535: [SPARK-27640][SQL][SS] Avoid duplicate lookups for datasource through provider

beliefer edited a comment on issue #24535: [SPARK-27640][SQL][SS] Avoid duplicate lookups for datasource through provider URL: https://github.com/apache/spark/pull/24535#issuecomment-493852958 > Thank you for ping me, @beliefer . However, the reviewers' comments are consistent. And, I also

[GitHub] [spark] AmplabJenkins removed a comment on issue #24645: [SPARK-27773][Shuffle] add metrics for number of exceptions caught in shuffle service's TransportChannelHandler

AmplabJenkins removed a comment on issue #24645: [SPARK-27773][Shuffle] add metrics for number of exceptions caught in shuffle service's TransportChannelHandler URL: https://github.com/apache/spark/pull/24645#issuecomment-493853040 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #24645: [SPARK-27773][Shuffle] add metrics for number of exceptions caught in shuffle service's TransportChannelHandler

AmplabJenkins commented on issue #24645: [SPARK-27773][Shuffle] add metrics for number of exceptions caught in shuffle service's TransportChannelHandler URL: https://github.com/apache/spark/pull/24645#issuecomment-493853645 Can one of the admins verify this patch? -

[GitHub] [spark] AmplabJenkins commented on issue #24533: [SPARK-27637][Shuffle] For nettyBlockTransferService, if IOException occurred while fetching data, check whether relative executor is alive b

AmplabJenkins commented on issue #24533: [SPARK-27637][Shuffle] For nettyBlockTransferService, if IOException occurred while fetching data, check whether relative executor is alive before retry URL: https://github.com/apache/spark/pull/24533#issuecomment-493853705 Merged build finished. T

[GitHub] [spark] AmplabJenkins commented on issue #24533: [SPARK-27637][Shuffle] For nettyBlockTransferService, if IOException occurred while fetching data, check whether relative executor is alive b

AmplabJenkins commented on issue #24533: [SPARK-27637][Shuffle] For nettyBlockTransferService, if IOException occurred while fetching data, check whether relative executor is alive before retry URL: https://github.com/apache/spark/pull/24533#issuecomment-493853711 Test FAILed. Refer to

[GitHub] [spark] AmplabJenkins removed a comment on issue #24645: [SPARK-27773][Shuffle] add metrics for number of exceptions caught in shuffle service's TransportChannelHandler

AmplabJenkins removed a comment on issue #24645: [SPARK-27773][Shuffle] add metrics for number of exceptions caught in shuffle service's TransportChannelHandler URL: https://github.com/apache/spark/pull/24645#issuecomment-493853151 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins removed a comment on issue #24533: [SPARK-27637][Shuffle] For nettyBlockTransferService, if IOException occurred while fetching data, check whether relative executor is

AmplabJenkins removed a comment on issue #24533: [SPARK-27637][Shuffle] For nettyBlockTransferService, if IOException occurred while fetching data, check whether relative executor is alive before retry URL: https://github.com/apache/spark/pull/24533#issuecomment-493853705 Merged build fin

[GitHub] [spark] cryeo commented on issue #24335: [SPARK-27425][SQL] Add count_if functions

cryeo commented on issue #24335: [SPARK-27425][SQL] Add count_if functions URL: https://github.com/apache/spark/pull/24335#issuecomment-493854630 > Another question is tho, are there like sum_if, avg_if too? Sorry for the late reply. I think that the use cases of `count_if` are qu

[GitHub] [spark] wangyum commented on issue #20430: [SPARK-23263][TEST] CTAS should update stat if autoUpdate statistics is enabled

wangyum commented on issue #20430: [SPARK-23263][TEST] CTAS should update stat if autoUpdate statistics is enabled URL: https://github.com/apache/spark/pull/20430#issuecomment-493854914 retest this please This is an automated

[GitHub] [spark] SparkQA commented on issue #24533: [SPARK-27637][Shuffle] For nettyBlockTransferService, if IOException occurred while fetching data, check whether relative executor is alive before

SparkQA commented on issue #24533: [SPARK-27637][Shuffle] For nettyBlockTransferService, if IOException occurred while fetching data, check whether relative executor is alive before retry URL: https://github.com/apache/spark/pull/24533#issuecomment-493855304 **[Test build #105554 has sta

[GitHub] [spark] SparkQA commented on issue #20430: [SPARK-23263][TEST] CTAS should update stat if autoUpdate statistics is enabled

SparkQA commented on issue #20430: [SPARK-23263][TEST] CTAS should update stat if autoUpdate statistics is enabled URL: https://github.com/apache/spark/pull/20430#issuecomment-493855303 **[Test build #105553 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/10

[GitHub] [spark] AmplabJenkins removed a comment on issue #24533: [SPARK-27637][Shuffle] For nettyBlockTransferService, if IOException occurred while fetching data, check whether relative executor is

AmplabJenkins removed a comment on issue #24533: [SPARK-27637][Shuffle] For nettyBlockTransferService, if IOException occurred while fetching data, check whether relative executor is alive before retry URL: https://github.com/apache/spark/pull/24533#issuecomment-493853711 Test FAILed.

  1   2   3   4   5   >