[GitHub] [spark] apeming closed pull request #27220: [SPARK-30519][CORE][2.4.3]use spark.executorEnv.HADOOP_USER_NAME to set executor's hadoop user

2020-01-15 Thread GitBox
apeming closed pull request #27220: [SPARK-30519][CORE][2.4.3]use spark.executorEnv.HADOOP_USER_NAME to set executor's hadoop user URL: https://github.com/apache/spark/pull/27220 This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins commented on issue #27220: [SPARK-30519][CORE][2.4.3]use spark.executorEnv.HADOOP_USER_NAME to set executor's hadoop user

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27220: [SPARK-30519][CORE][2.4.3]use spark.executorEnv.HADOOP_USER_NAME to set executor's hadoop user URL: https://github.com/apache/spark/pull/27220#issuecomment-574675478 Can one of the admins verify this patch? --

[GitHub] [spark] apeming opened a new pull request #27220: [SPARK-30519][CORE][2.4.3]

2020-01-15 Thread GitBox
apeming opened a new pull request #27220: [SPARK-30519][CORE][2.4.3] URL: https://github.com/apache/spark/pull/27220 ### What changes were proposed in this pull request? Let executor can specify hadoop user by using spark.executorEnv.HADOOP_USER_NAME ### Why are the ch

[GitHub] [spark] yaooqinn commented on a change in pull request #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties

2020-01-15 Thread GitBox
yaooqinn commented on a change in pull request #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties URL: https://github.com/apache/spark/pull/27197#discussion_r366882223 ## File path: sql/catalyst/src/main/scala/org/apache/spar

[GitHub] [spark] AmplabJenkins removed a comment on issue #26502: [SPARK-29876][SS] Delete/archive file source completed files in separate thread

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #26502: [SPARK-29876][SS] Delete/archive file source completed files in separate thread URL: https://github.com/apache/spark/pull/26502#issuecomment-574665333 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26502: [SPARK-29876][SS] Delete/archive file source completed files in separate thread

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #26502: [SPARK-29876][SS] Delete/archive file source completed files in separate thread URL: https://github.com/apache/spark/pull/26502#issuecomment-574665322 Merged build finished. Test PASSed. --

[GitHub] [spark] SparkQA removed a comment on issue #26502: [SPARK-29876][SS] Delete/archive file source completed files in separate thread

2020-01-15 Thread GitBox
SparkQA removed a comment on issue #26502: [SPARK-29876][SS] Delete/archive file source completed files in separate thread URL: https://github.com/apache/spark/pull/26502#issuecomment-574573069 **[Test build #116776 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBu

[GitHub] [spark] AmplabJenkins commented on issue #26502: [SPARK-29876][SS] Delete/archive file source completed files in separate thread

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #26502: [SPARK-29876][SS] Delete/archive file source completed files in separate thread URL: https://github.com/apache/spark/pull/26502#issuecomment-574665333 Test PASSed. Refer to this link for build results (access rights to CI server needed): https

[GitHub] [spark] maropu commented on issue #27219: [SPARK-26736][SQL] Partition pruning through nondeterministic expressions in Hive tables

2020-01-15 Thread GitBox
maropu commented on issue #27219: [SPARK-26736][SQL] Partition pruning through nondeterministic expressions in Hive tables URL: https://github.com/apache/spark/pull/27219#issuecomment-574665325 cc: @cloud-fan @Ngone51 This is

[GitHub] [spark] AmplabJenkins commented on issue #26502: [SPARK-29876][SS] Delete/archive file source completed files in separate thread

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #26502: [SPARK-29876][SS] Delete/archive file source completed files in separate thread URL: https://github.com/apache/spark/pull/26502#issuecomment-574665322 Merged build finished. Test PASSed. --

[GitHub] [spark] SparkQA commented on issue #26502: [SPARK-29876][SS] Delete/archive file source completed files in separate thread

2020-01-15 Thread GitBox
SparkQA commented on issue #26502: [SPARK-29876][SS] Delete/archive file source completed files in separate thread URL: https://github.com/apache/spark/pull/26502#issuecomment-574664585 **[Test build #116776 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/1

[GitHub] [spark] AmplabJenkins removed a comment on issue #27219: [SPARK-26736][SQL] Partition pruning through nondeterministic expressions in Hive tables

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27219: [SPARK-26736][SQL] Partition pruning through nondeterministic expressions in Hive tables URL: https://github.com/apache/spark/pull/27219#issuecomment-574664099 Test PASSed. Refer to this link for build results (access rights to CI server n

[GitHub] [spark] AmplabJenkins removed a comment on issue #27219: [SPARK-26736][SQL] Partition pruning through nondeterministic expressions in Hive tables

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27219: [SPARK-26736][SQL] Partition pruning through nondeterministic expressions in Hive tables URL: https://github.com/apache/spark/pull/27219#issuecomment-574664087 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins commented on issue #27219: [SPARK-26736][SQL] Partition pruning through nondeterministic expressions in Hive tables

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27219: [SPARK-26736][SQL] Partition pruning through nondeterministic expressions in Hive tables URL: https://github.com/apache/spark/pull/27219#issuecomment-574664087 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins commented on issue #27219: [SPARK-26736][SQL] Partition pruning through nondeterministic expressions in Hive tables

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27219: [SPARK-26736][SQL] Partition pruning through nondeterministic expressions in Hive tables URL: https://github.com/apache/spark/pull/27219#issuecomment-574664099 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #27219: [SPARK-26736][SQL] Partition pruning through nondeterministic expressions in Hive tables

2020-01-15 Thread GitBox
SparkQA removed a comment on issue #27219: [SPARK-26736][SQL] Partition pruning through nondeterministic expressions in Hive tables URL: https://github.com/apache/spark/pull/27219#issuecomment-574615460 **[Test build #116779 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPull

[GitHub] [spark] SparkQA commented on issue #27219: [SPARK-26736][SQL] Partition pruning through nondeterministic expressions in Hive tables

2020-01-15 Thread GitBox
SparkQA commented on issue #27219: [SPARK-26736][SQL] Partition pruning through nondeterministic expressions in Hive tables URL: https://github.com/apache/spark/pull/27219#issuecomment-574663373 **[Test build #116779 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequest

[GitHub] [spark] cloud-fan commented on a change in pull request #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties

2020-01-15 Thread GitBox
cloud-fan commented on a change in pull request #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties URL: https://github.com/apache/spark/pull/27197#discussion_r366875986 ## File path: sql/catalyst/src/main/scala/org/apache/spa

[GitHub] [spark] cloud-fan commented on a change in pull request #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties

2020-01-15 Thread GitBox
cloud-fan commented on a change in pull request #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties URL: https://github.com/apache/spark/pull/27197#discussion_r366875986 ## File path: sql/catalyst/src/main/scala/org/apache/spa

[GitHub] [spark] cloud-fan commented on a change in pull request #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties

2020-01-15 Thread GitBox
cloud-fan commented on a change in pull request #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties URL: https://github.com/apache/spark/pull/27197#discussion_r366873681 ## File path: sql/catalyst/src/main/scala/org/apache/spa

[GitHub] [spark] cloud-fan commented on a change in pull request #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties

2020-01-15 Thread GitBox
cloud-fan commented on a change in pull request #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties URL: https://github.com/apache/spark/pull/27197#discussion_r366872502 ## File path: sql/catalyst/src/main/scala/org/apache/spa

[GitHub] [spark] cloud-fan commented on a change in pull request #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties

2020-01-15 Thread GitBox
cloud-fan commented on a change in pull request #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties URL: https://github.com/apache/spark/pull/27197#discussion_r366871367 ## File path: sql/catalyst/src/main/scala/org/apache/spa

[GitHub] [spark] yaooqinn commented on a change in pull request #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties

2020-01-15 Thread GitBox
yaooqinn commented on a change in pull request #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties URL: https://github.com/apache/spark/pull/27197#discussion_r366871254 ## File path: sql/catalyst/src/main/scala/org/apache/spar

[GitHub] [spark] cloud-fan commented on a change in pull request #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties

2020-01-15 Thread GitBox
cloud-fan commented on a change in pull request #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties URL: https://github.com/apache/spark/pull/27197#discussion_r366870614 ## File path: sql/catalyst/src/main/scala/org/apache/spa

[GitHub] [spark] cloud-fan commented on a change in pull request #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties

2020-01-15 Thread GitBox
cloud-fan commented on a change in pull request #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties URL: https://github.com/apache/spark/pull/27197#discussion_r366869594 ## File path: sql/catalyst/src/main/scala/org/apache/spa

[GitHub] [spark] AmplabJenkins removed a comment on issue #27187: [SPARK-30497][SQL] migrate DESCRIBE TABLE to the new framework

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27187: [SPARK-30497][SQL] migrate DESCRIBE TABLE to the new framework URL: https://github.com/apache/spark/pull/27187#issuecomment-574654953 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampl

[GitHub] [spark] AmplabJenkins removed a comment on issue #27187: [SPARK-30497][SQL] migrate DESCRIBE TABLE to the new framework

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27187: [SPARK-30497][SQL] migrate DESCRIBE TABLE to the new framework URL: https://github.com/apache/spark/pull/27187#issuecomment-574654948 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #27187: [SPARK-30497][SQL] migrate DESCRIBE TABLE to the new framework

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27187: [SPARK-30497][SQL] migrate DESCRIBE TABLE to the new framework URL: https://github.com/apache/spark/pull/27187#issuecomment-574654948 Merged build finished. Test PASSed. This is an au

[GitHub] [spark] AmplabJenkins commented on issue #27187: [SPARK-30497][SQL] migrate DESCRIBE TABLE to the new framework

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27187: [SPARK-30497][SQL] migrate DESCRIBE TABLE to the new framework URL: https://github.com/apache/spark/pull/27187#issuecomment-574654953 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.be

[GitHub] [spark] SparkQA commented on issue #27187: [SPARK-30497][SQL] migrate DESCRIBE TABLE to the new framework

2020-01-15 Thread GitBox
SparkQA commented on issue #27187: [SPARK-30497][SQL] migrate DESCRIBE TABLE to the new framework URL: https://github.com/apache/spark/pull/27187#issuecomment-574654459 **[Test build #116784 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116784/testReport)

[GitHub] [spark] cloud-fan commented on a change in pull request #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties

2020-01-15 Thread GitBox
cloud-fan commented on a change in pull request #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties URL: https://github.com/apache/spark/pull/27197#discussion_r366867414 ## File path: docs/sql-migration-guide.md ## @@

[GitHub] [spark] cloud-fan commented on issue #27187: [SPARK-30497][SQL] migrate DESCRIBE TABLE to the new framework

2020-01-15 Thread GitBox
cloud-fan commented on issue #27187: [SPARK-30497][SQL] migrate DESCRIBE TABLE to the new framework URL: https://github.com/apache/spark/pull/27187#issuecomment-574653101 retest this please This is an automated message from

[GitHub] [spark] cloud-fan commented on issue #27198: [SPARK-27986][SQL][FOLLOWUP] Respect filter in sql/toString of AggregateExpression

2020-01-15 Thread GitBox
cloud-fan commented on issue #27198: [SPARK-27986][SQL][FOLLOWUP] Respect filter in sql/toString of AggregateExpression URL: https://github.com/apache/spark/pull/27198#issuecomment-574652829 LGTM This is an automated message

[GitHub] [spark] maropu edited a comment on issue #26961: [SPARK-29708][SQL] Correct aggregated values when grouping sets are duplicated

2020-01-15 Thread GitBox
maropu edited a comment on issue #26961: [SPARK-29708][SQL] Correct aggregated values when grouping sets are duplicated URL: https://github.com/apache/spark/pull/26961#issuecomment-574652108 yea, thanks for the check. I don't, either. ---

[GitHub] [spark] maropu commented on issue #26961: [SPARK-29708][SQL] Correct aggregated values when grouping sets are duplicated

2020-01-15 Thread GitBox
maropu commented on issue #26961: [SPARK-29708][SQL] Correct aggregated values when grouping sets are duplicated URL: https://github.com/apache/spark/pull/26961#issuecomment-574652108 yea, thanks for the check. I think so, too. --

[GitHub] [spark] cloud-fan commented on issue #26961: [SPARK-29708][SQL] Correct aggregated values when grouping sets are duplicated

2020-01-15 Thread GitBox
cloud-fan commented on issue #26961: [SPARK-29708][SQL] Correct aggregated values when grouping sets are duplicated URL: https://github.com/apache/spark/pull/26961#issuecomment-574651586 This is a correctness bug, but for a rarely used API. I don't have a strong opinion. -

[GitHub] [spark] maropu commented on issue #26961: [SPARK-29708][SQL] Correct aggregated values when grouping sets are duplicated

2020-01-15 Thread GitBox
maropu commented on issue #26961: [SPARK-29708][SQL] Correct aggregated values when grouping sets are duplicated URL: https://github.com/apache/spark/pull/26961#issuecomment-574651141 @dongjoon-hyun Just a check; we don't need to backport this bugfix to branch-2.4? ---

[GitHub] [spark] maropu commented on issue #26961: [SPARK-29708][SQL] Correct aggregated values when grouping sets are duplicated

2020-01-15 Thread GitBox
maropu commented on issue #26961: [SPARK-29708][SQL] Correct aggregated values when grouping sets are duplicated URL: https://github.com/apache/spark/pull/26961#issuecomment-574650513 Merged to master. This is an automated me

[GitHub] [spark] maropu closed pull request #26961: [SPARK-29708][SQL] Correct aggregated values when grouping sets are duplicated

2020-01-15 Thread GitBox
maropu closed pull request #26961: [SPARK-29708][SQL] Correct aggregated values when grouping sets are duplicated URL: https://github.com/apache/spark/pull/26961 This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins removed a comment on issue #27198: [SPARK-27986][SQL][FOLLOWUP] Respect filter in sql/toString of AggregateExpression

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27198: [SPARK-27986][SQL][FOLLOWUP] Respect filter in sql/toString of AggregateExpression URL: https://github.com/apache/spark/pull/27198#issuecomment-574646946 Test PASSed. Refer to this link for build results (access rights to CI server needed)

[GitHub] [spark] AmplabJenkins commented on issue #27198: [SPARK-27986][SQL][FOLLOWUP] Respect filter in sql/toString of AggregateExpression

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27198: [SPARK-27986][SQL][FOLLOWUP] Respect filter in sql/toString of AggregateExpression URL: https://github.com/apache/spark/pull/27198#issuecomment-574646946 Test PASSed. Refer to this link for build results (access rights to CI server needed): h

[GitHub] [spark] AmplabJenkins commented on issue #27198: [SPARK-27986][SQL][FOLLOWUP] Respect filter in sql/toString of AggregateExpression

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27198: [SPARK-27986][SQL][FOLLOWUP] Respect filter in sql/toString of AggregateExpression URL: https://github.com/apache/spark/pull/27198#issuecomment-574646940 Merged build finished. Test PASSed. ---

[GitHub] [spark] maropu commented on issue #27212: [SPARK-30515][SQL] Refactor SimplifyBinaryComparison to reduce the time complexity

2020-01-15 Thread GitBox
maropu commented on issue #27212: [SPARK-30515][SQL] Refactor SimplifyBinaryComparison to reduce the time complexity URL: https://github.com/apache/spark/pull/27212#issuecomment-574647022 Thanks! Merged to master. This is an

[GitHub] [spark] maropu closed pull request #27212: [SPARK-30515][SQL] Refactor SimplifyBinaryComparison to reduce the time complexity

2020-01-15 Thread GitBox
maropu closed pull request #27212: [SPARK-30515][SQL] Refactor SimplifyBinaryComparison to reduce the time complexity URL: https://github.com/apache/spark/pull/27212 This is an automated message from the Apache Git Service.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27198: [SPARK-27986][SQL][FOLLOWUP] Respect filter in sql/toString of AggregateExpression

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27198: [SPARK-27986][SQL][FOLLOWUP] Respect filter in sql/toString of AggregateExpression URL: https://github.com/apache/spark/pull/27198#issuecomment-574646940 Merged build finished. Test PASSed. ---

[GitHub] [spark] SparkQA commented on issue #27198: [SPARK-27986][SQL][FOLLOWUP] Respect filter in sql/toString of AggregateExpression

2020-01-15 Thread GitBox
SparkQA commented on issue #27198: [SPARK-27986][SQL][FOLLOWUP] Respect filter in sql/toString of AggregateExpression URL: https://github.com/apache/spark/pull/27198#issuecomment-574646365 **[Test build #116783 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder

[GitHub] [spark] AmplabJenkins removed a comment on issue #27191: [SPARK-30495][SS] Consider spark.security.credentials.kafka.enabled and cluster configuration when checking latest delegation token

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27191: [SPARK-30495][SS] Consider spark.security.credentials.kafka.enabled and cluster configuration when checking latest delegation token URL: https://github.com/apache/spark/pull/27191#issuecomment-574645995 Test PASSed. Refer to this link for

[GitHub] [spark] AmplabJenkins removed a comment on issue #27191: [SPARK-30495][SS] Consider spark.security.credentials.kafka.enabled and cluster configuration when checking latest delegation token

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27191: [SPARK-30495][SS] Consider spark.security.credentials.kafka.enabled and cluster configuration when checking latest delegation token URL: https://github.com/apache/spark/pull/27191#issuecomment-574645986 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins commented on issue #27191: [SPARK-30495][SS] Consider spark.security.credentials.kafka.enabled and cluster configuration when checking latest delegation token

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27191: [SPARK-30495][SS] Consider spark.security.credentials.kafka.enabled and cluster configuration when checking latest delegation token URL: https://github.com/apache/spark/pull/27191#issuecomment-574645986 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins commented on issue #27191: [SPARK-30495][SS] Consider spark.security.credentials.kafka.enabled and cluster configuration when checking latest delegation token

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27191: [SPARK-30495][SS] Consider spark.security.credentials.kafka.enabled and cluster configuration when checking latest delegation token URL: https://github.com/apache/spark/pull/27191#issuecomment-574645995 Test PASSed. Refer to this link for build r

[GitHub] [spark] AmplabJenkins removed a comment on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-574645469 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-574645481 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampla

[GitHub] [spark] SparkQA commented on issue #27191: [SPARK-30495][SS] Consider spark.security.credentials.kafka.enabled and cluster configuration when checking latest delegation token

2020-01-15 Thread GitBox
SparkQA commented on issue #27191: [SPARK-30495][SS] Consider spark.security.credentials.kafka.enabled and cluster configuration when checking latest delegation token URL: https://github.com/apache/spark/pull/27191#issuecomment-574645229 **[Test build #116777 has finished](https://amplab.

[GitHub] [spark] AmplabJenkins commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-574645469 Merged build finished. Test PASSed. This is an au

[GitHub] [spark] AmplabJenkins commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-574645481 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.ber

[GitHub] [spark] SparkQA removed a comment on issue #27191: [SPARK-30495][SS] Consider spark.security.credentials.kafka.enabled and cluster configuration when checking latest delegation token

2020-01-15 Thread GitBox
SparkQA removed a comment on issue #27191: [SPARK-30495][SS] Consider spark.security.credentials.kafka.enabled and cluster configuration when checking latest delegation token URL: https://github.com/apache/spark/pull/27191#issuecomment-574586527 **[Test build #116777 has started](https://

[GitHub] [spark] SparkQA commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away

2020-01-15 Thread GitBox
SparkQA commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-574644762 **[Test build #116772 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116772/testReport

[GitHub] [spark] SparkQA removed a comment on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away

2020-01-15 Thread GitBox
SparkQA removed a comment on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-574549813 **[Test build #116772 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116772/tes

[GitHub] [spark] AmplabJenkins removed a comment on issue #27210: [SPARK-30312][SQL][FOLLOWUP] Preserve path permission and acl when truncate table

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27210: [SPARK-30312][SQL][FOLLOWUP] Preserve path permission and acl when truncate table URL: https://github.com/apache/spark/pull/27210#issuecomment-574643574 Test PASSed. Refer to this link for build results (access rights to CI server needed)

[GitHub] [spark] AmplabJenkins commented on issue #27210: [SPARK-30312][SQL][FOLLOWUP] Preserve path permission and acl when truncate table

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27210: [SPARK-30312][SQL][FOLLOWUP] Preserve path permission and acl when truncate table URL: https://github.com/apache/spark/pull/27210#issuecomment-574643574 Test PASSed. Refer to this link for build results (access rights to CI server needed): ht

[GitHub] [spark] AmplabJenkins removed a comment on issue #27210: [SPARK-30312][SQL][FOLLOWUP] Preserve path permission and acl when truncate table

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27210: [SPARK-30312][SQL][FOLLOWUP] Preserve path permission and acl when truncate table URL: https://github.com/apache/spark/pull/27210#issuecomment-574643561 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #27210: [SPARK-30312][SQL][FOLLOWUP] Preserve path permission and acl when truncate table

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27210: [SPARK-30312][SQL][FOLLOWUP] Preserve path permission and acl when truncate table URL: https://github.com/apache/spark/pull/27210#issuecomment-574643561 Merged build finished. Test PASSed. ---

[GitHub] [spark] SparkQA removed a comment on issue #27210: [SPARK-30312][SQL][FOLLOWUP] Preserve path permission and acl when truncate table

2020-01-15 Thread GitBox
SparkQA removed a comment on issue #27210: [SPARK-30312][SQL][FOLLOWUP] Preserve path permission and acl when truncate table URL: https://github.com/apache/spark/pull/27210#issuecomment-574555148 **[Test build #116773 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullReques

[GitHub] [spark] AmplabJenkins commented on issue #27212: [SPARK-30515][SQL] Refactor SimplifyBinaryComparison to reduce the time complexity

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27212: [SPARK-30515][SQL] Refactor SimplifyBinaryComparison to reduce the time complexity URL: https://github.com/apache/spark/pull/27212#issuecomment-574642912 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #27212: [SPARK-30515][SQL] Refactor SimplifyBinaryComparison to reduce the time complexity

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27212: [SPARK-30515][SQL] Refactor SimplifyBinaryComparison to reduce the time complexity URL: https://github.com/apache/spark/pull/27212#issuecomment-574642922 Test PASSed. Refer to this link for build results (access rights to CI server needed)

[GitHub] [spark] AmplabJenkins commented on issue #27212: [SPARK-30515][SQL] Refactor SimplifyBinaryComparison to reduce the time complexity

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27212: [SPARK-30515][SQL] Refactor SimplifyBinaryComparison to reduce the time complexity URL: https://github.com/apache/spark/pull/27212#issuecomment-574642922 Test PASSed. Refer to this link for build results (access rights to CI server needed): ht

[GitHub] [spark] AmplabJenkins removed a comment on issue #27212: [SPARK-30515][SQL] Refactor SimplifyBinaryComparison to reduce the time complexity

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27212: [SPARK-30515][SQL] Refactor SimplifyBinaryComparison to reduce the time complexity URL: https://github.com/apache/spark/pull/27212#issuecomment-574642912 Merged build finished. Test PASSed. ---

[GitHub] [spark] SparkQA commented on issue #27210: [SPARK-30312][SQL][FOLLOWUP] Preserve path permission and acl when truncate table

2020-01-15 Thread GitBox
SparkQA commented on issue #27210: [SPARK-30312][SQL][FOLLOWUP] Preserve path permission and acl when truncate table URL: https://github.com/apache/spark/pull/27210#issuecomment-574642962 **[Test build #116773 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilde

[GitHub] [spark] SparkQA removed a comment on issue #27212: [SPARK-30515][SQL] Refactor SimplifyBinaryComparison to reduce the time complexity

2020-01-15 Thread GitBox
SparkQA removed a comment on issue #27212: [SPARK-30515][SQL] Refactor SimplifyBinaryComparison to reduce the time complexity URL: https://github.com/apache/spark/pull/27212#issuecomment-574547368 **[Test build #116766 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullReques

[GitHub] [spark] SparkQA commented on issue #27212: [SPARK-30515][SQL] Refactor SimplifyBinaryComparison to reduce the time complexity

2020-01-15 Thread GitBox
SparkQA commented on issue #27212: [SPARK-30515][SQL] Refactor SimplifyBinaryComparison to reduce the time complexity URL: https://github.com/apache/spark/pull/27212#issuecomment-574642193 **[Test build #116766 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilde

[GitHub] [spark] AmplabJenkins removed a comment on issue #26961: [SPARK-29708][SQL] Correct aggregated values when grouping sets are duplicated

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #26961: [SPARK-29708][SQL] Correct aggregated values when grouping sets are duplicated URL: https://github.com/apache/spark/pull/26961#issuecomment-574642076 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #26961: [SPARK-29708][SQL] Correct aggregated values when grouping sets are duplicated

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #26961: [SPARK-29708][SQL] Correct aggregated values when grouping sets are duplicated URL: https://github.com/apache/spark/pull/26961#issuecomment-574642082 Test PASSed. Refer to this link for build results (access rights to CI server needed): https:

[GitHub] [spark] AmplabJenkins removed a comment on issue #26961: [SPARK-29708][SQL] Correct aggregated values when grouping sets are duplicated

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #26961: [SPARK-29708][SQL] Correct aggregated values when grouping sets are duplicated URL: https://github.com/apache/spark/pull/26961#issuecomment-574642082 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26961: [SPARK-29708][SQL] Correct aggregated values when grouping sets are duplicated

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #26961: [SPARK-29708][SQL] Correct aggregated values when grouping sets are duplicated URL: https://github.com/apache/spark/pull/26961#issuecomment-574642076 Merged build finished. Test PASSed. ---

[GitHub] [spark] SparkQA removed a comment on issue #26961: [SPARK-29708][SQL] Correct aggregated values when grouping sets are duplicated

2020-01-15 Thread GitBox
SparkQA removed a comment on issue #26961: [SPARK-29708][SQL] Correct aggregated values when grouping sets are duplicated URL: https://github.com/apache/spark/pull/26961#issuecomment-574547409 **[Test build #116768 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBui

[GitHub] [spark] SparkQA commented on issue #26961: [SPARK-29708][SQL] Correct aggregated values when grouping sets are duplicated

2020-01-15 Thread GitBox
SparkQA commented on issue #26961: [SPARK-29708][SQL] Correct aggregated values when grouping sets are duplicated URL: https://github.com/apache/spark/pull/26961#issuecomment-574641512 **[Test build #116768 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/11

[GitHub] [spark] AmplabJenkins removed a comment on issue #27218: [WIP][SPARK-30499][SQL] Remove SQL config spark.sql.execution.pandas.respectSessionTimeZone

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27218: [WIP][SPARK-30499][SQL] Remove SQL config spark.sql.execution.pandas.respectSessionTimeZone URL: https://github.com/apache/spark/pull/27218#issuecomment-574641221 Test PASSed. Refer to this link for build results (access rights to CI serve

[GitHub] [spark] AmplabJenkins removed a comment on issue #27218: [WIP][SPARK-30499][SQL] Remove SQL config spark.sql.execution.pandas.respectSessionTimeZone

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27218: [WIP][SPARK-30499][SQL] Remove SQL config spark.sql.execution.pandas.respectSessionTimeZone URL: https://github.com/apache/spark/pull/27218#issuecomment-574641214 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins commented on issue #27218: [WIP][SPARK-30499][SQL] Remove SQL config spark.sql.execution.pandas.respectSessionTimeZone

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27218: [WIP][SPARK-30499][SQL] Remove SQL config spark.sql.execution.pandas.respectSessionTimeZone URL: https://github.com/apache/spark/pull/27218#issuecomment-574641214 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins commented on issue #27218: [WIP][SPARK-30499][SQL] Remove SQL config spark.sql.execution.pandas.respectSessionTimeZone

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27218: [WIP][SPARK-30499][SQL] Remove SQL config spark.sql.execution.pandas.respectSessionTimeZone URL: https://github.com/apache/spark/pull/27218#issuecomment-574641221 Test PASSed. Refer to this link for build results (access rights to CI server needed

[GitHub] [spark] SparkQA commented on issue #27218: [WIP][SPARK-30499][SQL] Remove SQL config spark.sql.execution.pandas.respectSessionTimeZone

2020-01-15 Thread GitBox
SparkQA commented on issue #27218: [WIP][SPARK-30499][SQL] Remove SQL config spark.sql.execution.pandas.respectSessionTimeZone URL: https://github.com/apache/spark/pull/27218#issuecomment-574640827 **[Test build #116782 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullReque

[GitHub] [spark] AmplabJenkins removed a comment on issue #26973: [SPARK-30323][SQL] Support filters pushdown in CSV datasource

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #26973: [SPARK-30323][SQL] Support filters pushdown in CSV datasource URL: https://github.com/apache/spark/pull/26973#issuecomment-574638864 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.

[GitHub] [spark] AmplabJenkins commented on issue #26973: [SPARK-30323][SQL] Support filters pushdown in CSV datasource

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #26973: [SPARK-30323][SQL] Support filters pushdown in CSV datasource URL: https://github.com/apache/spark/pull/26973#issuecomment-574638864 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berke

[GitHub] [spark] AmplabJenkins commented on issue #26973: [SPARK-30323][SQL] Support filters pushdown in CSV datasource

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #26973: [SPARK-30323][SQL] Support filters pushdown in CSV datasource URL: https://github.com/apache/spark/pull/26973#issuecomment-574638853 Merged build finished. Test PASSed. This is an auto

[GitHub] [spark] AmplabJenkins removed a comment on issue #26973: [SPARK-30323][SQL] Support filters pushdown in CSV datasource

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #26973: [SPARK-30323][SQL] Support filters pushdown in CSV datasource URL: https://github.com/apache/spark/pull/26973#issuecomment-574638853 Merged build finished. Test PASSed. This is

[GitHub] [spark] SparkQA removed a comment on issue #26973: [SPARK-30323][SQL] Support filters pushdown in CSV datasource

2020-01-15 Thread GitBox
SparkQA removed a comment on issue #26973: [SPARK-30323][SQL] Support filters pushdown in CSV datasource URL: https://github.com/apache/spark/pull/26973#issuecomment-574544679 **[Test build #116764 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116764/testR

[GitHub] [spark] SparkQA commented on issue #26973: [SPARK-30323][SQL] Support filters pushdown in CSV datasource

2020-01-15 Thread GitBox
SparkQA commented on issue #26973: [SPARK-30323][SQL] Support filters pushdown in CSV datasource URL: https://github.com/apache/spark/pull/26973#issuecomment-574638211 **[Test build #116764 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116764/testReport)*

[GitHub] [spark] AmplabJenkins commented on issue #26961: [SPARK-29708][SQL] Correct aggregated values when grouping sets are duplicated

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #26961: [SPARK-29708][SQL] Correct aggregated values when grouping sets are duplicated URL: https://github.com/apache/spark/pull/26961#issuecomment-574637201 Test PASSed. Refer to this link for build results (access rights to CI server needed): https:

[GitHub] [spark] AmplabJenkins commented on issue #26961: [SPARK-29708][SQL] Correct aggregated values when grouping sets are duplicated

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #26961: [SPARK-29708][SQL] Correct aggregated values when grouping sets are duplicated URL: https://github.com/apache/spark/pull/26961#issuecomment-574637195 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #26961: [SPARK-29708][SQL] Correct aggregated values when grouping sets are duplicated

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #26961: [SPARK-29708][SQL] Correct aggregated values when grouping sets are duplicated URL: https://github.com/apache/spark/pull/26961#issuecomment-574637201 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26961: [SPARK-29708][SQL] Correct aggregated values when grouping sets are duplicated

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #26961: [SPARK-29708][SQL] Correct aggregated values when grouping sets are duplicated URL: https://github.com/apache/spark/pull/26961#issuecomment-574637195 Merged build finished. Test PASSed. ---

[GitHub] [spark] SparkQA commented on issue #26961: [SPARK-29708][SQL] Correct aggregated values when grouping sets are duplicated

2020-01-15 Thread GitBox
SparkQA commented on issue #26961: [SPARK-29708][SQL] Correct aggregated values when grouping sets are duplicated URL: https://github.com/apache/spark/pull/26961#issuecomment-574636637 **[Test build #116765 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/11

[GitHub] [spark] SparkQA removed a comment on issue #26961: [SPARK-29708][SQL] Correct aggregated values when grouping sets are duplicated

2020-01-15 Thread GitBox
SparkQA removed a comment on issue #26961: [SPARK-29708][SQL] Correct aggregated values when grouping sets are duplicated URL: https://github.com/apache/spark/pull/26961#issuecomment-574544692 **[Test build #116765 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBui

[GitHub] [spark] AmplabJenkins removed a comment on issue #26918: [SPARK-30279][SQL] Support 32 or more grouping attributes for GROUPING_ID

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #26918: [SPARK-30279][SQL] Support 32 or more grouping attributes for GROUPING_ID URL: https://github.com/apache/spark/pull/26918#issuecomment-574635020 Test PASSed. Refer to this link for build results (access rights to CI server needed): ht

[GitHub] [spark] AmplabJenkins removed a comment on issue #26918: [SPARK-30279][SQL] Support 32 or more grouping attributes for GROUPING_ID

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #26918: [SPARK-30279][SQL] Support 32 or more grouping attributes for GROUPING_ID URL: https://github.com/apache/spark/pull/26918#issuecomment-574635013 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #26918: [SPARK-30279][SQL] Support 32 or more grouping attributes for GROUPING_ID

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #26918: [SPARK-30279][SQL] Support 32 or more grouping attributes for GROUPING_ID URL: https://github.com/apache/spark/pull/26918#issuecomment-574635020 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://am

[GitHub] [spark] AmplabJenkins commented on issue #26918: [SPARK-30279][SQL] Support 32 or more grouping attributes for GROUPING_ID

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #26918: [SPARK-30279][SQL] Support 32 or more grouping attributes for GROUPING_ID URL: https://github.com/apache/spark/pull/26918#issuecomment-574635013 Merged build finished. Test PASSed. Th

[GitHub] [spark] SparkQA removed a comment on issue #26918: [SPARK-30279][SQL] Support 32 or more grouping attributes for GROUPING_ID

2020-01-15 Thread GitBox
SparkQA removed a comment on issue #26918: [SPARK-30279][SQL] Support 32 or more grouping attributes for GROUPING_ID URL: https://github.com/apache/spark/pull/26918#issuecomment-574547393 **[Test build #116769 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder

[GitHub] [spark] SparkQA commented on issue #26918: [SPARK-30279][SQL] Support 32 or more grouping attributes for GROUPING_ID

2020-01-15 Thread GitBox
SparkQA commented on issue #26918: [SPARK-30279][SQL] Support 32 or more grouping attributes for GROUPING_ID URL: https://github.com/apache/spark/pull/26918#issuecomment-574634270 **[Test build #116769 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116769

[GitHub] [spark] AmplabJenkins removed a comment on issue #27209: [SPARK-29450][SS][2.4] Measure the number of output rows for streaming aggregation with append mode

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27209: [SPARK-29450][SS][2.4] Measure the number of output rows for streaming aggregation with append mode URL: https://github.com/apache/spark/pull/27209#issuecomment-574634061 Test PASSed. Refer to this link for build results (access rights to

<    3   4   5   6   7   8   9   10   11   >