[GitHub] [spark] AmplabJenkins commented on issue #24715: [SPARK-25474][SQL][DOCS] Update the docs for spark.sql.statistics.fallBackToHdfs

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #24715: [SPARK-25474][SQL][DOCS] Update the docs for spark.sql.statistics.fallBackToHdfs URL: https://github.com/apache/spark/pull/24715#issuecomment-525596356 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24715: [SPARK-25474][SQL][DOCS] Update the docs for spark.sql.statistics.fallBackToHdfs

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #24715: [SPARK-25474][SQL][DOCS] Update the docs for spark.sql.statistics.fallBackToHdfs URL: https://github.com/apache/spark/pull/24715#issuecomment-525596352 Merged build finished. Test PASSed.

[GitHub] [spark] MGHawes commented on issue #25575: [SPARK-28818][SQL] Respect source column nullability in the arrays created by `freqItems()`

2019-08-27 Thread GitBox
MGHawes commented on issue #25575: [SPARK-28818][SQL] Respect source column nullability in the arrays created by `freqItems()` URL: https://github.com/apache/spark/pull/25575#issuecomment-525592248 Thanks, wasn't sure of the process

[GitHub] [spark] maropu commented on issue #25575: [SPARK-28818][SQL] Respect source column nullability in the arrays created by `freqItems()`

2019-08-27 Thread GitBox
maropu commented on issue #25575: [SPARK-28818][SQL] Respect source column nullability in the arrays created by `freqItems()` URL: https://github.com/apache/spark/pull/25575#issuecomment-525591657 You don't need to do so and the commiltters will do later.

[GitHub] [spark] MGHawes commented on issue #25575: [SPARK-28818][SQL] Respect source column nullability in the arrays created by `freqItems()`

2019-08-27 Thread GitBox
MGHawes commented on issue #25575: [SPARK-28818][SQL] Respect source column nullability in the arrays created by `freqItems()` URL: https://github.com/apache/spark/pull/25575#issuecomment-525590808 Thanks for the reviews @maropu, @srowen are we good to merge this? I obv. don't have write

[GitHub] [spark] AmplabJenkins removed a comment on issue #25512: [SPARK-28782][SQL] Generator support in aggregate expressions

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #25512: [SPARK-28782][SQL] Generator support in aggregate expressions URL: https://github.com/apache/spark/pull/25512#issuecomment-525589500 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25512: [SPARK-28782][SQL] Generator support in aggregate expressions

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #25512: [SPARK-28782][SQL] Generator support in aggregate expressions URL: https://github.com/apache/spark/pull/25512#issuecomment-525589495 Merged build finished. Test FAILed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #25512: [SPARK-28782][SQL] Generator support in aggregate expressions

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #25512: [SPARK-28782][SQL] Generator support in aggregate expressions URL: https://github.com/apache/spark/pull/25512#issuecomment-525589495 Merged build finished. Test FAILed. This

[GitHub] [spark] AmplabJenkins commented on issue #25512: [SPARK-28782][SQL] Generator support in aggregate expressions

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #25512: [SPARK-28782][SQL] Generator support in aggregate expressions URL: https://github.com/apache/spark/pull/25512#issuecomment-525589500 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #25512: [SPARK-28782][SQL] Generator support in aggregate expressions

2019-08-27 Thread GitBox
SparkQA commented on issue #25512: [SPARK-28782][SQL] Generator support in aggregate expressions URL: https://github.com/apache/spark/pull/25512#issuecomment-525589309 **[Test build #109842 has

[GitHub] [spark] SparkQA removed a comment on issue #25512: [SPARK-28782][SQL] Generator support in aggregate expressions

2019-08-27 Thread GitBox
SparkQA removed a comment on issue #25512: [SPARK-28782][SQL] Generator support in aggregate expressions URL: https://github.com/apache/spark/pull/25512#issuecomment-525560148 **[Test build #109842 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25604: [SPARK-28890][SQL] Upgrade Hive Metastore Client to the 3.1.2 for Hive 3.1

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #25604: [SPARK-28890][SQL] Upgrade Hive Metastore Client to the 3.1.2 for Hive 3.1 URL: https://github.com/apache/spark/pull/25604#issuecomment-525588445 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25604: [SPARK-28890][SQL] Upgrade Hive Metastore Client to the 3.1.2 for Hive 3.1

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #25604: [SPARK-28890][SQL] Upgrade Hive Metastore Client to the 3.1.2 for Hive 3.1 URL: https://github.com/apache/spark/pull/25604#issuecomment-525588451 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25604: [SPARK-28890][SQL] Upgrade Hive Metastore Client to the 3.1.2 for Hive 3.1

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #25604: [SPARK-28890][SQL] Upgrade Hive Metastore Client to the 3.1.2 for Hive 3.1 URL: https://github.com/apache/spark/pull/25604#issuecomment-525588451 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25604: [SPARK-28890][SQL] Upgrade Hive Metastore Client to the 3.1.2 for Hive 3.1

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #25604: [SPARK-28890][SQL] Upgrade Hive Metastore Client to the 3.1.2 for Hive 3.1 URL: https://github.com/apache/spark/pull/25604#issuecomment-525588445 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #25604: [SPARK-28890][SQL] Upgrade Hive Metastore Client to the 3.1.2 for Hive 3.1

2019-08-27 Thread GitBox
SparkQA removed a comment on issue #25604: [SPARK-28890][SQL] Upgrade Hive Metastore Client to the 3.1.2 for Hive 3.1 URL: https://github.com/apache/spark/pull/25604#issuecomment-525568939 **[Test build #109843 has

[GitHub] [spark] SparkQA commented on issue #25604: [SPARK-28890][SQL] Upgrade Hive Metastore Client to the 3.1.2 for Hive 3.1

2019-08-27 Thread GitBox
SparkQA commented on issue #25604: [SPARK-28890][SQL] Upgrade Hive Metastore Client to the 3.1.2 for Hive 3.1 URL: https://github.com/apache/spark/pull/25604#issuecomment-525588219 **[Test build #109843 has

[GitHub] [spark] maropu commented on a change in pull request #20965: [SPARK-21870][SQL] Split aggregation code into small functions

2019-08-27 Thread GitBox
maropu commented on a change in pull request #20965: [SPARK-21870][SQL] Split aggregation code into small functions URL: https://github.com/apache/spark/pull/20965#discussion_r318393079 ## File path:

[GitHub] [spark] HyukjinKwon commented on a change in pull request #25600: [SPARK-11150][SQL] Dynamic Partition Pruning

2019-08-27 Thread GitBox
HyukjinKwon commented on a change in pull request #25600: [SPARK-11150][SQL] Dynamic Partition Pruning URL: https://github.com/apache/spark/pull/25600#discussion_r318392852 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala

[GitHub] [spark] AmplabJenkins commented on issue #20965: [SPARK-21870][SQL] Split aggregation code into small functions

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #20965: [SPARK-21870][SQL] Split aggregation code into small functions URL: https://github.com/apache/spark/pull/20965#issuecomment-525583973 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #20965: [SPARK-21870][SQL] Split aggregation code into small functions

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #20965: [SPARK-21870][SQL] Split aggregation code into small functions URL: https://github.com/apache/spark/pull/20965#issuecomment-525583973 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #20965: [SPARK-21870][SQL] Split aggregation code into small functions

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #20965: [SPARK-21870][SQL] Split aggregation code into small functions URL: https://github.com/apache/spark/pull/20965#issuecomment-525583968 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #20965: [SPARK-21870][SQL] Split aggregation code into small functions

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #20965: [SPARK-21870][SQL] Split aggregation code into small functions URL: https://github.com/apache/spark/pull/20965#issuecomment-525583968 Merged build finished. Test PASSed. This is an

[GitHub] [spark] SparkQA commented on issue #20965: [WIP][SPARK-21870][SQL] Split aggregation code into small functions

2019-08-27 Thread GitBox
SparkQA commented on issue #20965: [WIP][SPARK-21870][SQL] Split aggregation code into small functions URL: https://github.com/apache/spark/pull/20965#issuecomment-525582857 **[Test build #109849 has

[GitHub] [spark] SparkQA commented on issue #25605: [SPARK-28730][SPARK-28495][SQL][FOLLOW-UP] Revise the doc of option spark.sql.storeAssignmentPolicy

2019-08-27 Thread GitBox
SparkQA commented on issue #25605: [SPARK-28730][SPARK-28495][SQL][FOLLOW-UP] Revise the doc of option spark.sql.storeAssignmentPolicy URL: https://github.com/apache/spark/pull/25605#issuecomment-525582843 **[Test build #109848 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25605: [SPARK-28730][SPARK-28495][SQL][FOLLOW-UP] Revise the doc of option spark.sql.storeAssignmentPolicy

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #25605: [SPARK-28730][SPARK-28495][SQL][FOLLOW-UP] Revise the doc of option spark.sql.storeAssignmentPolicy URL: https://github.com/apache/spark/pull/25605#issuecomment-525582472 Test PASSed. Refer to this link for build results (access rights

[GitHub] [spark] AmplabJenkins removed a comment on issue #25605: [SPARK-28730][SPARK-28495][SQL][FOLLOW-UP] Revise the doc of option spark.sql.storeAssignmentPolicy

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #25605: [SPARK-28730][SPARK-28495][SQL][FOLLOW-UP] Revise the doc of option spark.sql.storeAssignmentPolicy URL: https://github.com/apache/spark/pull/25605#issuecomment-525582464 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25605: [SPARK-28730][SPARK-28495][SQL][FOLLOW-UP] Revise the doc of option spark.sql.storeAssignmentPolicy

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #25605: [SPARK-28730][SPARK-28495][SQL][FOLLOW-UP] Revise the doc of option spark.sql.storeAssignmentPolicy URL: https://github.com/apache/spark/pull/25605#issuecomment-525582464 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25605: [SPARK-28730][SPARK-28495][SQL][FOLLOW-UP] Revise the doc of option spark.sql.storeAssignmentPolicy

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #25605: [SPARK-28730][SPARK-28495][SQL][FOLLOW-UP] Revise the doc of option spark.sql.storeAssignmentPolicy URL: https://github.com/apache/spark/pull/25605#issuecomment-525582472 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #20965: [WIP][SPARK-21870][SQL] Split aggregation code into small functions

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #20965: [WIP][SPARK-21870][SQL] Split aggregation code into small functions URL: https://github.com/apache/spark/pull/20965#issuecomment-525582073 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #20965: [WIP][SPARK-21870][SQL] Split aggregation code into small functions

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #20965: [WIP][SPARK-21870][SQL] Split aggregation code into small functions URL: https://github.com/apache/spark/pull/20965#issuecomment-525582078 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #20965: [WIP][SPARK-21870][SQL] Split aggregation code into small functions

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #20965: [WIP][SPARK-21870][SQL] Split aggregation code into small functions URL: https://github.com/apache/spark/pull/20965#issuecomment-525582078 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #20965: [WIP][SPARK-21870][SQL] Split aggregation code into small functions

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #20965: [WIP][SPARK-21870][SQL] Split aggregation code into small functions URL: https://github.com/apache/spark/pull/20965#issuecomment-525582073 Merged build finished. Test PASSed. This is

[GitHub] [spark] SparkQA removed a comment on issue #20965: [WIP][SPARK-21870][SQL] Split aggregation code into small functions

2019-08-27 Thread GitBox
SparkQA removed a comment on issue #20965: [WIP][SPARK-21870][SQL] Split aggregation code into small functions URL: https://github.com/apache/spark/pull/20965#issuecomment-525541633 **[Test build #109839 has

[GitHub] [spark] SparkQA commented on issue #20965: [WIP][SPARK-21870][SQL] Split aggregation code into small functions

2019-08-27 Thread GitBox
SparkQA commented on issue #20965: [WIP][SPARK-21870][SQL] Split aggregation code into small functions URL: https://github.com/apache/spark/pull/20965#issuecomment-525581630 **[Test build #109839 has

[GitHub] [spark] SparkQA commented on issue #22138: [SPARK-25151][SS] Apply Apache Commons Pool to KafkaDataConsumer

2019-08-27 Thread GitBox
SparkQA commented on issue #22138: [SPARK-25151][SS] Apply Apache Commons Pool to KafkaDataConsumer URL: https://github.com/apache/spark/pull/22138#issuecomment-525581381 **[Test build #109847 has

[GitHub] [spark] SparkQA commented on issue #25600: [SPARK-11150][SQL] Dynamic Partition Pruning

2019-08-27 Thread GitBox
SparkQA commented on issue #25600: [SPARK-11150][SQL] Dynamic Partition Pruning URL: https://github.com/apache/spark/pull/25600#issuecomment-525581360 **[Test build #109846 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109846/testReport)** for PR 25600 at

[GitHub] [spark] AmplabJenkins removed a comment on issue #25600: [SPARK-11150][SQL] Dynamic Partition Pruning

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #25600: [SPARK-11150][SQL] Dynamic Partition Pruning URL: https://github.com/apache/spark/pull/25600#issuecomment-525581041 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25600: [SPARK-11150][SQL] Dynamic Partition Pruning

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #25600: [SPARK-11150][SQL] Dynamic Partition Pruning URL: https://github.com/apache/spark/pull/25600#issuecomment-525581037 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #25600: [SPARK-11150][SQL] Dynamic Partition Pruning

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #25600: [SPARK-11150][SQL] Dynamic Partition Pruning URL: https://github.com/apache/spark/pull/25600#issuecomment-525581041 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25600: [SPARK-11150][SQL] Dynamic Partition Pruning

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #25600: [SPARK-11150][SQL] Dynamic Partition Pruning URL: https://github.com/apache/spark/pull/25600#issuecomment-525581037 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] cloud-fan commented on a change in pull request #25458: [SPARK-27931][SQL] Accept "true", "yes", "1", "false", "no", "0", and unique prefixes as input and trim input for the boolean d

2019-08-27 Thread GitBox
cloud-fan commented on a change in pull request #25458: [SPARK-27931][SQL] Accept "true", "yes", "1", "false", "no", "0", and unique prefixes as input and trim input for the boolean data type. URL: https://github.com/apache/spark/pull/25458#discussion_r318389066 ## File path:

[GitHub] [spark] cloud-fan commented on issue #25601: [SPARK-28856][SQL] Implement SHOW DATABASES for Data Source V2 Tables

2019-08-27 Thread GitBox
cloud-fan commented on issue #25601: [SPARK-28856][SQL] Implement SHOW DATABASES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25601#issuecomment-525580222 shall we call it `SHOW NAMESPACES`? This is an

[GitHub] [spark] cloud-fan commented on a change in pull request #25605: [SPARK-28730][SPARK-28495][SQL][FOLLOW-UP] Revise the doc of option spark.sql.storeAssignmentPolicy

2019-08-27 Thread GitBox
cloud-fan commented on a change in pull request #25605: [SPARK-28730][SPARK-28495][SQL][FOLLOW-UP] Revise the doc of option spark.sql.storeAssignmentPolicy URL: https://github.com/apache/spark/pull/25605#discussion_r318388587 ## File path:

[GitHub] [spark] HeartSaVioR edited a comment on issue #25577: [WIP][CORE][SPARK-28867] InMemoryStore checkpoint to speed up replay log file in HistoryServer

2019-08-27 Thread GitBox
HeartSaVioR edited a comment on issue #25577: [WIP][CORE][SPARK-28867] InMemoryStore checkpoint to speed up replay log file in HistoryServer URL: https://github.com/apache/spark/pull/25577#issuecomment-525578717 Thanks for pointing out about "recover live entities". I've commented in your

[GitHub] [spark] HeartSaVioR edited a comment on issue #25577: [WIP][CORE][SPARK-28867] InMemoryStore checkpoint to speed up replay log file in HistoryServer

2019-08-27 Thread GitBox
HeartSaVioR edited a comment on issue #25577: [WIP][CORE][SPARK-28867] InMemoryStore checkpoint to speed up replay log file in HistoryServer URL: https://github.com/apache/spark/pull/25577#issuecomment-525578717 Thanks for pointing out about "recover live entities". I've commented in your

[GitHub] [spark] HeartSaVioR edited a comment on issue #25577: [WIP][CORE][SPARK-28867] InMemoryStore checkpoint to speed up replay log file in HistoryServer

2019-08-27 Thread GitBox
HeartSaVioR edited a comment on issue #25577: [WIP][CORE][SPARK-28867] InMemoryStore checkpoint to speed up replay log file in HistoryServer URL: https://github.com/apache/spark/pull/25577#issuecomment-525578717 Thanks for pointing out about "recover live entities". I've commented in your

[GitHub] [spark] HeartSaVioR commented on issue #25577: [WIP][CORE][SPARK-28867] InMemoryStore checkpoint to speed up replay log file in HistoryServer

2019-08-27 Thread GitBox
HeartSaVioR commented on issue #25577: [WIP][CORE][SPARK-28867] InMemoryStore checkpoint to speed up replay log file in HistoryServer URL: https://github.com/apache/spark/pull/25577#issuecomment-525578717 Thanks for pointing out about "recover live entities". I've commented in your

[GitHub] [spark] cloud-fan closed pull request #25570: [SPARK-23519][SQL] create view should work from query with duplicate output columns

2019-08-27 Thread GitBox
cloud-fan closed pull request #25570: [SPARK-23519][SQL] create view should work from query with duplicate output columns URL: https://github.com/apache/spark/pull/25570 This is an automated message from the Apache Git

[GitHub] [spark] cloud-fan commented on issue #25570: [SPARK-23519][SQL] create view should work from query with duplicate output columns

2019-08-27 Thread GitBox
cloud-fan commented on issue #25570: [SPARK-23519][SQL] create view should work from query with duplicate output columns URL: https://github.com/apache/spark/pull/25570#issuecomment-525576389 thanks, merging to master! This

[GitHub] [spark] dilipbiswal commented on issue #25525: [SPARK-28786][DOC][SQL]Document INSERT statement in SQL Reference

2019-08-27 Thread GitBox
dilipbiswal commented on issue #25525: [SPARK-28786][DOC][SQL]Document INSERT statement in SQL Reference URL: https://github.com/apache/spark/pull/25525#issuecomment-525575081 LGTM cc @gatorsmile @srowen for final sign off.

[GitHub] [spark] SparkQA commented on issue #25575: [SPARK-28818][SQL] Respect source column nullability in the arrays created by `freqItems()`

2019-08-27 Thread GitBox
SparkQA commented on issue #25575: [SPARK-28818][SQL] Respect source column nullability in the arrays created by `freqItems()` URL: https://github.com/apache/spark/pull/25575#issuecomment-525574846 **[Test build #109845 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25575: [SPARK-28818][SQL] Respect source column nullability in the arrays created by `freqItems()`

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #25575: [SPARK-28818][SQL] Respect source column nullability in the arrays created by `freqItems()` URL: https://github.com/apache/spark/pull/25575#issuecomment-525574425 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #25575: [SPARK-28818][SQL] Respect source column nullability in the arrays created by `freqItems()`

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #25575: [SPARK-28818][SQL] Respect source column nullability in the arrays created by `freqItems()` URL: https://github.com/apache/spark/pull/25575#issuecomment-525574425 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #25575: [SPARK-28818][SQL] Respect source column nullability in the arrays created by `freqItems()`

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #25575: [SPARK-28818][SQL] Respect source column nullability in the arrays created by `freqItems()` URL: https://github.com/apache/spark/pull/25575#issuecomment-525574423 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25575: [SPARK-28818][SQL] Respect source column nullability in the arrays created by `freqItems()`

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #25575: [SPARK-28818][SQL] Respect source column nullability in the arrays created by `freqItems()` URL: https://github.com/apache/spark/pull/25575#issuecomment-525574423 Merged build finished. Test PASSed.

[GitHub] [spark] HeartSaVioR commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-08-27 Thread GitBox
HeartSaVioR commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-525573132 @dongjinleekr Kindly reminder. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #22138: [SPARK-25151][SS] Apply Apache Commons Pool to KafkaDataConsumer

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #22138: [SPARK-25151][SS] Apply Apache Commons Pool to KafkaDataConsumer URL: https://github.com/apache/spark/pull/22138#issuecomment-525572488 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #25559: [WIP][DO-NOT-MERGE] Test updating Kinesis deps and current state of Kinesis Python tests

2019-08-27 Thread GitBox
SparkQA removed a comment on issue #25559: [WIP][DO-NOT-MERGE] Test updating Kinesis deps and current state of Kinesis Python tests URL: https://github.com/apache/spark/pull/25559#issuecomment-525544916 **[Test build #4846 has

[GitHub] [spark] SparkQA commented on issue #25559: [WIP][DO-NOT-MERGE] Test updating Kinesis deps and current state of Kinesis Python tests

2019-08-27 Thread GitBox
SparkQA commented on issue #25559: [WIP][DO-NOT-MERGE] Test updating Kinesis deps and current state of Kinesis Python tests URL: https://github.com/apache/spark/pull/25559#issuecomment-525572637 **[Test build #4846 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #22138: [SPARK-25151][SS] Apply Apache Commons Pool to KafkaDataConsumer

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #22138: [SPARK-25151][SS] Apply Apache Commons Pool to KafkaDataConsumer URL: https://github.com/apache/spark/pull/22138#issuecomment-525572483 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #22138: [SPARK-25151][SS] Apply Apache Commons Pool to KafkaDataConsumer

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #22138: [SPARK-25151][SS] Apply Apache Commons Pool to KafkaDataConsumer URL: https://github.com/apache/spark/pull/22138#issuecomment-525572483 Merged build finished. Test FAILed. This is an

[GitHub] [spark] SparkQA removed a comment on issue #22138: [SPARK-25151][SS] Apply Apache Commons Pool to KafkaDataConsumer

2019-08-27 Thread GitBox
SparkQA removed a comment on issue #22138: [SPARK-25151][SS] Apply Apache Commons Pool to KafkaDataConsumer URL: https://github.com/apache/spark/pull/22138#issuecomment-525547727 **[Test build #109841 has

[GitHub] [spark] AmplabJenkins commented on issue #22138: [SPARK-25151][SS] Apply Apache Commons Pool to KafkaDataConsumer

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #22138: [SPARK-25151][SS] Apply Apache Commons Pool to KafkaDataConsumer URL: https://github.com/apache/spark/pull/22138#issuecomment-525572488 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #22138: [SPARK-25151][SS] Apply Apache Commons Pool to KafkaDataConsumer

2019-08-27 Thread GitBox
SparkQA commented on issue #22138: [SPARK-25151][SS] Apply Apache Commons Pool to KafkaDataConsumer URL: https://github.com/apache/spark/pull/22138#issuecomment-525572243 **[Test build #109841 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25342: [SPARK-28571][CORE][SHUFFLE] Use the shuffle writer plugin for the SortShuffleWriter

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #25342: [SPARK-28571][CORE][SHUFFLE] Use the shuffle writer plugin for the SortShuffleWriter URL: https://github.com/apache/spark/pull/25342#issuecomment-525571889 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #25605: [SPARK-28730][SPARK-28495][SQL][FOLLOW-UP] Revise the doc of option spark.sql.storeAssignmentPolicy

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #25605: [SPARK-28730][SPARK-28495][SQL][FOLLOW-UP] Revise the doc of option spark.sql.storeAssignmentPolicy URL: https://github.com/apache/spark/pull/25605#issuecomment-525571411 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25342: [SPARK-28571][CORE][SHUFFLE] Use the shuffle writer plugin for the SortShuffleWriter

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #25342: [SPARK-28571][CORE][SHUFFLE] Use the shuffle writer plugin for the SortShuffleWriter URL: https://github.com/apache/spark/pull/25342#issuecomment-525571885 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25605: [SPARK-28730][SPARK-28495][SQL][FOLLOW-UP] Revise the doc of option spark.sql.storeAssignmentPolicy

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #25605: [SPARK-28730][SPARK-28495][SQL][FOLLOW-UP] Revise the doc of option spark.sql.storeAssignmentPolicy URL: https://github.com/apache/spark/pull/25605#issuecomment-525571418 Test PASSed. Refer to this link for build results (access rights

[GitHub] [spark] AmplabJenkins commented on issue #25342: [SPARK-28571][CORE][SHUFFLE] Use the shuffle writer plugin for the SortShuffleWriter

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #25342: [SPARK-28571][CORE][SHUFFLE] Use the shuffle writer plugin for the SortShuffleWriter URL: https://github.com/apache/spark/pull/25342#issuecomment-525571889 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #25342: [SPARK-28571][CORE][SHUFFLE] Use the shuffle writer plugin for the SortShuffleWriter

2019-08-27 Thread GitBox
SparkQA removed a comment on issue #25342: [SPARK-28571][CORE][SHUFFLE] Use the shuffle writer plugin for the SortShuffleWriter URL: https://github.com/apache/spark/pull/25342#issuecomment-525543200 **[Test build #109840 has

[GitHub] [spark] SparkQA commented on issue #25605: [SPARK-28730][SPARK-28495][SQL][FOLLOW-UP] Revise the doc of option spark.sql.storeAssignmentPolicy

2019-08-27 Thread GitBox
SparkQA commented on issue #25605: [SPARK-28730][SPARK-28495][SQL][FOLLOW-UP] Revise the doc of option spark.sql.storeAssignmentPolicy URL: https://github.com/apache/spark/pull/25605#issuecomment-525571828 **[Test build #109844 has

[GitHub] [spark] AmplabJenkins commented on issue #25342: [SPARK-28571][CORE][SHUFFLE] Use the shuffle writer plugin for the SortShuffleWriter

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #25342: [SPARK-28571][CORE][SHUFFLE] Use the shuffle writer plugin for the SortShuffleWriter URL: https://github.com/apache/spark/pull/25342#issuecomment-525571885 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #25342: [SPARK-28571][CORE][SHUFFLE] Use the shuffle writer plugin for the SortShuffleWriter

2019-08-27 Thread GitBox
SparkQA commented on issue #25342: [SPARK-28571][CORE][SHUFFLE] Use the shuffle writer plugin for the SortShuffleWriter URL: https://github.com/apache/spark/pull/25342#issuecomment-525571583 **[Test build #109840 has

[GitHub] [spark] AmplabJenkins commented on issue #25605: [SPARK-28730][SPARK-28495][SQL][FOLLOW-UP] Revise the doc of option spark.sql.storeAssignmentPolicy

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #25605: [SPARK-28730][SPARK-28495][SQL][FOLLOW-UP] Revise the doc of option spark.sql.storeAssignmentPolicy URL: https://github.com/apache/spark/pull/25605#issuecomment-525571418 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #25605: [SPARK-28730][SPARK-28495][SQL][FOLLOW-UP] Revise the doc of option spark.sql.storeAssignmentPolicy

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #25605: [SPARK-28730][SPARK-28495][SQL][FOLLOW-UP] Revise the doc of option spark.sql.storeAssignmentPolicy URL: https://github.com/apache/spark/pull/25605#issuecomment-525571411 Merged build finished. Test PASSed.

[GitHub] [spark] gengliangwang edited a comment on issue #25605: [SPARK-28730][SPARK-28495][SQL][FOLLOW-UP] Revise the doc of option spark.sql.storeAssignmentPolicy

2019-08-27 Thread GitBox
gengliangwang edited a comment on issue #25605: [SPARK-28730][SPARK-28495][SQL][FOLLOW-UP] Revise the doc of option spark.sql.storeAssignmentPolicy URL: https://github.com/apache/spark/pull/25605#issuecomment-525571300 cc @cloud-fan

[GitHub] [spark] gengliangwang commented on issue #25605: [SPARK-28730][SPARK-28495][SQL][FOLLOW-UP] Revise the doc of option spark.sql.storeAssignmentPolicy

2019-08-27 Thread GitBox
gengliangwang commented on issue #25605: [SPARK-28730][SPARK-28495][SQL][FOLLOW-UP] Revise the doc of option spark.sql.storeAssignmentPolicy URL: https://github.com/apache/spark/pull/25605#issuecomment-525571300 @cloud-fan

[GitHub] [spark] gengliangwang opened a new pull request #25605: [SPARK-28730][SPARK-28495][SQL][FOLLOW-UP] Revise the doc of option spark.sql.storeAssignmentPolicy

2019-08-27 Thread GitBox
gengliangwang opened a new pull request #25605: [SPARK-28730][SPARK-28495][SQL][FOLLOW-UP] Revise the doc of option spark.sql.storeAssignmentPolicy URL: https://github.com/apache/spark/pull/25605 ### What changes were proposed in this pull request? Revise the

[GitHub] [spark] AmplabJenkins removed a comment on issue #25604: [SPARK-28890][SQL] Upgrade Hive Metastore Client to the 3.1.2 for Hive 3.1

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #25604: [SPARK-28890][SQL] Upgrade Hive Metastore Client to the 3.1.2 for Hive 3.1 URL: https://github.com/apache/spark/pull/25604#issuecomment-525568562 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25604: [SPARK-28890][SQL] Upgrade Hive Metastore Client to the 3.1.2 for Hive 3.1

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #25604: [SPARK-28890][SQL] Upgrade Hive Metastore Client to the 3.1.2 for Hive 3.1 URL: https://github.com/apache/spark/pull/25604#issuecomment-525568558 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #25604: [SPARK-28890][SQL] Upgrade Hive Metastore Client to the 3.1.2 for Hive 3.1

2019-08-27 Thread GitBox
SparkQA commented on issue #25604: [SPARK-28890][SQL] Upgrade Hive Metastore Client to the 3.1.2 for Hive 3.1 URL: https://github.com/apache/spark/pull/25604#issuecomment-525568939 **[Test build #109843 has

[GitHub] [spark] AmplabJenkins commented on issue #25604: [SPARK-28890][SQL] Upgrade Hive Metastore Client to the 3.1.2 for Hive 3.1

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #25604: [SPARK-28890][SQL] Upgrade Hive Metastore Client to the 3.1.2 for Hive 3.1 URL: https://github.com/apache/spark/pull/25604#issuecomment-525568558 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25604: [SPARK-28890][SQL] Upgrade Hive Metastore Client to the 3.1.2 for Hive 3.1

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #25604: [SPARK-28890][SQL] Upgrade Hive Metastore Client to the 3.1.2 for Hive 3.1 URL: https://github.com/apache/spark/pull/25604#issuecomment-525568562 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] wangyum opened a new pull request #25604: [SPARK-28890][SQL] Upgrade Hive Metastore Client to the 3.1.2 for Hive 3.1

2019-08-27 Thread GitBox
wangyum opened a new pull request #25604: [SPARK-28890][SQL] Upgrade Hive Metastore Client to the 3.1.2 for Hive 3.1 URL: https://github.com/apache/spark/pull/25604 ### What changes were proposed in this pull request? Hive 3.1.2 has been released. This PR upgrades the Hive

[GitHub] [spark] AmplabJenkins removed a comment on issue #25601: [SPARK-28856][SQL] Implement SHOW DATABASES for Data Source V2 Tables

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #25601: [SPARK-28856][SQL] Implement SHOW DATABASES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25601#issuecomment-525565709 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25601: [SPARK-28856][SQL] Implement SHOW DATABASES for Data Source V2 Tables

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #25601: [SPARK-28856][SQL] Implement SHOW DATABASES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25601#issuecomment-525565707 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25601: [SPARK-28856][SQL] Implement SHOW DATABASES for Data Source V2 Tables

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #25601: [SPARK-28856][SQL] Implement SHOW DATABASES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25601#issuecomment-525565709 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25601: [SPARK-28856][SQL] Implement SHOW DATABASES for Data Source V2 Tables

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #25601: [SPARK-28856][SQL] Implement SHOW DATABASES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25601#issuecomment-525565707 Merged build finished. Test PASSed. This

[GitHub] [spark] SparkQA removed a comment on issue #25601: [SPARK-28856][SQL] Implement SHOW DATABASES for Data Source V2 Tables

2019-08-27 Thread GitBox
SparkQA removed a comment on issue #25601: [SPARK-28856][SQL] Implement SHOW DATABASES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25601#issuecomment-525521338 **[Test build #109836 has

[GitHub] [spark] SparkQA commented on issue #25601: [SPARK-28856][SQL] Implement SHOW DATABASES for Data Source V2 Tables

2019-08-27 Thread GitBox
SparkQA commented on issue #25601: [SPARK-28856][SQL] Implement SHOW DATABASES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25601#issuecomment-525565287 **[Test build #109836 has

[GitHub] [spark] ulysses-you commented on issue #25556: [SPARK-28853][SQL] Support conf to organize file partitions by file path

2019-08-27 Thread GitBox
ulysses-you commented on issue #25556: [SPARK-28853][SQL] Support conf to organize file partitions by file path URL: https://github.com/apache/spark/pull/25556#issuecomment-525563248 I think it can be merge partition one by one in a loop.

[GitHub] [spark] SparkQA commented on issue #25512: [SPARK-28782][SQL] Generator support in aggregate expressions

2019-08-27 Thread GitBox
SparkQA commented on issue #25512: [SPARK-28782][SQL] Generator support in aggregate expressions URL: https://github.com/apache/spark/pull/25512#issuecomment-525560148 **[Test build #109842 has

[GitHub] [spark] dongjoon-hyun commented on issue #25603: [SPARK-28881][PYTHON][TESTS][FOLLOW-UP] Use SparkSession(SparkContext(...)) to prevent for Spark conf to affect other tests

2019-08-27 Thread GitBox
dongjoon-hyun commented on issue #25603: [SPARK-28881][PYTHON][TESTS][FOLLOW-UP] Use SparkSession(SparkContext(...)) to prevent for Spark conf to affect other tests URL: https://github.com/apache/spark/pull/25603#issuecomment-525559734 Late LGTM.

[GitHub] [spark] AmplabJenkins commented on issue #25512: [SPARK-28782][SQL] Generator support in aggregate expressions

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #25512: [SPARK-28782][SQL] Generator support in aggregate expressions URL: https://github.com/apache/spark/pull/25512#issuecomment-525559749 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #25512: [SPARK-28782][SQL] Generator support in aggregate expressions

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #25512: [SPARK-28782][SQL] Generator support in aggregate expressions URL: https://github.com/apache/spark/pull/25512#issuecomment-525559754 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25512: [SPARK-28782][SQL] Generator support in aggregate expressions

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #25512: [SPARK-28782][SQL] Generator support in aggregate expressions URL: https://github.com/apache/spark/pull/25512#issuecomment-525559749 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #25512: [SPARK-28782][SQL] Generator support in aggregate expressions

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #25512: [SPARK-28782][SQL] Generator support in aggregate expressions URL: https://github.com/apache/spark/pull/25512#issuecomment-525559754 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] beliefer commented on a change in pull request #25309: [SPARK-28577][YARN]Resource capability requested for each executor add offHeapMemorySize

2019-08-27 Thread GitBox
beliefer commented on a change in pull request #25309: [SPARK-28577][YARN]Resource capability requested for each executor add offHeapMemorySize URL: https://github.com/apache/spark/pull/25309#discussion_r318370407 ## File path:

[GitHub] [spark] WeichenXu123 commented on issue #25512: [SPARK-28782][SQL] Generator support in aggregate expressions

2019-08-27 Thread GitBox
WeichenXu123 commented on issue #25512: [SPARK-28782][SQL] Generator support in aggregate expressions URL: https://github.com/apache/spark/pull/25512#issuecomment-525559331 Jenkins retest this please This is an automated

  1   2   3   4   5   6   7   8   9   10   >