[GitHub] [spark] AmplabJenkins commented on issue #26160: [SPARK-29498][SQL] CatalogTable to HiveTable should not change the table's ownership

2019-10-18 Thread GitBox
AmplabJenkins commented on issue #26160: [SPARK-29498][SQL] CatalogTable to HiveTable should not change the table's ownership URL: https://github.com/apache/spark/pull/26160#issuecomment-543647406 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #26160: [SPARK-29498][SQL] CatalogTable to HiveTable should not change the table's ownership

2019-10-18 Thread GitBox
SparkQA commented on issue #26160: [SPARK-29498][SQL] CatalogTable to HiveTable should not change the table's ownership URL: https://github.com/apache/spark/pull/26160#issuecomment-543646547 **[Test build #112271 has

[GitHub] [spark] SparkQA commented on issue #26161: [SPARK-27900][K8s] Add jvm oom flag in cluster mode

2019-10-18 Thread GitBox
SparkQA commented on issue #26161: [SPARK-27900][K8s] Add jvm oom flag in cluster mode URL: https://github.com/apache/spark/pull/26161#issuecomment-543646573 **[Test build #112270 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112270/testReport)** for PR

[GitHub] [spark] SparkQA commented on issue #26161: [SPARK-27900][K8s] Add jvm oom flag in cluster mode

2019-10-18 Thread GitBox
SparkQA commented on issue #26161: [SPARK-27900][K8s] Add jvm oom flag in cluster mode URL: https://github.com/apache/spark/pull/26161#issuecomment-543666390 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/17254/

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka

2019-10-18 Thread GitBox
gaborgsomogyi commented on a change in pull request #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka URL: https://github.com/apache/spark/pull/26153#discussion_r336439286 ## File path:

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka

2019-10-18 Thread GitBox
gaborgsomogyi commented on a change in pull request #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka URL: https://github.com/apache/spark/pull/26153#discussion_r336436512 ## File path:

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka

2019-10-18 Thread GitBox
gaborgsomogyi commented on a change in pull request #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka URL: https://github.com/apache/spark/pull/26153#discussion_r336417051 ## File path:

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka

2019-10-18 Thread GitBox
gaborgsomogyi commented on a change in pull request #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka URL: https://github.com/apache/spark/pull/26153#discussion_r336409937 ## File path:

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka

2019-10-18 Thread GitBox
gaborgsomogyi commented on a change in pull request #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka URL: https://github.com/apache/spark/pull/26153#discussion_r336407635 ## File path: docs/structured-streaming-kafka-integration.md ## @@

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka

2019-10-18 Thread GitBox
gaborgsomogyi commented on a change in pull request #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka URL: https://github.com/apache/spark/pull/26153#discussion_r336404694 ## File path: docs/structured-streaming-kafka-integration.md ## @@

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka

2019-10-18 Thread GitBox
gaborgsomogyi commented on a change in pull request #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka URL: https://github.com/apache/spark/pull/26153#discussion_r336431794 ## File path:

[GitHub] [spark] HeartSaVioR commented on a change in pull request #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka

2019-10-18 Thread GitBox
HeartSaVioR commented on a change in pull request #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka URL: https://github.com/apache/spark/pull/26153#discussion_r336446130 ## File path:

[GitHub] [spark] HeartSaVioR commented on issue #26158: [MINOR][SQL][SS] Deduplicate codes from Kafka data source

2019-10-18 Thread GitBox
HeartSaVioR commented on issue #26158: [MINOR][SQL][SS] Deduplicate codes from Kafka data source URL: https://github.com/apache/spark/pull/26158#issuecomment-543692934 cc. @tdas @zsxwing @jose-torres @gaborgsomogyi This is

[GitHub] [spark] HeartSaVioR commented on issue #26162: [SPARK-29438][SS] Use partition ID of source for state store in stream-stream join

2019-10-18 Thread GitBox
HeartSaVioR commented on issue #26162: [SPARK-29438][SS] Use partition ID of source for state store in stream-stream join URL: https://github.com/apache/spark/pull/26162#issuecomment-543692986 cc. @tdas @zsxwing @jose-torres @gaborgsomogyi

[GitHub] [spark] SparkQA commented on issue #26155: [SPARK-27879][SQL] Add support for bit_and and bit_or aggregates

2019-10-18 Thread GitBox
SparkQA commented on issue #26155: [SPARK-27879][SQL] Add support for bit_and and bit_or aggregates URL: https://github.com/apache/spark/pull/26155#issuecomment-543712108 **[Test build #112266 has

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka

2019-10-18 Thread GitBox
gaborgsomogyi commented on a change in pull request #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka URL: https://github.com/apache/spark/pull/26153#discussion_r336471262 ## File path:

[GitHub] [spark] redsk commented on a change in pull request #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka

2019-10-18 Thread GitBox
redsk commented on a change in pull request #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka URL: https://github.com/apache/spark/pull/26153#discussion_r336471883 ## File path: docs/structured-streaming-kafka-integration.md ## @@ -622,6

[GitHub] [spark] SparkQA removed a comment on issue #26120: [SPARK-29014][SQL] DataSourceV2: Fix current/default catalog usage

2019-10-18 Thread GitBox
SparkQA removed a comment on issue #26120: [SPARK-29014][SQL] DataSourceV2: Fix current/default catalog usage URL: https://github.com/apache/spark/pull/26120#issuecomment-543626018 **[Test build #112269 has

[GitHub] [spark] SparkQA commented on issue #26120: [SPARK-29014][SQL] DataSourceV2: Fix current/default catalog usage

2019-10-18 Thread GitBox
SparkQA commented on issue #26120: [SPARK-29014][SQL] DataSourceV2: Fix current/default catalog usage URL: https://github.com/apache/spark/pull/26120#issuecomment-543742493 **[Test build #112269 has

[GitHub] [spark] AmplabJenkins commented on issue #26165: [SPARK-29508][SQL] Implicitly cast strings in datetime arithmetic operations

2019-10-18 Thread GitBox
AmplabJenkins commented on issue #26165: [SPARK-29508][SQL] Implicitly cast strings in datetime arithmetic operations URL: https://github.com/apache/spark/pull/26165#issuecomment-543752007 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26165: [SPARK-29508][SQL] Implicitly cast strings in datetime arithmetic operations

2019-10-18 Thread GitBox
AmplabJenkins commented on issue #26165: [SPARK-29508][SQL] Implicitly cast strings in datetime arithmetic operations URL: https://github.com/apache/spark/pull/26165#issuecomment-543752019 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] MaxGekk commented on issue #26165: [SPARK-29508][SQL] Implicitly cast strings in datetime arithmetic operations

2019-10-18 Thread GitBox
MaxGekk commented on issue #26165: [SPARK-29508][SQL] Implicitly cast strings in datetime arithmetic operations URL: https://github.com/apache/spark/pull/26165#issuecomment-543751740 @wangyum Please, review this PR. This is

[GitHub] [spark] AmplabJenkins commented on issue #26162: [SPARK-29438][SS] Use partition ID of source for state store in stream-stream join

2019-10-18 Thread GitBox
AmplabJenkins commented on issue #26162: [SPARK-29438][SS] Use partition ID of source for state store in stream-stream join URL: https://github.com/apache/spark/pull/26162#issuecomment-543661942 Can one of the admins verify this patch?

[GitHub] [spark] HeartSaVioR commented on issue #26156: [SPARK-29438][SS] Failed to get state store when task number is not determinate

2019-10-18 Thread GitBox
HeartSaVioR commented on issue #26156: [SPARK-29438][SS] Failed to get state store when task number is not determinate URL: https://github.com/apache/spark/pull/26156#issuecomment-543662716 Hi @uncleGen , sorry I didn't see what you meant for taskpartition in JIRA, now I got it.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26080: [SPARK-29425][SQL] The ownership of a database should be respected

2019-10-18 Thread GitBox
AmplabJenkins removed a comment on issue #26080: [SPARK-29425][SQL] The ownership of a database should be respected URL: https://github.com/apache/spark/pull/26080#issuecomment-543661968 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #26129: [SPARK-29482][SQL] ANALYZE TABLE should look up catalog/table like v2 commands

2019-10-18 Thread GitBox
SparkQA commented on issue #26129: [SPARK-29482][SQL] ANALYZE TABLE should look up catalog/table like v2 commands URL: https://github.com/apache/spark/pull/26129#issuecomment-543670034 **[Test build #112259 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #26161: [SPARK-27900][K8s] Add jvm oom flag in cluster mode

2019-10-18 Thread GitBox
AmplabJenkins removed a comment on issue #26161: [SPARK-27900][K8s] Add jvm oom flag in cluster mode URL: https://github.com/apache/spark/pull/26161#issuecomment-543675790 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26161: [SPARK-27900][K8s] Add jvm oom flag in cluster mode

2019-10-18 Thread GitBox
AmplabJenkins removed a comment on issue #26161: [SPARK-27900][K8s] Add jvm oom flag in cluster mode URL: https://github.com/apache/spark/pull/26161#issuecomment-543675779 Merged build finished. Test PASSed. This is an

[GitHub] [spark] SparkQA commented on issue #26161: [SPARK-27900][K8s] Add jvm oom flag in cluster mode

2019-10-18 Thread GitBox
SparkQA commented on issue #26161: [SPARK-27900][K8s] Add jvm oom flag in cluster mode URL: https://github.com/apache/spark/pull/26161#issuecomment-543675701 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/17254/

[GitHub] [spark] AmplabJenkins commented on issue #26161: [SPARK-27900][K8s] Add jvm oom flag in cluster mode

2019-10-18 Thread GitBox
AmplabJenkins commented on issue #26161: [SPARK-27900][K8s] Add jvm oom flag in cluster mode URL: https://github.com/apache/spark/pull/26161#issuecomment-543675790 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26161: [SPARK-27900][K8s] Add jvm oom flag in cluster mode

2019-10-18 Thread GitBox
AmplabJenkins commented on issue #26161: [SPARK-27900][K8s] Add jvm oom flag in cluster mode URL: https://github.com/apache/spark/pull/26161#issuecomment-543675779 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] SparkQA removed a comment on issue #25981: [SPARK-28420][SQL] Support the `INTERVAL` type in `date_part()`

2019-10-18 Thread GitBox
SparkQA removed a comment on issue #25981: [SPARK-28420][SQL] Support the `INTERVAL` type in `date_part()` URL: https://github.com/apache/spark/pull/25981#issuecomment-543569933 **[Test build #112262 has

[GitHub] [spark] AmplabJenkins commented on issue #25981: [SPARK-28420][SQL] Support the `INTERVAL` type in `date_part()`

2019-10-18 Thread GitBox
AmplabJenkins commented on issue #25981: [SPARK-28420][SQL] Support the `INTERVAL` type in `date_part()` URL: https://github.com/apache/spark/pull/25981#issuecomment-543685093 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #25981: [SPARK-28420][SQL] Support the `INTERVAL` type in `date_part()`

2019-10-18 Thread GitBox
AmplabJenkins commented on issue #25981: [SPARK-28420][SQL] Support the `INTERVAL` type in `date_part()` URL: https://github.com/apache/spark/pull/25981#issuecomment-543685105 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] HeartSaVioR commented on issue #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka

2019-10-18 Thread GitBox
HeartSaVioR commented on issue #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka URL: https://github.com/apache/spark/pull/26153#issuecomment-543692309 > Just to double check won't this change the schema of a stateful query? The `partition` attribute is

[GitHub] [spark] redsk commented on issue #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka

2019-10-18 Thread GitBox
redsk commented on issue #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka URL: https://github.com/apache/spark/pull/26153#issuecomment-543708565 > * The continuous test coverage can be increased What would you suggest? Aren't batch, streaming, and

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka

2019-10-18 Thread GitBox
gaborgsomogyi commented on a change in pull request #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka URL: https://github.com/apache/spark/pull/26153#discussion_r336464078 ## File path: docs/structured-streaming-kafka-integration.md ## @@

[GitHub] [spark] redsk commented on a change in pull request #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka

2019-10-18 Thread GitBox
redsk commented on a change in pull request #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka URL: https://github.com/apache/spark/pull/26153#discussion_r336466716 ## File path:

[GitHub] [spark] WeichenXu123 commented on issue #18610: [SPARK-21386] ML LinearRegression supports warm start from user provided initial model.

2019-10-18 Thread GitBox
WeichenXu123 commented on issue #18610: [SPARK-21386] ML LinearRegression supports warm start from user provided initial model. URL: https://github.com/apache/spark/pull/18610#issuecomment-543717445 @yanboliang This PR is stale. If no further updates, would you mind to close it ? Thanks

[GitHub] [spark] AmplabJenkins commented on issue #26161: [SPARK-27900][K8s] Add jvm oom flag in cluster mode

2019-10-18 Thread GitBox
AmplabJenkins commented on issue #26161: [SPARK-27900][K8s] Add jvm oom flag in cluster mode URL: https://github.com/apache/spark/pull/26161#issuecomment-543717546 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #26161: [SPARK-27900][K8s] Add jvm oom flag in cluster mode

2019-10-18 Thread GitBox
AmplabJenkins commented on issue #26161: [SPARK-27900][K8s] Add jvm oom flag in cluster mode URL: https://github.com/apache/spark/pull/26161#issuecomment-543717558 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] redsk commented on a change in pull request #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka

2019-10-18 Thread GitBox
redsk commented on a change in pull request #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka URL: https://github.com/apache/spark/pull/26153#discussion_r336473481 ## File path:

[GitHub] [spark] gaborgsomogyi commented on issue #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka

2019-10-18 Thread GitBox
gaborgsomogyi commented on issue #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka URL: https://github.com/apache/spark/pull/26153#issuecomment-543729261 Yep. This is an automated message from the

[GitHub] [spark] SparkQA commented on issue #24939: [SPARK-18569][ML][R] Support RFormula arithmetic, I() and spark functions

2019-10-18 Thread GitBox
SparkQA commented on issue #24939: [SPARK-18569][ML][R] Support RFormula arithmetic, I() and spark functions URL: https://github.com/apache/spark/pull/24939#issuecomment-543747027 **[Test build #112278 has

[GitHub] [spark] MaxGekk opened a new pull request #26165: [SPARK-29508][SQL] Implicitly cast strings in datetime arithmetic operations

2019-10-18 Thread GitBox
MaxGekk opened a new pull request #26165: [SPARK-29508][SQL] Implicitly cast strings in datetime arithmetic operations URL: https://github.com/apache/spark/pull/26165 ### What changes were proposed in this pull request? - Cast strings to intervals in `interval - string`. For example:

[GitHub] [spark] SparkQA removed a comment on issue #26162: [SPARK-29438][SS] Use partition ID of StateStoreAwareZipPartitionsRDD for determining partition ID of state store in stream-stream join

2019-10-18 Thread GitBox
SparkQA removed a comment on issue #26162: [SPARK-29438][SS] Use partition ID of StateStoreAwareZipPartitionsRDD for determining partition ID of state store in stream-stream join URL: https://github.com/apache/spark/pull/26162#issuecomment-543665325 **[Test build #112273 has

[GitHub] [spark] SparkQA commented on issue #26162: [SPARK-29438][SS] Use partition ID of StateStoreAwareZipPartitionsRDD for determining partition ID of state store in stream-stream join

2019-10-18 Thread GitBox
SparkQA commented on issue #26162: [SPARK-29438][SS] Use partition ID of StateStoreAwareZipPartitionsRDD for determining partition ID of state store in stream-stream join URL: https://github.com/apache/spark/pull/26162#issuecomment-543771333 **[Test build #112273 has

[GitHub] [spark] SparkQA commented on issue #26134: [SPARK-29486][SQL] CalendarInterval should have 3 fields: months, days and microseconds

2019-10-18 Thread GitBox
SparkQA commented on issue #26134: [SPARK-29486][SQL] CalendarInterval should have 3 fields: months, days and microseconds URL: https://github.com/apache/spark/pull/26134#issuecomment-543771183 **[Test build #112281 has

[GitHub] [spark] wangyum opened a new pull request #26160: [SPARK-29498][SQL] CatalogTable to HiveTable should not change the table's ownership

2019-10-18 Thread GitBox
wangyum opened a new pull request #26160: [SPARK-29498][SQL] CatalogTable to HiveTable should not change the table's ownership URL: https://github.com/apache/spark/pull/26160 ### What changes were proposed in this pull request? `CatalogTable` to `HiveTable` will change the table's

[GitHub] [spark] zhengruifeng closed pull request #26135: [SPARK-29489][ML][PySpark] ml.evaluation support log-loss

2019-10-18 Thread GitBox
zhengruifeng closed pull request #26135: [SPARK-29489][ML][PySpark] ml.evaluation support log-loss URL: https://github.com/apache/spark/pull/26135 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] skonto opened a new pull request #26161: [SPARK-27900][K8s] Add jvm oom flag in cluster mode

2019-10-18 Thread GitBox
skonto opened a new pull request #26161: [SPARK-27900][K8s] Add jvm oom flag in cluster mode URL: https://github.com/apache/spark/pull/26161 ### What changes were proposed in this pull request? - Adds a flag to make the driver exit in case of an oom error in cluster mode (by

[GitHub] [spark] HeartSaVioR commented on issue #26162: [SPARK-29438][SS] Use partition ID of source for state store in stream-stream join

2019-10-18 Thread GitBox
HeartSaVioR commented on issue #26162: [SPARK-29438][SS] Use partition ID of source for state store in stream-stream join URL: https://github.com/apache/spark/pull/26162#issuecomment-543664548 We could add configuration to retain the behavior (using `TaskContext.partitionId()`) and avoid

[GitHub] [spark] gengliangwang closed pull request #26129: [SPARK-29482][SQL] ANALYZE TABLE should look up catalog/table like v2 commands

2019-10-18 Thread GitBox
gengliangwang closed pull request #26129: [SPARK-29482][SQL] ANALYZE TABLE should look up catalog/table like v2 commands URL: https://github.com/apache/spark/pull/26129 This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins commented on issue #26151: [SPARK-29502][SQL] typed interval expression should fail for invalid format

2019-10-18 Thread GitBox
AmplabJenkins commented on issue #26151: [SPARK-29502][SQL] typed interval expression should fail for invalid format URL: https://github.com/apache/spark/pull/26151#issuecomment-543672860 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26151: [SPARK-29502][SQL] typed interval expression should fail for invalid format

2019-10-18 Thread GitBox
AmplabJenkins commented on issue #26151: [SPARK-29502][SQL] typed interval expression should fail for invalid format URL: https://github.com/apache/spark/pull/26151#issuecomment-543672879 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26156: [SPARK-29438][SS] Failed to get state store when task number is not determinate

2019-10-18 Thread GitBox
AmplabJenkins removed a comment on issue #26156: [SPARK-29438][SS] Failed to get state store when task number is not determinate URL: https://github.com/apache/spark/pull/26156#issuecomment-543680017 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26156: [SPARK-29438][SS] Failed to get state store when task number is not determinate

2019-10-18 Thread GitBox
AmplabJenkins removed a comment on issue #26156: [SPARK-29438][SS] Failed to get state store when task number is not determinate URL: https://github.com/apache/spark/pull/26156#issuecomment-543680029 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26156: [SPARK-29438][SS] Failed to get state store when task number is not determinate

2019-10-18 Thread GitBox
AmplabJenkins commented on issue #26156: [SPARK-29438][SS] Failed to get state store when task number is not determinate URL: https://github.com/apache/spark/pull/26156#issuecomment-543680029 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26156: [SPARK-29438][SS] Failed to get state store when task number is not determinate

2019-10-18 Thread GitBox
AmplabJenkins commented on issue #26156: [SPARK-29438][SS] Failed to get state store when task number is not determinate URL: https://github.com/apache/spark/pull/26156#issuecomment-543680017 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #26156: [SPARK-29438][SS] Failed to get state store when task number is not determinate

2019-10-18 Thread GitBox
SparkQA removed a comment on issue #26156: [SPARK-29438][SS] Failed to get state store when task number is not determinate URL: https://github.com/apache/spark/pull/26156#issuecomment-543562964 **[Test build #112261 has

[GitHub] [spark] gaborgsomogyi commented on issue #25853: [WIP][SPARK-21869][SS] Apply Apache Commons Pool to Kafka producer

2019-10-18 Thread GitBox
gaborgsomogyi commented on issue #25853: [WIP][SPARK-21869][SS] Apply Apache Commons Pool to Kafka producer URL: https://github.com/apache/spark/pull/25853#issuecomment-543697286 The endurance test looks stable so removing the WIP.

[GitHub] [spark] redsk commented on a change in pull request #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka

2019-10-18 Thread GitBox
redsk commented on a change in pull request #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka URL: https://github.com/apache/spark/pull/26153#discussion_r336458516 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #26155: [SPARK-27879][SQL] Add support for bit_and and bit_or aggregates

2019-10-18 Thread GitBox
AmplabJenkins removed a comment on issue #26155: [SPARK-27879][SQL] Add support for bit_and and bit_or aggregates URL: https://github.com/apache/spark/pull/26155#issuecomment-543712944 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26155: [SPARK-27879][SQL] Add support for bit_and and bit_or aggregates

2019-10-18 Thread GitBox
AmplabJenkins commented on issue #26155: [SPARK-27879][SQL] Add support for bit_and and bit_or aggregates URL: https://github.com/apache/spark/pull/26155#issuecomment-543712944 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #26155: [SPARK-27879][SQL] Add support for bit_and and bit_or aggregates

2019-10-18 Thread GitBox
AmplabJenkins removed a comment on issue #26155: [SPARK-27879][SQL] Add support for bit_and and bit_or aggregates URL: https://github.com/apache/spark/pull/26155#issuecomment-543712952 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26155: [SPARK-27879][SQL] Add support for bit_and and bit_or aggregates

2019-10-18 Thread GitBox
AmplabJenkins commented on issue #26155: [SPARK-27879][SQL] Add support for bit_and and bit_or aggregates URL: https://github.com/apache/spark/pull/26155#issuecomment-543712952 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka

2019-10-18 Thread GitBox
gaborgsomogyi commented on a change in pull request #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka URL: https://github.com/apache/spark/pull/26153#discussion_r336470375 ## File path:

[GitHub] [spark] redsk commented on issue #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka

2019-10-18 Thread GitBox
redsk commented on issue #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka URL: https://github.com/apache/spark/pull/26153#issuecomment-543728279 > I've had a deeper look and I tend to agree to depend on micro-batch tests. So no more tests need on this

[GitHub] [spark] AmplabJenkins removed a comment on issue #26164: [SPARK-21492][SQL] Fix memory leak in SortMergeJoin

2019-10-18 Thread GitBox
AmplabJenkins removed a comment on issue #26164: [SPARK-21492][SQL] Fix memory leak in SortMergeJoin URL: https://github.com/apache/spark/pull/26164#issuecomment-543744519 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25870: [SPARK-27936][K8S] support python deps

2019-10-18 Thread GitBox
AmplabJenkins commented on issue #25870: [SPARK-27936][K8S] support python deps URL: https://github.com/apache/spark/pull/25870#issuecomment-543754014 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25870: [SPARK-27936][K8S] support python deps

2019-10-18 Thread GitBox
AmplabJenkins commented on issue #25870: [SPARK-27936][K8S] support python deps URL: https://github.com/apache/spark/pull/25870#issuecomment-543754002 Merged build finished. Test FAILed. This is an automated message from the

[GitHub] [spark] SparkQA commented on issue #25870: [SPARK-27936][K8S] support python deps

2019-10-18 Thread GitBox
SparkQA commented on issue #25870: [SPARK-27936][K8S] support python deps URL: https://github.com/apache/spark/pull/25870#issuecomment-543753981 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/17258/

[GitHub] [spark] MaxGekk commented on a change in pull request #26151: [SPARK-29502][SQL] typed interval expression should fail for invalid format

2019-10-18 Thread GitBox
MaxGekk commented on a change in pull request #26151: [SPARK-29502][SQL] typed interval expression should fail for invalid format URL: https://github.com/apache/spark/pull/26151#discussion_r336497019 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #26165: [SPARK-29508][SQL] Implicitly cast strings in datetime arithmetic operations

2019-10-18 Thread GitBox
AmplabJenkins removed a comment on issue #26165: [SPARK-29508][SQL] Implicitly cast strings in datetime arithmetic operations URL: https://github.com/apache/spark/pull/26165#issuecomment-543765429 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #26165: [SPARK-29508][SQL] Implicitly cast strings in datetime arithmetic operations

2019-10-18 Thread GitBox
SparkQA removed a comment on issue #26165: [SPARK-29508][SQL] Implicitly cast strings in datetime arithmetic operations URL: https://github.com/apache/spark/pull/26165#issuecomment-543754816 **[Test build #112279 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #26165: [SPARK-29508][SQL] Implicitly cast strings in datetime arithmetic operations

2019-10-18 Thread GitBox
AmplabJenkins removed a comment on issue #26165: [SPARK-29508][SQL] Implicitly cast strings in datetime arithmetic operations URL: https://github.com/apache/spark/pull/26165#issuecomment-543765423 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #26160: [SPARK-29498][SQL] CatalogTable to HiveTable should not change the table's ownership

2019-10-18 Thread GitBox
SparkQA removed a comment on issue #26160: [SPARK-29498][SQL] CatalogTable to HiveTable should not change the table's ownership URL: https://github.com/apache/spark/pull/26160#issuecomment-543714990 **[Test build #112274 has

[GitHub] [spark] SparkQA commented on issue #26160: [SPARK-29498][SQL] CatalogTable to HiveTable should not change the table's ownership

2019-10-18 Thread GitBox
SparkQA commented on issue #26160: [SPARK-29498][SQL] CatalogTable to HiveTable should not change the table's ownership URL: https://github.com/apache/spark/pull/26160#issuecomment-543773562 **[Test build #112274 has

[GitHub] [spark] AmplabJenkins commented on issue #26080: [SPARK-29425][SQL] The ownership of a database should be respected

2019-10-18 Thread GitBox
AmplabJenkins commented on issue #26080: [SPARK-29425][SQL] The ownership of a database should be respected URL: https://github.com/apache/spark/pull/26080#issuecomment-543661959 Merged build finished. Test FAILed. This is

[GitHub] [spark] AmplabJenkins commented on issue #26080: [SPARK-29425][SQL] The ownership of a database should be respected

2019-10-18 Thread GitBox
AmplabJenkins commented on issue #26080: [SPARK-29425][SQL] The ownership of a database should be respected URL: https://github.com/apache/spark/pull/26080#issuecomment-543661968 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26163: [MINOR][DOCS] Fix incorrect EqualNullSafe symbol in sql-migration-guide.md

2019-10-18 Thread GitBox
AmplabJenkins commented on issue #26163: [MINOR][DOCS] Fix incorrect EqualNullSafe symbol in sql-migration-guide.md URL: https://github.com/apache/spark/pull/26163#issuecomment-543662175 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26163: [MINOR][DOCS] Fix incorrect EqualNullSafe symbol in sql-migration-guide.md

2019-10-18 Thread GitBox
AmplabJenkins commented on issue #26163: [MINOR][DOCS] Fix incorrect EqualNullSafe symbol in sql-migration-guide.md URL: https://github.com/apache/spark/pull/26163#issuecomment-543662158 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26080: [SPARK-29425][SQL] The ownership of a database should be respected

2019-10-18 Thread GitBox
AmplabJenkins removed a comment on issue #26080: [SPARK-29425][SQL] The ownership of a database should be respected URL: https://github.com/apache/spark/pull/26080#issuecomment-543661959 Merged build finished. Test FAILed.

[GitHub] [spark] HeartSaVioR opened a new pull request #26162: [SPARK-29438][SS] Use partition ID of source for state store in stream-stream join

2019-10-18 Thread GitBox
HeartSaVioR opened a new pull request #26162: [SPARK-29438][SS] Use partition ID of source for state store in stream-stream join URL: https://github.com/apache/spark/pull/26162 ### What changes were proposed in this pull request? Credit to @uncleGen for discovering the problem and

[GitHub] [spark] wangyum opened a new pull request #26163: [MINOR][DOCS] Fix incorrect EqualNullSafe symbol in sql-migration-guide.md

2019-10-18 Thread GitBox
wangyum opened a new pull request #26163: [MINOR][DOCS] Fix incorrect EqualNullSafe symbol in sql-migration-guide.md URL: https://github.com/apache/spark/pull/26163 ### What changes were proposed in this pull request? This PR fixes the incorrect `EqualNullSafe` symbol in

[GitHub] [spark] SparkQA commented on issue #26080: [SPARK-29425][SQL] The ownership of a database should be respected

2019-10-18 Thread GitBox
SparkQA commented on issue #26080: [SPARK-29425][SQL] The ownership of a database should be respected URL: https://github.com/apache/spark/pull/26080#issuecomment-543661691 **[Test build #112267 has

[GitHub] [spark] SparkQA removed a comment on issue #26080: [SPARK-29425][SQL] The ownership of a database should be respected

2019-10-18 Thread GitBox
SparkQA removed a comment on issue #26080: [SPARK-29425][SQL] The ownership of a database should be respected URL: https://github.com/apache/spark/pull/26080#issuecomment-543605266 **[Test build #112267 has

[GitHub] [spark] krishna-pandey commented on issue #26131: [SPARK-29483][BUILD] Bump Jackson to 2.10.0

2019-10-18 Thread GitBox
krishna-pandey commented on issue #26131: [SPARK-29483][BUILD] Bump Jackson to 2.10.0 URL: https://github.com/apache/spark/pull/26131#issuecomment-543677010 @srowen What's the issue in upgrading Jackson in 2.4? This is an

[GitHub] [spark] AmplabJenkins commented on issue #26157: [SPARK-28560][SQL][followup] resolve the remaining comments for PR#25295

2019-10-18 Thread GitBox
AmplabJenkins commented on issue #26157: [SPARK-28560][SQL][followup] resolve the remaining comments for PR#25295 URL: https://github.com/apache/spark/pull/26157#issuecomment-543690455 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26157: [SPARK-28560][SQL][followup] resolve the remaining comments for PR#25295

2019-10-18 Thread GitBox
AmplabJenkins commented on issue #26157: [SPARK-28560][SQL][followup] resolve the remaining comments for PR#25295 URL: https://github.com/apache/spark/pull/26157#issuecomment-543690465 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #26157: [SPARK-28560][SQL][followup] resolve the remaining comments for PR#25295

2019-10-18 Thread GitBox
SparkQA commented on issue #26157: [SPARK-28560][SQL][followup] resolve the remaining comments for PR#25295 URL: https://github.com/apache/spark/pull/26157#issuecomment-543689725 **[Test build #112264 has

[GitHub] [spark] SparkQA removed a comment on issue #26157: [SPARK-28560][SQL][followup] resolve the remaining comments for PR#25295

2019-10-18 Thread GitBox
SparkQA removed a comment on issue #26157: [SPARK-28560][SQL][followup] resolve the remaining comments for PR#25295 URL: https://github.com/apache/spark/pull/26157#issuecomment-543581244 **[Test build #112264 has

[GitHub] [spark] redsk commented on a change in pull request #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka

2019-10-18 Thread GitBox
redsk commented on a change in pull request #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka URL: https://github.com/apache/spark/pull/26153#discussion_r336450456 ## File path: docs/structured-streaming-kafka-integration.md ## @@ -622,6

[GitHub] [spark] redsk commented on a change in pull request #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka

2019-10-18 Thread GitBox
redsk commented on a change in pull request #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka URL: https://github.com/apache/spark/pull/26153#discussion_r336456840 ## File path:

[GitHub] [spark] redsk commented on a change in pull request #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka

2019-10-18 Thread GitBox
redsk commented on a change in pull request #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka URL: https://github.com/apache/spark/pull/26153#discussion_r336456840 ## File path:

[GitHub] [spark] redsk commented on a change in pull request #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka

2019-10-18 Thread GitBox
redsk commented on a change in pull request #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka URL: https://github.com/apache/spark/pull/26153#discussion_r336456840 ## File path:

[GitHub] [spark] SparkQA commented on issue #26160: [SPARK-29498][SQL] CatalogTable to HiveTable should not change the table's ownership

2019-10-18 Thread GitBox
SparkQA commented on issue #26160: [SPARK-29498][SQL] CatalogTable to HiveTable should not change the table's ownership URL: https://github.com/apache/spark/pull/26160#issuecomment-543714990 **[Test build #112274 has

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka

2019-10-18 Thread GitBox
gaborgsomogyi commented on a change in pull request #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka URL: https://github.com/apache/spark/pull/26153#discussion_r336464599 ## File path:

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka

2019-10-18 Thread GitBox
gaborgsomogyi commented on a change in pull request #26153: [SPARK-29500][SQL][SS] Support partition column when writing to Kafka URL: https://github.com/apache/spark/pull/26153#discussion_r336464855 ## File path:

[GitHub] [spark] SparkQA commented on issue #25870: [SPARK-27936][K8S] support python deps

2019-10-18 Thread GitBox
SparkQA commented on issue #25870: [SPARK-27936][K8S] support python deps URL: https://github.com/apache/spark/pull/25870#issuecomment-543718951 **[Test build #112275 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112275/testReport)** for PR 25870 at

<    1   2   3   4   5   6   7   8   9   10   >