[GitHub] [spark] HyukjinKwon commented on issue #25749: [SPARK-29041][PYTHON] Allows createDataFrame to accept bytes as binary type

2019-09-12 Thread GitBox
HyukjinKwon commented on issue #25749: [SPARK-29041][PYTHON] Allows createDataFrame to accept bytes as binary type URL: https://github.com/apache/spark/pull/25749#issuecomment-530691141 I don't think so. Yes so It might be better do document that. We can start to work on that after

[GitHub] [spark] AmplabJenkins commented on issue #25770: [SPARK-29064][CORE] Add PrometheusResource to export Executor metrics

2019-09-12 Thread GitBox
AmplabJenkins commented on issue #25770: [SPARK-29064][CORE] Add PrometheusResource to export Executor metrics URL: https://github.com/apache/spark/pull/25770#issuecomment-530695947 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #25770: [SPARK-29064][CORE] Add PrometheusResource to export Executor metrics

2019-09-12 Thread GitBox
AmplabJenkins commented on issue #25770: [SPARK-29064][CORE] Add PrometheusResource to export Executor metrics URL: https://github.com/apache/spark/pull/25770#issuecomment-530695962 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25769: [SPARK-29032][CORE] Add PrometheusServlet to monitor Masster/Worker/Driver

2019-09-12 Thread GitBox
AmplabJenkins commented on issue #25769: [SPARK-29032][CORE] Add PrometheusServlet to monitor Masster/Worker/Driver URL: https://github.com/apache/spark/pull/25769#issuecomment-530695936 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25768: [SPARK-29063][SQL] Modify fillValue approach to support joined dataframe

2019-09-12 Thread GitBox
AmplabJenkins removed a comment on issue #25768: [SPARK-29063][SQL] Modify fillValue approach to support joined dataframe URL: https://github.com/apache/spark/pull/25768#issuecomment-530695537 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25768: [SPARK-29063][SQL] Modify fillValue approach to support joined dataframe

2019-09-12 Thread GitBox
AmplabJenkins removed a comment on issue #25768: [SPARK-29063][SQL] Modify fillValue approach to support joined dataframe URL: https://github.com/apache/spark/pull/25768#issuecomment-530695543 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25769: [SPARK-29032][CORE] Add PrometheusServlet to monitor Masster/Worker/Driver

2019-09-12 Thread GitBox
AmplabJenkins commented on issue #25769: [SPARK-29032][CORE] Add PrometheusServlet to monitor Masster/Worker/Driver URL: https://github.com/apache/spark/pull/25769#issuecomment-530695932 Merged build finished. Test PASSed.

[GitHub] [spark] MaxGekk commented on issue #25772: [SPARK-29065][SQL][TEST] Extend `EXTRACT` benchmark

2019-09-12 Thread GitBox
MaxGekk commented on issue #25772: [SPARK-29065][SQL][TEST] Extend `EXTRACT` benchmark URL: https://github.com/apache/spark/pull/25772#issuecomment-530696202 @dongjoon-hyun @cloud-fan @maropu Could you take a look at the PR. Should I extract cast-related code to a separate PR? WDYT?

[GitHub] [spark] AmplabJenkins removed a comment on issue #25770: [SPARK-29064][CORE] Add PrometheusResource to export Executor metrics

2019-09-12 Thread GitBox
AmplabJenkins removed a comment on issue #25770: [SPARK-29064][CORE] Add PrometheusResource to export Executor metrics URL: https://github.com/apache/spark/pull/25770#issuecomment-530695947 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25770: [SPARK-29064][CORE] Add PrometheusResource to export Executor metrics

2019-09-12 Thread GitBox
AmplabJenkins removed a comment on issue #25770: [SPARK-29064][CORE] Add PrometheusResource to export Executor metrics URL: https://github.com/apache/spark/pull/25770#issuecomment-530695962 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25769: [SPARK-29032][CORE] Add PrometheusServlet to monitor Masster/Worker/Driver

2019-09-12 Thread GitBox
AmplabJenkins removed a comment on issue #25769: [SPARK-29032][CORE] Add PrometheusServlet to monitor Masster/Worker/Driver URL: https://github.com/apache/spark/pull/25769#issuecomment-530695936 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] MaxGekk opened a new pull request #25772: [SPARK-29065][SQL][TEST] Extend `EXTRACT` benchmark

2019-09-12 Thread GitBox
MaxGekk opened a new pull request #25772: [SPARK-29065][SQL][TEST] Extend `EXTRACT` benchmark URL: https://github.com/apache/spark/pull/25772 ### What changes were proposed in this pull request? In the PR, I propose to extend `ExtractBenchmark` and add new ones for: - `EXTRACT`

[GitHub] [spark] dongjoon-hyun commented on issue #25769: [SPARK-29032][CORE] Add PrometheusServlet to monitor Masster/Worker/Driver

2019-09-12 Thread GitBox
dongjoon-hyun commented on issue #25769: [SPARK-29032][CORE] Add PrometheusServlet to monitor Masster/Worker/Driver URL: https://github.com/apache/spark/pull/25769#issuecomment-530695635 Retest this please This is an

[GitHub] [spark] dilipbiswal commented on issue #25595: [SPARK-28792][SQL][DOC] Document CREATE DATABASE statement in SQL Reference.

2019-09-12 Thread GitBox
dilipbiswal commented on issue #25595: [SPARK-28792][SQL][DOC] Document CREATE DATABASE statement in SQL Reference. URL: https://github.com/apache/spark/pull/25595#issuecomment-530699532 @sharangk Mostly looks good. I have put some minor comments.

[GitHub] [spark] dilipbiswal commented on a change in pull request #25595: [SPARK-28792][SQL][DOC] Document CREATE DATABASE statement in SQL Reference.

2019-09-12 Thread GitBox
dilipbiswal commented on a change in pull request #25595: [SPARK-28792][SQL][DOC] Document CREATE DATABASE statement in SQL Reference. URL: https://github.com/apache/spark/pull/25595#discussion_r323589132 ## File path: docs/sql-ref-syntax-ddl-create-database.md ## @@

[GitHub] [spark] wangyum closed pull request #25752: [SPARK-29045][SQL][TESTS] Drop table to avoid test failure in SQLMetricsSuite

2019-09-12 Thread GitBox
wangyum closed pull request #25752: [SPARK-29045][SQL][TESTS] Drop table to avoid test failure in SQLMetricsSuite URL: https://github.com/apache/spark/pull/25752 This is an automated message from the Apache Git Service. To

[GitHub] [spark] wangyum commented on issue #25752: [SPARK-29045][SQL][TESTS] Drop table to avoid test failure in SQLMetricsSuite

2019-09-12 Thread GitBox
wangyum commented on issue #25752: [SPARK-29045][SQL][TESTS] Drop table to avoid test failure in SQLMetricsSuite URL: https://github.com/apache/spark/pull/25752#issuecomment-530679513 Merged to master. This is an automated

[GitHub] [spark] dilipbiswal commented on a change in pull request #25595: [SPARK-28792][SQL][DOC] Document CREATE DATABASE statement in SQL Reference.

2019-09-12 Thread GitBox
dilipbiswal commented on a change in pull request #25595: [SPARK-28792][SQL][DOC] Document CREATE DATABASE statement in SQL Reference. URL: https://github.com/apache/spark/pull/25595#discussion_r323588378 ## File path: docs/sql-ref-syntax-ddl-create-database.md ## @@

[GitHub] [spark] AmplabJenkins removed a comment on issue #25772: [SPARK-29065][SQL][TEST] Extend `EXTRACT` benchmark

2019-09-12 Thread GitBox
AmplabJenkins removed a comment on issue #25772: [SPARK-29065][SQL][TEST] Extend `EXTRACT` benchmark URL: https://github.com/apache/spark/pull/25772#issuecomment-530698312 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #25772: [SPARK-29065][SQL][TEST] Extend `EXTRACT` benchmark

2019-09-12 Thread GitBox
AmplabJenkins removed a comment on issue #25772: [SPARK-29065][SQL][TEST] Extend `EXTRACT` benchmark URL: https://github.com/apache/spark/pull/25772#issuecomment-530698319 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #23531: [SPARK-24497][SQL] Support recursive SQL query

2019-09-12 Thread GitBox
SparkQA commented on issue #23531: [SPARK-24497][SQL] Support recursive SQL query URL: https://github.com/apache/spark/pull/23531#issuecomment-530698912 **[Test build #110505 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110505/testReport)** for PR 23531

[GitHub] [spark] dilipbiswal commented on a change in pull request #25595: [SPARK-28792][SQL][DOC] Document CREATE DATABASE statement in SQL Reference.

2019-09-12 Thread GitBox
dilipbiswal commented on a change in pull request #25595: [SPARK-28792][SQL][DOC] Document CREATE DATABASE statement in SQL Reference. URL: https://github.com/apache/spark/pull/25595#discussion_r323588632 ## File path: docs/sql-ref-syntax-ddl-create-database.md ## @@

[GitHub] [spark] cloud-fan commented on a change in pull request #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes

2019-09-12 Thread GitBox
cloud-fan commented on a change in pull request #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes URL: https://github.com/apache/spark/pull/25700#discussion_r323594355 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes

2019-09-12 Thread GitBox
cloud-fan commented on a change in pull request #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes URL: https://github.com/apache/spark/pull/25700#discussion_r323594522 ## File path:

[GitHub] [spark] dilipbiswal commented on a change in pull request #25533: [SPARK-28798][DOC][SQL]Document DROP TABLE/VIEW statement in SQL Reference.

2019-09-12 Thread GitBox
dilipbiswal commented on a change in pull request #25533: [SPARK-28798][DOC][SQL]Document DROP TABLE/VIEW statement in SQL Reference. URL: https://github.com/apache/spark/pull/25533#discussion_r323597220 ## File path: docs/sql-ref-syntax-ddl-drop-table.md ## @@ -19,4

[GitHub] [spark] AmplabJenkins removed a comment on issue #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes

2019-09-12 Thread GitBox
AmplabJenkins removed a comment on issue #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes URL: https://github.com/apache/spark/pull/25700#issuecomment-530705713 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes

2019-09-12 Thread GitBox
AmplabJenkins commented on issue #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes URL: https://github.com/apache/spark/pull/25700#issuecomment-530705721 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes

2019-09-12 Thread GitBox
AmplabJenkins commented on issue #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes URL: https://github.com/apache/spark/pull/25700#issuecomment-530705713 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes

2019-09-12 Thread GitBox
AmplabJenkins removed a comment on issue #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes URL: https://github.com/apache/spark/pull/25700#issuecomment-530705721 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25758: [SPARK-28856][FOLLOW-UP][SQL][TEST] Add the `namespaces` keyword to TableIdentifierParserSuite

2019-09-12 Thread GitBox
AmplabJenkins removed a comment on issue #25758: [SPARK-28856][FOLLOW-UP][SQL][TEST] Add the `namespaces` keyword to TableIdentifierParserSuite URL: https://github.com/apache/spark/pull/25758#issuecomment-530684322 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #25758: [SPARK-28856][FOLLOW-UP][SQL][TEST] Add the `namespaces` keyword to TableIdentifierParserSuite

2019-09-12 Thread GitBox
AmplabJenkins commented on issue #25758: [SPARK-28856][FOLLOW-UP][SQL][TEST] Add the `namespaces` keyword to TableIdentifierParserSuite URL: https://github.com/apache/spark/pull/25758#issuecomment-530684322 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] SparkQA removed a comment on issue #25758: [SPARK-28856][FOLLOW-UP][SQL][TEST] Add the `namespaces` keyword to TableIdentifierParserSuite

2019-09-12 Thread GitBox
SparkQA removed a comment on issue #25758: [SPARK-28856][FOLLOW-UP][SQL][TEST] Add the `namespaces` keyword to TableIdentifierParserSuite URL: https://github.com/apache/spark/pull/25758#issuecomment-530640733 **[Test build #110497 has

[GitHub] [spark] AmplabJenkins commented on issue #25758: [SPARK-28856][FOLLOW-UP][SQL][TEST] Add the `namespaces` keyword to TableIdentifierParserSuite

2019-09-12 Thread GitBox
AmplabJenkins commented on issue #25758: [SPARK-28856][FOLLOW-UP][SQL][TEST] Add the `namespaces` keyword to TableIdentifierParserSuite URL: https://github.com/apache/spark/pull/25758#issuecomment-530684317 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25758: [SPARK-28856][FOLLOW-UP][SQL][TEST] Add the `namespaces` keyword to TableIdentifierParserSuite

2019-09-12 Thread GitBox
AmplabJenkins removed a comment on issue #25758: [SPARK-28856][FOLLOW-UP][SQL][TEST] Add the `namespaces` keyword to TableIdentifierParserSuite URL: https://github.com/apache/spark/pull/25758#issuecomment-530684317 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #25768: [SPARK-29063][SQL] Modify fillValue approach to support joined dataframe

2019-09-12 Thread GitBox
SparkQA commented on issue #25768: [SPARK-29063][SQL] Modify fillValue approach to support joined dataframe URL: https://github.com/apache/spark/pull/25768#issuecomment-530695037 **[Test build #110498 has

[GitHub] [spark] AmplabJenkins commented on issue #25768: [SPARK-29063][SQL] Modify fillValue approach to support joined dataframe

2019-09-12 Thread GitBox
AmplabJenkins commented on issue #25768: [SPARK-29063][SQL] Modify fillValue approach to support joined dataframe URL: https://github.com/apache/spark/pull/25768#issuecomment-530695543 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] dongjoon-hyun commented on issue #25770: [SPARK-29064][CORE] Add PrometheusResource to export Executor metrics

2019-09-12 Thread GitBox
dongjoon-hyun commented on issue #25770: [SPARK-29064][CORE] Add PrometheusResource to export Executor metrics URL: https://github.com/apache/spark/pull/25770#issuecomment-530695566 Retest this please. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #25768: [SPARK-29063][SQL] Modify fillValue approach to support joined dataframe

2019-09-12 Thread GitBox
AmplabJenkins commented on issue #25768: [SPARK-29063][SQL] Modify fillValue approach to support joined dataframe URL: https://github.com/apache/spark/pull/25768#issuecomment-530695537 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #25768: [SPARK-29063][SQL] Modify fillValue approach to support joined dataframe

2019-09-12 Thread GitBox
SparkQA removed a comment on issue #25768: [SPARK-29063][SQL] Modify fillValue approach to support joined dataframe URL: https://github.com/apache/spark/pull/25768#issuecomment-530648993 **[Test build #110498 has

[GitHub] [spark] highmoutain commented on issue #25758: [SPARK-28856][FOLLOW-UP][SQL][TEST] Add the `namespaces` keyword to TableIdentifierParserSuite

2019-09-12 Thread GitBox
highmoutain commented on issue #25758: [SPARK-28856][FOLLOW-UP][SQL][TEST] Add the `namespaces` keyword to TableIdentifierParserSuite URL: https://github.com/apache/spark/pull/25758#issuecomment-530701042 hi @maropu , I think this is the only one missing.

[GitHub] [spark] dilipbiswal commented on a change in pull request #25533: [SPARK-28798][DOC][SQL]Document DROP TABLE/VIEW statement in SQL Reference.

2019-09-12 Thread GitBox
dilipbiswal commented on a change in pull request #25533: [SPARK-28798][DOC][SQL]Document DROP TABLE/VIEW statement in SQL Reference. URL: https://github.com/apache/spark/pull/25533#discussion_r323598276 ## File path: docs/sql-ref-syntax-ddl-drop-table.md ## @@ -19,4

[GitHub] [spark] dilipbiswal commented on a change in pull request #25533: [SPARK-28798][DOC][SQL]Document DROP TABLE/VIEW statement in SQL Reference.

2019-09-12 Thread GitBox
dilipbiswal commented on a change in pull request #25533: [SPARK-28798][DOC][SQL]Document DROP TABLE/VIEW statement in SQL Reference. URL: https://github.com/apache/spark/pull/25533#discussion_r323598186 ## File path: docs/sql-ref-syntax-ddl-drop-table.md ## @@ -19,4

[GitHub] [spark] amanomer commented on issue #25543: [SPARK-28795][DOC][SQL] Document CREATE VIEW statement in SQL Reference

2019-09-12 Thread GitBox
amanomer commented on issue #25543: [SPARK-28795][DOC][SQL] Document CREATE VIEW statement in SQL Reference URL: https://github.com/apache/spark/pull/25543#issuecomment-530707365 Working on this. Thanks for your feedback.

[GitHub] [spark] cloud-fan commented on issue #25772: [SPARK-29065][SQL][TEST] Extend `EXTRACT` benchmark

2019-09-12 Thread GitBox
cloud-fan commented on issue #25772: [SPARK-29065][SQL][TEST] Extend `EXTRACT` benchmark URL: https://github.com/apache/spark/pull/25772#issuecomment-530707191 I think long to timestamp is a legacy behavior and we shouldn't go further in this direction. If we do want to convert integrals

[GitHub] [spark] imback82 commented on a change in pull request #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

2019-09-12 Thread GitBox
imback82 commented on a change in pull request #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#discussion_r323556054 ## File path:

[GitHub] [spark] SparkQA commented on issue #25758: [SPARK-28856][FOLLOW-UP][SQL][TEST] Add the `namespaces` keyword to TableIdentifierParserSuite

2019-09-12 Thread GitBox
SparkQA commented on issue #25758: [SPARK-28856][FOLLOW-UP][SQL][TEST] Add the `namespaces` keyword to TableIdentifierParserSuite URL: https://github.com/apache/spark/pull/25758#issuecomment-530683828 **[Test build #110497 has

[GitHub] [spark] dilipbiswal commented on a change in pull request #25595: [SPARK-28792][SQL][DOC] Document CREATE DATABASE statement in SQL Reference.

2019-09-12 Thread GitBox
dilipbiswal commented on a change in pull request #25595: [SPARK-28792][SQL][DOC] Document CREATE DATABASE statement in SQL Reference. URL: https://github.com/apache/spark/pull/25595#discussion_r323586751 ## File path: docs/sql-ref-syntax-ddl-create-database.md ## @@

[GitHub] [spark] dilipbiswal commented on a change in pull request #25595: [SPARK-28792][SQL][DOC] Document CREATE DATABASE statement in SQL Reference.

2019-09-12 Thread GitBox
dilipbiswal commented on a change in pull request #25595: [SPARK-28792][SQL][DOC] Document CREATE DATABASE statement in SQL Reference. URL: https://github.com/apache/spark/pull/25595#discussion_r323586875 ## File path: docs/sql-ref-syntax-ddl-create-database.md ## @@

[GitHub] [spark] maropu commented on issue #25758: [SPARK-28856][FOLLOW-UP][SQL][TEST] Add the `namespaces` keyword to TableIdentifierParserSuite

2019-09-12 Thread GitBox
maropu commented on issue #25758: [SPARK-28856][FOLLOW-UP][SQL][TEST] Add the `namespaces` keyword to TableIdentifierParserSuite URL: https://github.com/apache/spark/pull/25758#issuecomment-530696887 Thanks for your help, @highmoutain. This is only one missing entry there?

[GitHub] [spark] AmplabJenkins removed a comment on issue #23531: [SPARK-24497][SQL] Support recursive SQL query

2019-09-12 Thread GitBox
AmplabJenkins removed a comment on issue #23531: [SPARK-24497][SQL] Support recursive SQL query URL: https://github.com/apache/spark/pull/23531#issuecomment-530700812 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #23531: [SPARK-24497][SQL] Support recursive SQL query

2019-09-12 Thread GitBox
AmplabJenkins commented on issue #23531: [SPARK-24497][SQL] Support recursive SQL query URL: https://github.com/apache/spark/pull/23531#issuecomment-530700812 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #23531: [SPARK-24497][SQL] Support recursive SQL query

2019-09-12 Thread GitBox
AmplabJenkins removed a comment on issue #23531: [SPARK-24497][SQL] Support recursive SQL query URL: https://github.com/apache/spark/pull/23531#issuecomment-530700808 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #23531: [SPARK-24497][SQL] Support recursive SQL query

2019-09-12 Thread GitBox
AmplabJenkins commented on issue #23531: [SPARK-24497][SQL] Support recursive SQL query URL: https://github.com/apache/spark/pull/23531#issuecomment-530700808 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] maropu commented on issue #25772: [SPARK-29065][SQL][TEST] Extend `EXTRACT` benchmark

2019-09-12 Thread GitBox
maropu commented on issue #25772: [SPARK-29065][SQL][TEST] Extend `EXTRACT` benchmark URL: https://github.com/apache/spark/pull/25772#issuecomment-530700815 Ur, I see. I didn't notice we've already accepted explicit casts from long to timestamp though, any reason to support this explicit

[GitHub] [spark] dilipbiswal commented on issue #25543: [SPARK-28795][DOC][SQL] Document CREATE VIEW statement in SQL Reference

2019-09-12 Thread GitBox
dilipbiswal commented on issue #25543: [SPARK-28795][DOC][SQL] Document CREATE VIEW statement in SQL Reference URL: https://github.com/apache/spark/pull/25543#issuecomment-530700649 gentle ping @amanomer This is an

[GitHub] [spark] dilipbiswal commented on issue #25553: [SPARK-28797][DOC] Document DROP FUNCTION statement in SQL Reference.

2019-09-12 Thread GitBox
dilipbiswal commented on issue #25553: [SPARK-28797][DOC] Document DROP FUNCTION statement in SQL Reference. URL: https://github.com/apache/spark/pull/25553#issuecomment-530704528 @sandeep-katta Hello, could you please update this by following the convention of existing merged PRS. Thanks

[GitHub] [spark] rednaxelafx commented on a change in pull request #25766: [SPARK-29061][SQL] Prints bytecode statistics in debugCodegen

2019-09-12 Thread GitBox
rednaxelafx commented on a change in pull request #25766: [SPARK-29061][SQL] Prints bytecode statistics in debugCodegen URL: https://github.com/apache/spark/pull/25766#discussion_r323573008 ## File path:

[GitHub] [spark] rednaxelafx commented on a change in pull request #25766: [SPARK-29061][SQL] Prints bytecode statistics in debugCodegen

2019-09-12 Thread GitBox
rednaxelafx commented on a change in pull request #25766: [SPARK-29061][SQL] Prints bytecode statistics in debugCodegen URL: https://github.com/apache/spark/pull/25766#discussion_r323572401 ## File path:

[GitHub] [spark] wangyum commented on issue #25758: [SPARK-28856][FOLLOW-UP][SQL][TEST] Add the `namespaces` keyword to TableIdentifierParserSuite

2019-09-12 Thread GitBox
wangyum commented on issue #25758: [SPARK-28856][FOLLOW-UP][SQL][TEST] Add the `namespaces` keyword to TableIdentifierParserSuite URL: https://github.com/apache/spark/pull/25758#issuecomment-530684685 cc @maropu This is an

[GitHub] [spark] dilipbiswal commented on a change in pull request #25606: [SPARK-28814][SQL][DOC] Document SET/RESET in SQL Reference

2019-09-12 Thread GitBox
dilipbiswal commented on a change in pull request #25606: [SPARK-28814][SQL][DOC] Document SET/RESET in SQL Reference URL: https://github.com/apache/spark/pull/25606#discussion_r323576810 ## File path: docs/sql-ref-syntax-aux-conf-mgmt-set.md ## @@ -19,4 +19,51 @@

[GitHub] [spark] dilipbiswal commented on a change in pull request #25606: [SPARK-28814][SQL][DOC] Document SET/RESET in SQL Reference

2019-09-12 Thread GitBox
dilipbiswal commented on a change in pull request #25606: [SPARK-28814][SQL][DOC] Document SET/RESET in SQL Reference URL: https://github.com/apache/spark/pull/25606#discussion_r323577740 ## File path: docs/sql-ref-syntax-aux-conf-mgmt-set.md ## @@ -19,4 +19,51 @@

[GitHub] [spark] dilipbiswal commented on a change in pull request #25606: [SPARK-28814][SQL][DOC] Document SET/RESET in SQL Reference

2019-09-12 Thread GitBox
dilipbiswal commented on a change in pull request #25606: [SPARK-28814][SQL][DOC] Document SET/RESET in SQL Reference URL: https://github.com/apache/spark/pull/25606#discussion_r323576968 ## File path: docs/sql-ref-syntax-aux-conf-mgmt-set.md ## @@ -19,4 +19,51 @@

[GitHub] [spark] dilipbiswal commented on a change in pull request #25606: [SPARK-28814][SQL][DOC] Document SET/RESET in SQL Reference

2019-09-12 Thread GitBox
dilipbiswal commented on a change in pull request #25606: [SPARK-28814][SQL][DOC] Document SET/RESET in SQL Reference URL: https://github.com/apache/spark/pull/25606#discussion_r323577090 ## File path: docs/sql-ref-syntax-aux-conf-mgmt-set.md ## @@ -19,4 +19,51 @@

[GitHub] [spark] SparkQA commented on issue #25769: [SPARK-29032][CORE] Add PrometheusServlet to monitor Masster/Worker/Driver

2019-09-12 Thread GitBox
SparkQA commented on issue #25769: [SPARK-29032][CORE] Add PrometheusServlet to monitor Masster/Worker/Driver URL: https://github.com/apache/spark/pull/25769#issuecomment-530696591 **[Test build #110504 has

[GitHub] [spark] SparkQA commented on issue #25770: [SPARK-29064][CORE] Add PrometheusResource to export Executor metrics

2019-09-12 Thread GitBox
SparkQA commented on issue #25770: [SPARK-29064][CORE] Add PrometheusResource to export Executor metrics URL: https://github.com/apache/spark/pull/25770#issuecomment-530696594 **[Test build #110503 has

[GitHub] [spark] SparkQA commented on issue #25772: [SPARK-29065][SQL][TEST] Extend `EXTRACT` benchmark

2019-09-12 Thread GitBox
SparkQA commented on issue #25772: [SPARK-29065][SQL][TEST] Extend `EXTRACT` benchmark URL: https://github.com/apache/spark/pull/25772#issuecomment-530696600 **[Test build #110502 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110502/testReport)** for PR

[GitHub] [spark] AmplabJenkins removed a comment on issue #25769: [SPARK-29032][CORE] Add PrometheusServlet to monitor Masster/Worker/Driver

2019-09-12 Thread GitBox
AmplabJenkins removed a comment on issue #25769: [SPARK-29032][CORE] Add PrometheusServlet to monitor Masster/Worker/Driver URL: https://github.com/apache/spark/pull/25769#issuecomment-530695932 Merged build finished. Test PASSed.

[GitHub] [spark] maropu commented on issue #25772: [SPARK-29065][SQL][TEST] Extend `EXTRACT` benchmark

2019-09-12 Thread GitBox
maropu commented on issue #25772: [SPARK-29065][SQL][TEST] Extend `EXTRACT` benchmark URL: https://github.com/apache/spark/pull/25772#issuecomment-530702729 hahaha, I was faster This is an automated message from the Apache

[GitHub] [spark] cloud-fan commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-12 Thread GitBox
cloud-fan commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530703027 Do we have any queries return wrong result because of it? for round-robin partitioner, it

[GitHub] [spark] dongjoon-hyun commented on issue #25772: [SPARK-29065][SQL][TEST] Extend `EXTRACT` benchmark

2019-09-12 Thread GitBox
dongjoon-hyun commented on issue #25772: [SPARK-29065][SQL][TEST] Extend `EXTRACT` benchmark URL: https://github.com/apache/spark/pull/25772#issuecomment-530702549 Oops. I'm late. :) This is an automated message from the

[GitHub] [spark] dilipbiswal commented on a change in pull request #25533: [SPARK-28798][DOC][SQL]Document DROP TABLE/VIEW statement in SQL Reference.

2019-09-12 Thread GitBox
dilipbiswal commented on a change in pull request #25533: [SPARK-28798][DOC][SQL]Document DROP TABLE/VIEW statement in SQL Reference. URL: https://github.com/apache/spark/pull/25533#discussion_r323597961 ## File path: docs/sql-ref-syntax-ddl-drop-table.md ## @@ -19,4

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server

2019-09-12 Thread GitBox
dongjoon-hyun commented on a change in pull request #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server URL: https://github.com/apache/spark/pull/25705#discussion_r323597824 ## File path:

[GitHub] [spark] SparkQA commented on issue #25734: [SPARK-28939][SQL][2.4] Propagate SQLConf for plans executed by toRdd

2019-09-12 Thread GitBox
SparkQA commented on issue #25734: [SPARK-28939][SQL][2.4] Propagate SQLConf for plans executed by toRdd URL: https://github.com/apache/spark/pull/25734#issuecomment-530706458 **[Test build #110506 has

[GitHub] [spark] SparkQA commented on issue #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes

2019-09-12 Thread GitBox
SparkQA commented on issue #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes URL: https://github.com/apache/spark/pull/25700#issuecomment-530706461 **[Test build #110507 has

[GitHub] [spark] imback82 commented on a change in pull request #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

2019-09-12 Thread GitBox
imback82 commented on a change in pull request #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#discussion_r323570611 ## File path:

[GitHub] [spark] zhengruifeng commented on a change in pull request #25715: [SPARK-28969][PYTHON][ML] OneVsRestParams parity between scala and python

2019-09-12 Thread GitBox
zhengruifeng commented on a change in pull request #25715: [SPARK-28969][PYTHON][ML] OneVsRestParams parity between scala and python URL: https://github.com/apache/spark/pull/25715#discussion_r323573836 ## File path: python/pyspark/ml/classification.py ## @@ -1959,6

[GitHub] [spark] MaxGekk commented on issue #25716: [SPARK-29012][SQL] Support special timestamp values

2019-09-12 Thread GitBox
MaxGekk commented on issue #25716: [SPARK-29012][SQL] Support special timestamp values URL: https://github.com/apache/spark/pull/25716#issuecomment-530697767 @maropu @dongjoon-hyun Can we continue with the PR or we are waiting for @gengliangwang 's

[GitHub] [spark] dilipbiswal commented on a change in pull request #25606: [SPARK-28814][SQL][DOC] Document SET/RESET in SQL Reference

2019-09-12 Thread GitBox
dilipbiswal commented on a change in pull request #25606: [SPARK-28814][SQL][DOC] Document SET/RESET in SQL Reference URL: https://github.com/apache/spark/pull/25606#discussion_r323582859 ## File path: docs/sql-ref-syntax-aux-conf-mgmt-reset.md ## @@ -19,4 +19,20 @@

[GitHub] [spark] AmplabJenkins commented on issue #25772: [SPARK-29065][SQL][TEST] Extend `EXTRACT` benchmark

2019-09-12 Thread GitBox
AmplabJenkins commented on issue #25772: [SPARK-29065][SQL][TEST] Extend `EXTRACT` benchmark URL: https://github.com/apache/spark/pull/25772#issuecomment-530698312 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #25772: [SPARK-29065][SQL][TEST] Extend `EXTRACT` benchmark

2019-09-12 Thread GitBox
AmplabJenkins commented on issue #25772: [SPARK-29065][SQL][TEST] Extend `EXTRACT` benchmark URL: https://github.com/apache/spark/pull/25772#issuecomment-530698319 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25772: [SPARK-29065][SQL][TEST] Extend `EXTRACT` benchmark

2019-09-12 Thread GitBox
AmplabJenkins commented on issue #25772: [SPARK-29065][SQL][TEST] Extend `EXTRACT` benchmark URL: https://github.com/apache/spark/pull/25772#issuecomment-530697981 Can one of the admins verify this patch? This is an

[GitHub] [spark] MaxGekk commented on issue #25708: [SPARK-28141][SQL] Support special date values

2019-09-12 Thread GitBox
MaxGekk commented on issue #25708: [SPARK-28141][SQL] Support special date values URL: https://github.com/apache/spark/pull/25708#issuecomment-530698149 @maropu @dongjoon-hyun Here is the same question as in https://github.com/apache/spark/pull/25716#issuecomment-530697767

[GitHub] [spark] dilipbiswal commented on issue #25554: [SPARK-28796][DOC]Document DROP DATABASE statement in SQL Reference

2019-09-12 Thread GitBox
dilipbiswal commented on issue #25554: [SPARK-28796][DOC]Document DROP DATABASE statement in SQL Reference URL: https://github.com/apache/spark/pull/25554#issuecomment-530701754 @sandeep-katta Hey, could you please update this by following the convention of existing merged PRS.

[GitHub] [spark] AmplabJenkins commented on issue #25734: [SPARK-28939][SQL][2.4] Propagate SQLConf for plans executed by toRdd

2019-09-12 Thread GitBox
AmplabJenkins commented on issue #25734: [SPARK-28939][SQL][2.4] Propagate SQLConf for plans executed by toRdd URL: https://github.com/apache/spark/pull/25734#issuecomment-530708406 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #25734: [SPARK-28939][SQL][2.4] Propagate SQLConf for plans executed by toRdd

2019-09-12 Thread GitBox
AmplabJenkins commented on issue #25734: [SPARK-28939][SQL][2.4] Propagate SQLConf for plans executed by toRdd URL: https://github.com/apache/spark/pull/25734#issuecomment-530708418 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] dilipbiswal commented on a change in pull request #25533: [SPARK-28798][DOC][SQL]Document DROP TABLE/VIEW statement in SQL Reference.

2019-09-12 Thread GitBox
dilipbiswal commented on a change in pull request #25533: [SPARK-28798][DOC][SQL]Document DROP TABLE/VIEW statement in SQL Reference. URL: https://github.com/apache/spark/pull/25533#discussion_r323598753 ## File path: docs/sql-ref-syntax-ddl-drop-table.md ## @@ -19,4

[GitHub] [spark] cloud-fan commented on a change in pull request #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

2019-09-12 Thread GitBox
cloud-fan commented on a change in pull request #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#discussion_r323602010 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

2019-09-12 Thread GitBox
cloud-fan commented on a change in pull request #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#discussion_r323601154 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

2019-09-12 Thread GitBox
cloud-fan commented on a change in pull request #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#discussion_r323605731 ## File path:

[GitHub] [spark] wenxuanguan commented on issue #25618: [SPARK-28908][SS]Implement Kafka EOS sink for Structured Streaming

2019-09-12 Thread GitBox
wenxuanguan commented on issue #25618: [SPARK-28908][SS]Implement Kafka EOS sink for Structured Streaming URL: https://github.com/apache/spark/pull/25618#issuecomment-530713693 @gaborgsomogyi @HeartSaVioR Thanks for your reply. About transaction timeout, as described above and in the

[GitHub] [spark] maropu commented on a change in pull request #25766: [SPARK-29061][SQL] Prints bytecode statistics in debugCodegen

2019-09-12 Thread GitBox
maropu commented on a change in pull request #25766: [SPARK-29061][SQL] Prints bytecode statistics in debugCodegen URL: https://github.com/apache/spark/pull/25766#discussion_r323605070 ## File path:

[GitHub] [spark] hvanhovell commented on a change in pull request #25734: [SPARK-28939][SQL][2.4] Propagate SQLConf for plans executed by toRdd

2019-09-12 Thread GitBox
hvanhovell commented on a change in pull request #25734: [SPARK-28939][SQL][2.4] Propagate SQLConf for plans executed by toRdd URL: https://github.com/apache/spark/pull/25734#discussion_r323613828 ## File path: docs/sql-migration-guide-upgrade.md ## @@ -7,6 +7,12 @@

[GitHub] [spark] cloud-fan commented on a change in pull request #25764: [SPARK-29060][SQL] Add tree traversal helper for adaptive spark plans

2019-09-12 Thread GitBox
cloud-fan commented on a change in pull request #25764: [SPARK-29060][SQL] Add tree traversal helper for adaptive spark plans URL: https://github.com/apache/spark/pull/25764#discussion_r323620022 ## File path:

[GitHub] [spark] hvanhovell commented on a change in pull request #25734: [SPARK-28939][SQL][2.4] Propagate SQLConf for plans executed by toRdd

2019-09-12 Thread GitBox
hvanhovell commented on a change in pull request #25734: [SPARK-28939][SQL][2.4] Propagate SQLConf for plans executed by toRdd URL: https://github.com/apache/spark/pull/25734#discussion_r323628670 ## File path:

[GitHub] [spark] SparkQA commented on issue #25769: [SPARK-29032][CORE] Add PrometheusServlet to monitor Master/Worker/Driver

2019-09-12 Thread GitBox
SparkQA commented on issue #25769: [SPARK-29032][CORE] Add PrometheusServlet to monitor Master/Worker/Driver URL: https://github.com/apache/spark/pull/25769#issuecomment-530732652 **[Test build #110504 has

[GitHub] [spark] AmplabJenkins commented on issue #25769: [SPARK-29032][CORE] Add PrometheusServlet to monitor Master/Worker/Driver

2019-09-12 Thread GitBox
AmplabJenkins commented on issue #25769: [SPARK-29032][CORE] Add PrometheusServlet to monitor Master/Worker/Driver URL: https://github.com/apache/spark/pull/25769#issuecomment-530732985 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25769: [SPARK-29032][CORE] Add PrometheusServlet to monitor Master/Worker/Driver

2019-09-12 Thread GitBox
AmplabJenkins commented on issue #25769: [SPARK-29032][CORE] Add PrometheusServlet to monitor Master/Worker/Driver URL: https://github.com/apache/spark/pull/25769#issuecomment-530732976 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #25770: [SPARK-29064][CORE] Add PrometheusResource to export Executor metrics

2019-09-12 Thread GitBox
AmplabJenkins commented on issue #25770: [SPARK-29064][CORE] Add PrometheusResource to export Executor metrics URL: https://github.com/apache/spark/pull/25770#issuecomment-530744422 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #25770: [SPARK-29064][CORE] Add PrometheusResource to export Executor metrics

2019-09-12 Thread GitBox
AmplabJenkins commented on issue #25770: [SPARK-29064][CORE] Add PrometheusResource to export Executor metrics URL: https://github.com/apache/spark/pull/25770#issuecomment-530744429 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25754: [SPARK-29048] Improve performance on Column.isInCollection() with a large size collection

2019-09-12 Thread GitBox
AmplabJenkins removed a comment on issue #25754: [SPARK-29048] Improve performance on Column.isInCollection() with a large size collection URL: https://github.com/apache/spark/pull/25754#issuecomment-530750818 Test PASSed. Refer to this link for build results (access rights to CI server

  1   2   3   4   5   6   7   8   9   10   >