[GitHub] [spark] SparkQA commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-11 Thread GitBox
SparkQA commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530497294 **[Test build #110479 has

[GitHub] [spark] maryannxue opened a new pull request #25764: [SPARK-29060][SQL] Add tree traversal helper for adaptive spark plans

2019-09-11 Thread GitBox
maryannxue opened a new pull request #25764: [SPARK-29060][SQL] Add tree traversal helper for adaptive spark plans URL: https://github.com/apache/spark/pull/25764 ### What changes were proposed in this pull request? This PR adds a utility class `AdaptiveSparkPlanHelper` which provides

[GitHub] [spark] vanzin closed pull request #25725: [SPARK-24663][STREAMING][TESTS] StreamingContextSuite: Wait until slow receiver has been initialized, but with hard timeout

2019-09-11 Thread GitBox
vanzin closed pull request #25725: [SPARK-24663][STREAMING][TESTS] StreamingContextSuite: Wait until slow receiver has been initialized, but with hard timeout URL: https://github.com/apache/spark/pull/25725 This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #25632: [SPARK-28809][DOC][SQL]Document SHOW TABLE in SQL Reference

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25632: [SPARK-28809][DOC][SQL]Document SHOW TABLE in SQL Reference URL: https://github.com/apache/spark/pull/25632#issuecomment-526582292 Can one of the admins verify this patch?

[GitHub] [spark] SparkQA commented on issue #25753: [SPARK-29046][SQL] Fix NPE in SQLConf.get when active SparkContext is stopping

2019-09-11 Thread GitBox
SparkQA commented on issue #25753: [SPARK-29046][SQL] Fix NPE in SQLConf.get when active SparkContext is stopping URL: https://github.com/apache/spark/pull/25753#issuecomment-530557497 **[Test build #110485 has

[GitHub] [spark] planga82 commented on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab

2019-09-11 Thread GitBox
planga82 commented on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab URL: https://github.com/apache/spark/pull/25723#issuecomment-530557494 the tests has failed but in two tests that don't have any relation with my last changes. Someone knows if it is normal?

[GitHub] [spark] HeartSaVioR commented on a change in pull request #23952: [SPARK-26929][SQL]fix table owner use user instead of principal when create table through spark-sql or beeline

2019-09-11 Thread GitBox
HeartSaVioR commented on a change in pull request #23952: [SPARK-26929][SQL]fix table owner use user instead of principal when create table through spark-sql or beeline URL: https://github.com/apache/spark/pull/23952#discussion_r323449732 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #25741: [SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet/Resource

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25741: [SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet/Resource URL: https://github.com/apache/spark/pull/25741#issuecomment-530565164 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #25741: [SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet/Resource

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25741: [SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet/Resource URL: https://github.com/apache/spark/pull/25741#issuecomment-530565157 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #25763: [SPARK-29057][SQL] remove InsertIntoTable

2019-09-11 Thread GitBox
SparkQA commented on issue #25763: [SPARK-29057][SQL] remove InsertIntoTable URL: https://github.com/apache/spark/pull/25763#issuecomment-530565863 **[Test build #110481 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110481/testReport)** for PR 25763 at

[GitHub] [spark] SparkQA commented on issue #25718: [SPARK-28373][DOCS][WebUI] JDBC/ODBC Server Tab

2019-09-11 Thread GitBox
SparkQA commented on issue #25718: [SPARK-28373][DOCS][WebUI] JDBC/ODBC Server Tab URL: https://github.com/apache/spark/pull/25718#issuecomment-530565871 **[Test build #110487 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110487/testReport)** for PR

[GitHub] [spark] viirya commented on a change in pull request #25763: [SPARK-29057][SQL] remove InsertIntoTable

2019-09-11 Thread GitBox
viirya commented on a change in pull request #25763: [SPARK-29057][SQL] remove InsertIntoTable URL: https://github.com/apache/spark/pull/25763#discussion_r323469867 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/basicLogicalOperators.scala

[GitHub] [spark] brkyvz commented on issue #25735: [SPARK-29030][SQL] Simplify lookupV2Relation

2019-09-11 Thread GitBox
brkyvz commented on issue #25735: [SPARK-29030][SQL] Simplify lookupV2Relation URL: https://github.com/apache/spark/pull/25735#issuecomment-530574922 retest this please This is an automated message from the Apache Git

[GitHub] [spark] brkyvz commented on a change in pull request #25735: [SPARK-29030][SQL] Simplify lookupV2Relation

2019-09-11 Thread GitBox
brkyvz commented on a change in pull request #25735: [SPARK-29030][SQL] Simplify lookupV2Relation URL: https://github.com/apache/spark/pull/25735#discussion_r323469202 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala ## @@

[GitHub] [spark] AmplabJenkins commented on issue #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes

2019-09-11 Thread GitBox
AmplabJenkins commented on issue #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes URL: https://github.com/apache/spark/pull/25700#issuecomment-530580303 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes URL: https://github.com/apache/spark/pull/25700#issuecomment-530580297 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes

2019-09-11 Thread GitBox
AmplabJenkins commented on issue #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes URL: https://github.com/apache/spark/pull/25700#issuecomment-530580297 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes URL: https://github.com/apache/spark/pull/25700#issuecomment-530580303 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes

2019-09-11 Thread GitBox
SparkQA removed a comment on issue #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes URL: https://github.com/apache/spark/pull/25700#issuecomment-530491349 **[Test build #110483 has

[GitHub] [spark] holdenk opened a new pull request #25765: [SPARK-28937][SPARK-28936][KUBERNETES] Reduce test flakyness

2019-09-11 Thread GitBox
holdenk opened a new pull request #25765: [SPARK-28937][SPARK-28936][KUBERNETES] Reduce test flakyness URL: https://github.com/apache/spark/pull/25765 ### What changes were proposed in this pull request? Switch from using a Thread sleep for waiting for commands to finish to just

[GitHub] [spark] SparkQA commented on issue #25765: [SPARK-28937][SPARK-28936][KUBERNETES] Reduce test flakyness

2019-09-11 Thread GitBox
SparkQA commented on issue #25765: [SPARK-28937][SPARK-28936][KUBERNETES] Reduce test flakyness URL: https://github.com/apache/spark/pull/25765#issuecomment-530593702 **[Test build #110490 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110490/testReport)**

[GitHub] [spark] cloud-fan opened a new pull request #25763: [SPARK-29057][SQL] remove InsertIntoTable

2019-09-11 Thread GitBox
cloud-fan opened a new pull request #25763: [SPARK-29057][SQL] remove InsertIntoTable URL: https://github.com/apache/spark/pull/25763 ### What changes were proposed in this pull request? Remove `InsertIntoTable` and replace it's usage by `InsertIntoStatement` ### Why

[GitHub] [spark] brkyvz commented on a change in pull request #25681: [SPARK-28612][SQL] Add DataFrameWriterV2 API

2019-09-11 Thread GitBox
brkyvz commented on a change in pull request #25681: [SPARK-28612][SQL] Add DataFrameWriterV2 API URL: https://github.com/apache/spark/pull/25681#discussion_r323452899 ## File path: sql/core/src/main/scala/org/apache/spark/sql/functions.scala ## @@ -3942,6 +3943,63 @@

[GitHub] [spark] brkyvz commented on a change in pull request #25763: [SPARK-29057][SQL] remove InsertIntoTable

2019-09-11 Thread GitBox
brkyvz commented on a change in pull request #25763: [SPARK-29057][SQL] remove InsertIntoTable URL: https://github.com/apache/spark/pull/25763#discussion_r323455575 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/basicLogicalOperators.scala

[GitHub] [spark] SparkQA commented on issue #25741: [SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet/Resource

2019-09-11 Thread GitBox
SparkQA commented on issue #25741: [SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet/Resource URL: https://github.com/apache/spark/pull/25741#issuecomment-530563138 **[Test build #110486 has

[GitHub] [spark] AmplabJenkins commented on issue #25741: [SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet/Resource

2019-09-11 Thread GitBox
AmplabJenkins commented on issue #25741: [SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet/Resource URL: https://github.com/apache/spark/pull/25741#issuecomment-530565164 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25741: [SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet/Resource

2019-09-11 Thread GitBox
AmplabJenkins commented on issue #25741: [SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet/Resource URL: https://github.com/apache/spark/pull/25741#issuecomment-530565157 Merged build finished. Test PASSed.

[GitHub] [spark] BryanCutler commented on issue #25749: [SPARK-29041][PYTHON] Allows createDataFrame to accept bytes as binary type

2019-09-11 Thread GitBox
BryanCutler commented on issue #25749: [SPARK-29041][PYTHON] Allows createDataFrame to accept bytes as binary type URL: https://github.com/apache/spark/pull/25749#issuecomment-530565191 @HyukjinKwon I think it was by design to only accept `bytearray` and not `bytes` in pyspark - possibly

[GitHub] [spark] SparkQA commented on issue #25753: [SPARK-29046][SQL] Fix NPE in SQLConf.get when active SparkContext is stopping

2019-09-11 Thread GitBox
SparkQA commented on issue #25753: [SPARK-29046][SQL] Fix NPE in SQLConf.get when active SparkContext is stopping URL: https://github.com/apache/spark/pull/25753#issuecomment-530587984 **[Test build #110489 has

[GitHub] [spark] SparkQA commented on issue #25758: [SPARK-28856][FOLLOW-UP][SQL][TEST] Add the `namespaces` keyword to TableIdentifierParserSuite

2019-09-11 Thread GitBox
SparkQA commented on issue #25758: [SPARK-28856][FOLLOW-UP][SQL][TEST] Add the `namespaces` keyword to TableIdentifierParserSuite URL: https://github.com/apache/spark/pull/25758#issuecomment-530476398 **[Test build #110477 has

[GitHub] [spark] SparkQA removed a comment on issue #25758: [SPARK-28856][FOLLOW-UP][SQL][TEST] Add the `namespaces` keyword to TableIdentifierParserSuite

2019-09-11 Thread GitBox
SparkQA removed a comment on issue #25758: [SPARK-28856][FOLLOW-UP][SQL][TEST] Add the `namespaces` keyword to TableIdentifierParserSuite URL: https://github.com/apache/spark/pull/25758#issuecomment-530407626 **[Test build #110477 has

[GitHub] [spark] AmplabJenkins commented on issue #25763: [SPARK-29057][SQL] remove InsertIntoTable

2019-09-11 Thread GitBox
AmplabJenkins commented on issue #25763: [SPARK-29057][SQL] remove InsertIntoTable URL: https://github.com/apache/spark/pull/25763#issuecomment-530480609 Merged build finished. Test PASSed. This is an automated message from

[GitHub] [spark] AmplabJenkins commented on issue #25763: [SPARK-29057][SQL] remove InsertIntoTable

2019-09-11 Thread GitBox
AmplabJenkins commented on issue #25763: [SPARK-29057][SQL] remove InsertIntoTable URL: https://github.com/apache/spark/pull/25763#issuecomment-530480614 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] vanzin closed pull request #25706: [SPARK-26989][CORE][TEST] DAGSchedulerSuite: ensure listeners are fully processed before checking recorded values

2019-09-11 Thread GitBox
vanzin closed pull request #25706: [SPARK-26989][CORE][TEST] DAGSchedulerSuite: ensure listeners are fully processed before checking recorded values URL: https://github.com/apache/spark/pull/25706 This is an automated

[GitHub] [spark] vanzin commented on issue #25706: [SPARK-26989][CORE][TEST] DAGSchedulerSuite: ensure listeners are fully processed before checking recorded values

2019-09-11 Thread GitBox
vanzin commented on issue #25706: [SPARK-26989][CORE][TEST] DAGSchedulerSuite: ensure listeners are fully processed before checking recorded values URL: https://github.com/apache/spark/pull/25706#issuecomment-530480681 Merging to master.

[GitHub] [spark] AmplabJenkins commented on issue #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes

2019-09-11 Thread GitBox
AmplabJenkins commented on issue #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes URL: https://github.com/apache/spark/pull/25700#issuecomment-530493562 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes

2019-09-11 Thread GitBox
AmplabJenkins commented on issue #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes URL: https://github.com/apache/spark/pull/25700#issuecomment-530493552 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #25760: [WIP][SPARK-29054][SS] Invalidate Kafka consumer when new delegation token available

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25760: [WIP][SPARK-29054][SS] Invalidate Kafka consumer when new delegation token available URL: https://github.com/apache/spark/pull/25760#issuecomment-530498589 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #25760: [WIP][SPARK-29054][SS] Invalidate Kafka consumer when new delegation token available

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25760: [WIP][SPARK-29054][SS] Invalidate Kafka consumer when new delegation token available URL: https://github.com/apache/spark/pull/25760#issuecomment-530498582 Merged build finished. Test PASSed.

[GitHub] [spark] shanyu commented on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server

2019-09-11 Thread GitBox
shanyu commented on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server URL: https://github.com/apache/spark/pull/25705#issuecomment-530522050 @HeartSaVioR Yeah you are right, it also calls startPolling() after exit from safe mode. That's why we need it in

[GitHub] [spark] planga82 commented on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab

2019-09-11 Thread GitBox
planga82 commented on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab URL: https://github.com/apache/spark/pull/25723#issuecomment-530556171 Thanks @juliuszsompolski for your work. This is an

[GitHub] [spark] AmplabJenkins commented on issue #25632: [SPARK-28809][DOC][SQL]Document SHOW TABLE in SQL Reference

2019-09-11 Thread GitBox
AmplabJenkins commented on issue #25632: [SPARK-28809][DOC][SQL]Document SHOW TABLE in SQL Reference URL: https://github.com/apache/spark/pull/25632#issuecomment-530556289 Can one of the admins verify this patch? This is an

[GitHub] [spark] planga82 commented on issue #25718: [SPARK-28373][DOCS][WebUI] JDBC/ODBC Server Tab

2019-09-11 Thread GitBox
planga82 commented on issue #25718: [SPARK-28373][DOCS][WebUI] JDBC/ODBC Server Tab URL: https://github.com/apache/spark/pull/25718#issuecomment-530566862 It's no problem @juliuszsompolski. The important thing is that the document get as clear as posible. All ideas are welcome. Images

[GitHub] [spark] SparkQA commented on issue #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes

2019-09-11 Thread GitBox
SparkQA commented on issue #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes URL: https://github.com/apache/spark/pull/25700#issuecomment-530491349 **[Test build #110483 has

[GitHub] [spark] SparkQA removed a comment on issue #25760: [WIP][SPARK-29054][SS] Invalidate Kafka consumer when new delegation token available

2019-09-11 Thread GitBox
SparkQA removed a comment on issue #25760: [WIP][SPARK-29054][SS] Invalidate Kafka consumer when new delegation token available URL: https://github.com/apache/spark/pull/25760#issuecomment-530429179 **[Test build #110478 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530498023 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530498012 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-11 Thread GitBox
AmplabJenkins commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530498012 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-11 Thread GitBox
AmplabJenkins commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530498023 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #25760: [WIP][SPARK-29054][SS] Invalidate Kafka consumer when new delegation token available

2019-09-11 Thread GitBox
SparkQA commented on issue #25760: [WIP][SPARK-29054][SS] Invalidate Kafka consumer when new delegation token available URL: https://github.com/apache/spark/pull/25760#issuecomment-530497793 **[Test build #110478 has

[GitHub] [spark] AmplabJenkins commented on issue #25760: [WIP][SPARK-29054][SS] Invalidate Kafka consumer when new delegation token available

2019-09-11 Thread GitBox
AmplabJenkins commented on issue #25760: [WIP][SPARK-29054][SS] Invalidate Kafka consumer when new delegation token available URL: https://github.com/apache/spark/pull/25760#issuecomment-530498589 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25760: [WIP][SPARK-29054][SS] Invalidate Kafka consumer when new delegation token available

2019-09-11 Thread GitBox
AmplabJenkins commented on issue #25760: [WIP][SPARK-29054][SS] Invalidate Kafka consumer when new delegation token available URL: https://github.com/apache/spark/pull/25760#issuecomment-530498582 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab URL: https://github.com/apache/spark/pull/25723#issuecomment-530524330 Merged build finished. Test FAILed. This is an

[GitHub] [spark] SparkQA commented on issue #25764: [SPARK-29060][SQL] Add tree traversal helper for adaptive spark plans

2019-09-11 Thread GitBox
SparkQA commented on issue #25764: [SPARK-29060][SQL] Add tree traversal helper for adaptive spark plans URL: https://github.com/apache/spark/pull/25764#issuecomment-530531607 **[Test build #110484 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25764: [SPARK-29060][SQL] Add tree traversal helper for adaptive spark plans

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25764: [SPARK-29060][SQL] Add tree traversal helper for adaptive spark plans URL: https://github.com/apache/spark/pull/25764#issuecomment-530530868 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25764: [SPARK-29060][SQL] Add tree traversal helper for adaptive spark plans

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25764: [SPARK-29060][SQL] Add tree traversal helper for adaptive spark plans URL: https://github.com/apache/spark/pull/25764#issuecomment-530530879 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] viirya commented on a change in pull request #25295: [SPARK-28560][SQL] Optimize shuffle reader to local shuffle reader when smj converted to bhj in adaptive execution

2019-09-11 Thread GitBox
viirya commented on a change in pull request #25295: [SPARK-28560][SQL] Optimize shuffle reader to local shuffle reader when smj converted to bhj in adaptive execution URL: https://github.com/apache/spark/pull/25295#discussion_r323451679 ## File path:

[GitHub] [spark] brkyvz commented on a change in pull request #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes

2019-09-11 Thread GitBox
brkyvz commented on a change in pull request #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes URL: https://github.com/apache/spark/pull/25700#discussion_r323456568 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #25718: [SPARK-28373][DOCS][WebUI] JDBC/ODBC Server Tab

2019-09-11 Thread GitBox
AmplabJenkins commented on issue #25718: [SPARK-28373][DOCS][WebUI] JDBC/ODBC Server Tab URL: https://github.com/apache/spark/pull/25718#issuecomment-530568048 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] AmplabJenkins commented on issue #25718: [SPARK-28373][DOCS][WebUI] JDBC/ODBC Server Tab

2019-09-11 Thread GitBox
AmplabJenkins commented on issue #25718: [SPARK-28373][DOCS][WebUI] JDBC/ODBC Server Tab URL: https://github.com/apache/spark/pull/25718#issuecomment-530568062 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25718: [SPARK-28373][DOCS][WebUI] JDBC/ODBC Server Tab

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25718: [SPARK-28373][DOCS][WebUI] JDBC/ODBC Server Tab URL: https://github.com/apache/spark/pull/25718#issuecomment-530568048 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #25718: [SPARK-28373][DOCS][WebUI] JDBC/ODBC Server Tab

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25718: [SPARK-28373][DOCS][WebUI] JDBC/ODBC Server Tab URL: https://github.com/apache/spark/pull/25718#issuecomment-530568062 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25753: [SPARK-29046][SQL] Fix NPE in SQLConf.get when active SparkContext is stopping

2019-09-11 Thread GitBox
AmplabJenkins commented on issue #25753: [SPARK-29046][SQL] Fix NPE in SQLConf.get when active SparkContext is stopping URL: https://github.com/apache/spark/pull/25753#issuecomment-530585178 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA commented on issue #25753: [SPARK-29046][SQL] Fix NPE in SQLConf.get when active SparkContext is stopping

2019-09-11 Thread GitBox
SparkQA commented on issue #25753: [SPARK-29046][SQL] Fix NPE in SQLConf.get when active SparkContext is stopping URL: https://github.com/apache/spark/pull/25753#issuecomment-530585044 **[Test build #110485 has

[GitHub] [spark] SparkQA removed a comment on issue #25753: [SPARK-29046][SQL] Fix NPE in SQLConf.get when active SparkContext is stopping

2019-09-11 Thread GitBox
SparkQA removed a comment on issue #25753: [SPARK-29046][SQL] Fix NPE in SQLConf.get when active SparkContext is stopping URL: https://github.com/apache/spark/pull/25753#issuecomment-530557497 **[Test build #110485 has

[GitHub] [spark] AmplabJenkins commented on issue #25753: [SPARK-29046][SQL] Fix NPE in SQLConf.get when active SparkContext is stopping

2019-09-11 Thread GitBox
AmplabJenkins commented on issue #25753: [SPARK-29046][SQL] Fix NPE in SQLConf.get when active SparkContext is stopping URL: https://github.com/apache/spark/pull/25753#issuecomment-530585183 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25753: [SPARK-29046][SQL] Fix NPE in SQLConf.get when active SparkContext is stopping

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25753: [SPARK-29046][SQL] Fix NPE in SQLConf.get when active SparkContext is stopping URL: https://github.com/apache/spark/pull/25753#issuecomment-530585178 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA commented on issue #25764: [SPARK-29060][SQL] Add tree traversal helper for adaptive spark plans

2019-09-11 Thread GitBox
SparkQA commented on issue #25764: [SPARK-29060][SQL] Add tree traversal helper for adaptive spark plans URL: https://github.com/apache/spark/pull/25764#issuecomment-530598580 **[Test build #110484 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25758: [SPARK-28856][FOLLOW-UP][SQL][TEST] Add the `namespaces` keyword to TableIdentifierParserSuite

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25758: [SPARK-28856][FOLLOW-UP][SQL][TEST] Add the `namespaces` keyword to TableIdentifierParserSuite URL: https://github.com/apache/spark/pull/25758#issuecomment-530476687 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #25758: [SPARK-28856][FOLLOW-UP][SQL][TEST] Add the `namespaces` keyword to TableIdentifierParserSuite

2019-09-11 Thread GitBox
AmplabJenkins commented on issue #25758: [SPARK-28856][FOLLOW-UP][SQL][TEST] Add the `namespaces` keyword to TableIdentifierParserSuite URL: https://github.com/apache/spark/pull/25758#issuecomment-530476700 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #25758: [SPARK-28856][FOLLOW-UP][SQL][TEST] Add the `namespaces` keyword to TableIdentifierParserSuite

2019-09-11 Thread GitBox
AmplabJenkins commented on issue #25758: [SPARK-28856][FOLLOW-UP][SQL][TEST] Add the `namespaces` keyword to TableIdentifierParserSuite URL: https://github.com/apache/spark/pull/25758#issuecomment-530476687 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25763: [SPARK-29057][SQL] remove InsertIntoTable

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25763: [SPARK-29057][SQL] remove InsertIntoTable URL: https://github.com/apache/spark/pull/25763#issuecomment-530480614 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25763: [SPARK-29057][SQL] remove InsertIntoTable

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25763: [SPARK-29057][SQL] remove InsertIntoTable URL: https://github.com/apache/spark/pull/25763#issuecomment-530480609 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] Jeffwan commented on issue #25641: [SPARK-28921][BUILD][K8S][2.4] Update kubernetes client to 4.4.2

2019-09-11 Thread GitBox
Jeffwan commented on issue #25641: [SPARK-28921][BUILD][K8S][2.4] Update kubernetes client to 4.4.2 URL: https://github.com/apache/spark/pull/25641#issuecomment-530481844 @dongjoon-hyun This is great! Thank you so much. We will get involved in the community and make more contributions

[GitHub] [spark] vanzin commented on issue #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkContext

2019-09-11 Thread GitBox
vanzin commented on issue #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkContext URL: https://github.com/apache/spark/pull/25709#issuecomment-530482147 Merging to master. You left an unused import

[GitHub] [spark] vanzin commented on issue #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkContext

2019-09-11 Thread GitBox
vanzin commented on issue #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkContext URL: https://github.com/apache/spark/pull/25709#issuecomment-530485001 (Well, I forgot to actually commit the import

[GitHub] [spark] SparkQA commented on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab

2019-09-11 Thread GitBox
SparkQA commented on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab URL: https://github.com/apache/spark/pull/25723#issuecomment-530484771 **[Test build #110482 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110482/testReport)**

[GitHub] [spark] vanzin commented on a change in pull request #23952: [SPARK-26929][SQL]fix table owner use user instead of principal when create table through spark-sql or beeline

2019-09-11 Thread GitBox
vanzin commented on a change in pull request #23952: [SPARK-26929][SQL]fix table owner use user instead of principal when create table through spark-sql or beeline URL: https://github.com/apache/spark/pull/23952#discussion_r323453779 ## File path:

[GitHub] [spark] brkyvz commented on a change in pull request #25681: [SPARK-28612][SQL] Add DataFrameWriterV2 API

2019-09-11 Thread GitBox
brkyvz commented on a change in pull request #25681: [SPARK-28612][SQL] Add DataFrameWriterV2 API URL: https://github.com/apache/spark/pull/25681#discussion_r323453897 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/PartitionTransforms.scala

[GitHub] [spark] AmplabJenkins removed a comment on issue #25718: [SPARK-28373][DOCS][WebUI] JDBC/ODBC Server Tab

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25718: [SPARK-28373][DOCS][WebUI] JDBC/ODBC Server Tab URL: https://github.com/apache/spark/pull/25718#issuecomment-530570060 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #25718: [SPARK-28373][DOCS][WebUI] JDBC/ODBC Server Tab

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25718: [SPARK-28373][DOCS][WebUI] JDBC/ODBC Server Tab URL: https://github.com/apache/spark/pull/25718#issuecomment-530570066 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #25718: [SPARK-28373][DOCS][WebUI] JDBC/ODBC Server Tab

2019-09-11 Thread GitBox
SparkQA removed a comment on issue #25718: [SPARK-28373][DOCS][WebUI] JDBC/ODBC Server Tab URL: https://github.com/apache/spark/pull/25718#issuecomment-530565871 **[Test build #110487 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110487/testReport)** for

[GitHub] [spark] AmplabJenkins removed a comment on issue #25735: [SPARK-29030][SQL] Simplify lookupV2Relation

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25735: [SPARK-29030][SQL] Simplify lookupV2Relation URL: https://github.com/apache/spark/pull/25735#issuecomment-530576049 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #25735: [SPARK-29030][SQL] Simplify lookupV2Relation

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25735: [SPARK-29030][SQL] Simplify lookupV2Relation URL: https://github.com/apache/spark/pull/25735#issuecomment-530576056 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25735: [SPARK-29030][SQL] Simplify lookupV2Relation

2019-09-11 Thread GitBox
AmplabJenkins commented on issue #25735: [SPARK-29030][SQL] Simplify lookupV2Relation URL: https://github.com/apache/spark/pull/25735#issuecomment-530576049 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] AmplabJenkins commented on issue #25735: [SPARK-29030][SQL] Simplify lookupV2Relation

2019-09-11 Thread GitBox
AmplabJenkins commented on issue #25735: [SPARK-29030][SQL] Simplify lookupV2Relation URL: https://github.com/apache/spark/pull/25735#issuecomment-530576056 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #25735: [SPARK-29030][SQL] Simplify lookupV2Relation

2019-09-11 Thread GitBox
SparkQA commented on issue #25735: [SPARK-29030][SQL] Simplify lookupV2Relation URL: https://github.com/apache/spark/pull/25735#issuecomment-530576642 **[Test build #110488 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110488/testReport)** for PR 25735 at

[GitHub] [spark] AmplabJenkins removed a comment on issue #25765: [SPARK-28937][SPARK-28936][KUBERNETES] Reduce test flakyness

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25765: [SPARK-28937][SPARK-28936][KUBERNETES] Reduce test flakyness URL: https://github.com/apache/spark/pull/25765#issuecomment-530594233 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] cloud-fan commented on issue #25763: [SPARK-29057][SQL] remove InsertIntoTable

2019-09-11 Thread GitBox
cloud-fan commented on issue #25763: [SPARK-29057][SQL] remove InsertIntoTable URL: https://github.com/apache/spark/pull/25763#issuecomment-530478623 cc @brkyvz @rdblue @gengliangwang This is an automated message from the

[GitHub] [spark] vanzin commented on a change in pull request #23952: [SPARK-26929][SQL]fix table owner use user instead of principal when create table through spark-sql or beeline

2019-09-11 Thread GitBox
vanzin commented on a change in pull request #23952: [SPARK-26929][SQL]fix table owner use user instead of principal when create table through spark-sql or beeline URL: https://github.com/apache/spark/pull/23952#discussion_r323372328 ## File path:

[GitHub] [spark] juliuszsompolski commented on a change in pull request #25718: [SPARK-28373][DOCS][WebUI] JDBC/ODBC Server Tab

2019-09-11 Thread GitBox
juliuszsompolski commented on a change in pull request #25718: [SPARK-28373][DOCS][WebUI] JDBC/ODBC Server Tab URL: https://github.com/apache/spark/pull/25718#discussion_r323410912 ## File path: docs/web-ui.md ## @@ -369,3 +369,44 @@ The web UI includes a Streaming tab if

[GitHub] [spark] juliuszsompolski commented on a change in pull request #25718: [SPARK-28373][DOCS][WebUI] JDBC/ODBC Server Tab

2019-09-11 Thread GitBox
juliuszsompolski commented on a change in pull request #25718: [SPARK-28373][DOCS][WebUI] JDBC/ODBC Server Tab URL: https://github.com/apache/spark/pull/25718#discussion_r323410438 ## File path: docs/web-ui.md ## @@ -369,3 +369,44 @@ The web UI includes a Streaming tab if

[GitHub] [spark] SparkQA commented on issue #25756: [MINOR][DOCS] Fix few typos in the java docs

2019-09-11 Thread GitBox
SparkQA commented on issue #25756: [MINOR][DOCS] Fix few typos in the java docs URL: https://github.com/apache/spark/pull/25756#issuecomment-530532507 **[Test build #4862 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4862/testReport)** for PR 25756 at

[GitHub] [spark] AmplabJenkins removed a comment on issue #25753: [SPARK-29046][SQL] Fix NPE in SQLConf.get when active SparkContext is stopping

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25753: [SPARK-29046][SQL] Fix NPE in SQLConf.get when active SparkContext is stopping URL: https://github.com/apache/spark/pull/25753#issuecomment-530585183 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #25764: [SPARK-29060][SQL] Add tree traversal helper for adaptive spark plans

2019-09-11 Thread GitBox
SparkQA removed a comment on issue #25764: [SPARK-29060][SQL] Add tree traversal helper for adaptive spark plans URL: https://github.com/apache/spark/pull/25764#issuecomment-530531607 **[Test build #110484 has

[GitHub] [spark] AmplabJenkins commented on issue #25764: [SPARK-29060][SQL] Add tree traversal helper for adaptive spark plans

2019-09-11 Thread GitBox
AmplabJenkins commented on issue #25764: [SPARK-29060][SQL] Add tree traversal helper for adaptive spark plans URL: https://github.com/apache/spark/pull/25764#issuecomment-530598898 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #25764: [SPARK-29060][SQL] Add tree traversal helper for adaptive spark plans

2019-09-11 Thread GitBox
AmplabJenkins commented on issue #25764: [SPARK-29060][SQL] Add tree traversal helper for adaptive spark plans URL: https://github.com/apache/spark/pull/25764#issuecomment-530598901 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #25765: [SPARK-28937][SPARK-28936][KUBERNETES] Reduce test flakyness

2019-09-11 Thread GitBox
SparkQA commented on issue #25765: [SPARK-28937][SPARK-28936][KUBERNETES] Reduce test flakyness URL: https://github.com/apache/spark/pull/25765#issuecomment-530598952 Kubernetes integration test starting URL:

[GitHub] [spark] AmplabJenkins removed a comment on issue #25764: [SPARK-29060][SQL] Add tree traversal helper for adaptive spark plans

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25764: [SPARK-29060][SQL] Add tree traversal helper for adaptive spark plans URL: https://github.com/apache/spark/pull/25764#issuecomment-530598901 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25764: [SPARK-29060][SQL] Add tree traversal helper for adaptive spark plans

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25764: [SPARK-29060][SQL] Add tree traversal helper for adaptive spark plans URL: https://github.com/apache/spark/pull/25764#issuecomment-530598898 Merged build finished. Test PASSed.

  1   2   3   4   5   6   7   >