[GitHub] [spark] maryannxue commented on issue #25764: [SPARK-29060][SQL] Add tree traversal helper for adaptive spark plans

2019-09-11 Thread GitBox
maryannxue commented on issue #25764: [SPARK-29060][SQL] Add tree traversal helper for adaptive spark plans URL: https://github.com/apache/spark/pull/25764#issuecomment-530530559 cc @cloud-fan This is an automated message fr

[GitHub] [spark] maryannxue opened a new pull request #25764: [SPARK-29060][SQL] Add tree traversal helper for adaptive spark plans

2019-09-11 Thread GitBox
maryannxue opened a new pull request #25764: [SPARK-29060][SQL] Add tree traversal helper for adaptive spark plans URL: https://github.com/apache/spark/pull/25764 ### What changes were proposed in this pull request? This PR adds a utility class `AdaptiveSparkPlanHelper` which provides m

[GitHub] [spark] AmplabJenkins removed a comment on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab URL: https://github.com/apache/spark/pull/25723#issuecomment-530524336 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.b

[GitHub] [spark] AmplabJenkins removed a comment on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab URL: https://github.com/apache/spark/pull/25723#issuecomment-530524330 Merged build finished. Test FAILed. This is an

[GitHub] [spark] SparkQA removed a comment on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab

2019-09-11 Thread GitBox
SparkQA removed a comment on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab URL: https://github.com/apache/spark/pull/25723#issuecomment-530484771 **[Test build #110482 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110482/testRepor

[GitHub] [spark] AmplabJenkins commented on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab

2019-09-11 Thread GitBox
AmplabJenkins commented on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab URL: https://github.com/apache/spark/pull/25723#issuecomment-530524336 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.

[GitHub] [spark] AmplabJenkins commented on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab

2019-09-11 Thread GitBox
AmplabJenkins commented on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab URL: https://github.com/apache/spark/pull/25723#issuecomment-530524330 Merged build finished. Test FAILed. This is an automate

[GitHub] [spark] SparkQA commented on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab

2019-09-11 Thread GitBox
SparkQA commented on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab URL: https://github.com/apache/spark/pull/25723#issuecomment-530524037 **[Test build #110482 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110482/testReport)** f

[GitHub] [spark] juliuszsompolski commented on a change in pull request #25718: [SPARK-28373][DOCS][WebUI] JDBC/ODBC Server Tab

2019-09-11 Thread GitBox
juliuszsompolski commented on a change in pull request #25718: [SPARK-28373][DOCS][WebUI] JDBC/ODBC Server Tab URL: https://github.com/apache/spark/pull/25718#discussion_r323410912 ## File path: docs/web-ui.md ## @@ -369,3 +369,44 @@ The web UI includes a Streaming tab if

[GitHub] [spark] juliuszsompolski commented on a change in pull request #25718: [SPARK-28373][DOCS][WebUI] JDBC/ODBC Server Tab

2019-09-11 Thread GitBox
juliuszsompolski commented on a change in pull request #25718: [SPARK-28373][DOCS][WebUI] JDBC/ODBC Server Tab URL: https://github.com/apache/spark/pull/25718#discussion_r323410438 ## File path: docs/web-ui.md ## @@ -369,3 +369,44 @@ The web UI includes a Streaming tab if

[GitHub] [spark] shanyu commented on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server

2019-09-11 Thread GitBox
shanyu commented on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server URL: https://github.com/apache/spark/pull/25705#issuecomment-530522050 @HeartSaVioR Yeah you are right, it also calls startPolling() after exit from safe mode. That's why we need it in His

[GitHub] [spark] AmplabJenkins removed a comment on issue #25760: [WIP][SPARK-29054][SS] Invalidate Kafka consumer when new delegation token available

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25760: [WIP][SPARK-29054][SS] Invalidate Kafka consumer when new delegation token available URL: https://github.com/apache/spark/pull/25760#issuecomment-530498589 Test PASSed. Refer to this link for build results (access rights to CI server neede

[GitHub] [spark] AmplabJenkins removed a comment on issue #25760: [WIP][SPARK-29054][SS] Invalidate Kafka consumer when new delegation token available

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25760: [WIP][SPARK-29054][SS] Invalidate Kafka consumer when new delegation token available URL: https://github.com/apache/spark/pull/25760#issuecomment-530498582 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins commented on issue #25760: [WIP][SPARK-29054][SS] Invalidate Kafka consumer when new delegation token available

2019-09-11 Thread GitBox
AmplabJenkins commented on issue #25760: [WIP][SPARK-29054][SS] Invalidate Kafka consumer when new delegation token available URL: https://github.com/apache/spark/pull/25760#issuecomment-530498589 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25760: [WIP][SPARK-29054][SS] Invalidate Kafka consumer when new delegation token available

2019-09-11 Thread GitBox
AmplabJenkins commented on issue #25760: [WIP][SPARK-29054][SS] Invalidate Kafka consumer when new delegation token available URL: https://github.com/apache/spark/pull/25760#issuecomment-530498582 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins removed a comment on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530498023 Test PASSed. Refer to this link for build results (access rights to CI server needed

[GitHub] [spark] AmplabJenkins removed a comment on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530498012 Merged build finished. Test PASSed. --

[GitHub] [spark] SparkQA removed a comment on issue #25760: [WIP][SPARK-29054][SS] Invalidate Kafka consumer when new delegation token available

2019-09-11 Thread GitBox
SparkQA removed a comment on issue #25760: [WIP][SPARK-29054][SS] Invalidate Kafka consumer when new delegation token available URL: https://github.com/apache/spark/pull/25760#issuecomment-530429179 **[Test build #110478 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequ

[GitHub] [spark] SparkQA commented on issue #25760: [WIP][SPARK-29054][SS] Invalidate Kafka consumer when new delegation token available

2019-09-11 Thread GitBox
SparkQA commented on issue #25760: [WIP][SPARK-29054][SS] Invalidate Kafka consumer when new delegation token available URL: https://github.com/apache/spark/pull/25760#issuecomment-530497793 **[Test build #110478 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuil

[GitHub] [spark] AmplabJenkins commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-11 Thread GitBox
AmplabJenkins commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530498012 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-11 Thread GitBox
AmplabJenkins commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530498023 Test PASSed. Refer to this link for build results (access rights to CI server needed): h

[GitHub] [spark] SparkQA removed a comment on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-11 Thread GitBox
SparkQA removed a comment on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530429178 **[Test build #110479 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullReque

[GitHub] [spark] SparkQA commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-11 Thread GitBox
SparkQA commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530497294 **[Test build #110479 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuild

[GitHub] [spark] AmplabJenkins removed a comment on issue #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes URL: https://github.com/apache/spark/pull/25700#issuecomment-530493552 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes URL: https://github.com/apache/spark/pull/25700#issuecomment-530493562 Test PASSed. Refer to this link for build results (access rights to CI server needed): https

[GitHub] [spark] AmplabJenkins commented on issue #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes

2019-09-11 Thread GitBox
AmplabJenkins commented on issue #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes URL: https://github.com/apache/spark/pull/25700#issuecomment-530493562 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampla

[GitHub] [spark] AmplabJenkins commented on issue #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes

2019-09-11 Thread GitBox
AmplabJenkins commented on issue #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes URL: https://github.com/apache/spark/pull/25700#issuecomment-530493552 Merged build finished. Test PASSed. This i

[GitHub] [spark] vanzin commented on a change in pull request #25753: [SPARK-29046][SQL] Fix NPE in SQLConf.get when active SparkContext is stopping

2019-09-11 Thread GitBox
vanzin commented on a change in pull request #25753: [SPARK-29046][SQL] Fix NPE in SQLConf.get when active SparkContext is stopping URL: https://github.com/apache/spark/pull/25753#discussion_r323378348 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.

[GitHub] [spark] SparkQA commented on issue #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes

2019-09-11 Thread GitBox
SparkQA commented on issue #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes URL: https://github.com/apache/spark/pull/25700#issuecomment-530491349 **[Test build #110483 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110483/test

[GitHub] [spark] AmplabJenkins removed a comment on issue #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes URL: https://github.com/apache/spark/pull/25700#issuecomment-530490480 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes URL: https://github.com/apache/spark/pull/25700#issuecomment-530490489 Test PASSed. Refer to this link for build results (access rights to CI server needed): https

[GitHub] [spark] AmplabJenkins commented on issue #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes

2019-09-11 Thread GitBox
AmplabJenkins commented on issue #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes URL: https://github.com/apache/spark/pull/25700#issuecomment-530490480 Merged build finished. Test PASSed. This i

[GitHub] [spark] AmplabJenkins commented on issue #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes

2019-09-11 Thread GitBox
AmplabJenkins commented on issue #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes URL: https://github.com/apache/spark/pull/25700#issuecomment-530490489 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampla

[GitHub] [spark] vanzin commented on a change in pull request #23952: [SPARK-26929][SQL]fix table owner use user instead of principal when create table through spark-sql or beeline

2019-09-11 Thread GitBox
vanzin commented on a change in pull request #23952: [SPARK-26929][SQL]fix table owner use user instead of principal when create table through spark-sql or beeline URL: https://github.com/apache/spark/pull/23952#discussion_r323372328 ## File path: sql/hive/src/main/scala/org/apach

[GitHub] [spark] vanzin commented on issue #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkContext

2019-09-11 Thread GitBox
vanzin commented on issue #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkContext URL: https://github.com/apache/spark/pull/25709#issuecomment-530485001 (Well, I forgot to actually commit the import s

[GitHub] [spark] SparkQA commented on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab

2019-09-11 Thread GitBox
SparkQA commented on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab URL: https://github.com/apache/spark/pull/25723#issuecomment-530484771 **[Test build #110482 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110482/testReport)** fo

[GitHub] [spark] vanzin closed pull request #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkContext

2019-09-11 Thread GitBox
vanzin closed pull request #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkContext URL: https://github.com/apache/spark/pull/25709 Th

[GitHub] [spark] AmplabJenkins removed a comment on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab URL: https://github.com/apache/spark/pull/25723#issuecomment-530483929 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.

[GitHub] [spark] AmplabJenkins commented on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab

2019-09-11 Thread GitBox
AmplabJenkins commented on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab URL: https://github.com/apache/spark/pull/25723#issuecomment-530483929 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley

[GitHub] [spark] AmplabJenkins removed a comment on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab URL: https://github.com/apache/spark/pull/25723#issuecomment-530483913 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab

2019-09-11 Thread GitBox
AmplabJenkins commented on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab URL: https://github.com/apache/spark/pull/25723#issuecomment-530483913 Merged build finished. Test PASSed. This is an automate

[GitHub] [spark] vanzin commented on issue #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkContext

2019-09-11 Thread GitBox
vanzin commented on issue #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkContext URL: https://github.com/apache/spark/pull/25709#issuecomment-530482147 Merging to master. You left an unused import th

[GitHub] [spark] Jeffwan commented on issue #25641: [SPARK-28921][BUILD][K8S][2.4] Update kubernetes client to 4.4.2

2019-09-11 Thread GitBox
Jeffwan commented on issue #25641: [SPARK-28921][BUILD][K8S][2.4] Update kubernetes client to 4.4.2 URL: https://github.com/apache/spark/pull/25641#issuecomment-530481844 @dongjoon-hyun This is great! Thank you so much. We will get involved in the community and make more contributions then

[GitHub] [spark] AmplabJenkins removed a comment on issue #25763: [SPARK-29057][SQL] remove InsertIntoTable

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25763: [SPARK-29057][SQL] remove InsertIntoTable URL: https://github.com/apache/spark/pull/25763#issuecomment-530480614 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jen

[GitHub] [spark] AmplabJenkins removed a comment on issue #25763: [SPARK-29057][SQL] remove InsertIntoTable

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25763: [SPARK-29057][SQL] remove InsertIntoTable URL: https://github.com/apache/spark/pull/25763#issuecomment-530480609 Merged build finished. Test PASSed. This is an automated messag

[GitHub] [spark] SparkQA commented on issue #25763: [SPARK-29057][SQL] remove InsertIntoTable

2019-09-11 Thread GitBox
SparkQA commented on issue #25763: [SPARK-29057][SQL] remove InsertIntoTable URL: https://github.com/apache/spark/pull/25763#issuecomment-530481420 **[Test build #110481 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110481/testReport)** for PR 25763 at com

[GitHub] [spark] vanzin closed pull request #25706: [SPARK-26989][CORE][TEST] DAGSchedulerSuite: ensure listeners are fully processed before checking recorded values

2019-09-11 Thread GitBox
vanzin closed pull request #25706: [SPARK-26989][CORE][TEST] DAGSchedulerSuite: ensure listeners are fully processed before checking recorded values URL: https://github.com/apache/spark/pull/25706 This is an automated messag

[GitHub] [spark] vanzin commented on issue #25706: [SPARK-26989][CORE][TEST] DAGSchedulerSuite: ensure listeners are fully processed before checking recorded values

2019-09-11 Thread GitBox
vanzin commented on issue #25706: [SPARK-26989][CORE][TEST] DAGSchedulerSuite: ensure listeners are fully processed before checking recorded values URL: https://github.com/apache/spark/pull/25706#issuecomment-530480681 Merging to master.

[GitHub] [spark] AmplabJenkins commented on issue #25763: [SPARK-29057][SQL] remove InsertIntoTable

2019-09-11 Thread GitBox
AmplabJenkins commented on issue #25763: [SPARK-29057][SQL] remove InsertIntoTable URL: https://github.com/apache/spark/pull/25763#issuecomment-530480609 Merged build finished. Test PASSed. This is an automated message from t

[GitHub] [spark] AmplabJenkins commented on issue #25763: [SPARK-29057][SQL] remove InsertIntoTable

2019-09-11 Thread GitBox
AmplabJenkins commented on issue #25763: [SPARK-29057][SQL] remove InsertIntoTable URL: https://github.com/apache/spark/pull/25763#issuecomment-530480614 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//jo

[GitHub] [spark] cloud-fan commented on issue #25763: [SPARK-29057][SQL] remove InsertIntoTable

2019-09-11 Thread GitBox
cloud-fan commented on issue #25763: [SPARK-29057][SQL] remove InsertIntoTable URL: https://github.com/apache/spark/pull/25763#issuecomment-530478623 cc @brkyvz @rdblue @gengliangwang This is an automated message from the Apa

[GitHub] [spark] cloud-fan opened a new pull request #25763: [SPARK-29057][SQL] remove InsertIntoTable

2019-09-11 Thread GitBox
cloud-fan opened a new pull request #25763: [SPARK-29057][SQL] remove InsertIntoTable URL: https://github.com/apache/spark/pull/25763 ### What changes were proposed in this pull request? Remove `InsertIntoTable` and replace it's usage by `InsertIntoStatement` ### Why a

[GitHub] [spark] AmplabJenkins removed a comment on issue #25758: [SPARK-28856][FOLLOW-UP][SQL][TEST] Add the `namespaces` keyword to TableIdentifierParserSuite

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25758: [SPARK-28856][FOLLOW-UP][SQL][TEST] Add the `namespaces` keyword to TableIdentifierParserSuite URL: https://github.com/apache/spark/pull/25758#issuecomment-530476700 Test FAILed. Refer to this link for build results (access rights to CI s

[GitHub] [spark] AmplabJenkins commented on issue #25758: [SPARK-28856][FOLLOW-UP][SQL][TEST] Add the `namespaces` keyword to TableIdentifierParserSuite

2019-09-11 Thread GitBox
AmplabJenkins commented on issue #25758: [SPARK-28856][FOLLOW-UP][SQL][TEST] Add the `namespaces` keyword to TableIdentifierParserSuite URL: https://github.com/apache/spark/pull/25758#issuecomment-530476687 Merged build finished. Test FAILed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #25758: [SPARK-28856][FOLLOW-UP][SQL][TEST] Add the `namespaces` keyword to TableIdentifierParserSuite

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25758: [SPARK-28856][FOLLOW-UP][SQL][TEST] Add the `namespaces` keyword to TableIdentifierParserSuite URL: https://github.com/apache/spark/pull/25758#issuecomment-530476687 Merged build finished. Test FAILed. --

[GitHub] [spark] AmplabJenkins commented on issue #25758: [SPARK-28856][FOLLOW-UP][SQL][TEST] Add the `namespaces` keyword to TableIdentifierParserSuite

2019-09-11 Thread GitBox
AmplabJenkins commented on issue #25758: [SPARK-28856][FOLLOW-UP][SQL][TEST] Add the `namespaces` keyword to TableIdentifierParserSuite URL: https://github.com/apache/spark/pull/25758#issuecomment-530476700 Test FAILed. Refer to this link for build results (access rights to CI server nee

[GitHub] [spark] SparkQA removed a comment on issue #25758: [SPARK-28856][FOLLOW-UP][SQL][TEST] Add the `namespaces` keyword to TableIdentifierParserSuite

2019-09-11 Thread GitBox
SparkQA removed a comment on issue #25758: [SPARK-28856][FOLLOW-UP][SQL][TEST] Add the `namespaces` keyword to TableIdentifierParserSuite URL: https://github.com/apache/spark/pull/25758#issuecomment-530407626 **[Test build #110477 has started](https://amplab.cs.berkeley.edu/jenkins/job/Spa

[GitHub] [spark] SparkQA commented on issue #25758: [SPARK-28856][FOLLOW-UP][SQL][TEST] Add the `namespaces` keyword to TableIdentifierParserSuite

2019-09-11 Thread GitBox
SparkQA commented on issue #25758: [SPARK-28856][FOLLOW-UP][SQL][TEST] Add the `namespaces` keyword to TableIdentifierParserSuite URL: https://github.com/apache/spark/pull/25758#issuecomment-530476398 **[Test build #110477 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullR

[GitHub] [spark] rdblue commented on a change in pull request #25747: [SPARK-29039][SQL] centralize the catalog and table lookup logic

2019-09-11 Thread GitBox
rdblue commented on a change in pull request #25747: [SPARK-29039][SQL] centralize the catalog and table lookup logic URL: https://github.com/apache/spark/pull/25747#discussion_r323354619 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalog/v2/CatalogV2Implicits.s

[GitHub] [spark] cloud-fan commented on a change in pull request #25747: [SPARK-29039][SQL] centralize the catalog and table lookup logic

2019-09-11 Thread GitBox
cloud-fan commented on a change in pull request #25747: [SPARK-29039][SQL] centralize the catalog and table lookup logic URL: https://github.com/apache/spark/pull/25747#discussion_r323351528 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalog/v2/CatalogV2Implicit

[GitHub] [spark] rdblue commented on issue #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes

2019-09-11 Thread GitBox
rdblue commented on issue #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes URL: https://github.com/apache/spark/pull/25700#issuecomment-530469059 +1 The renames look good to me. As long as there are no added changes, then rebasing and committing this wh

[GitHub] [spark] juliuszsompolski commented on a change in pull request #25762: [SPARK-29056] ThriftServerSessionPage displays 1970/01/01 finish and close time when unset

2019-09-11 Thread GitBox
juliuszsompolski commented on a change in pull request #25762: [SPARK-29056] ThriftServerSessionPage displays 1970/01/01 finish and close time when unset URL: https://github.com/apache/spark/pull/25762#discussion_r323351232 ## File path: sql/hive-thriftserver/src/main/scala/org/apa

[GitHub] [spark] cloud-fan commented on issue #25104: [SPARK-28341][SQL] create a public API for V2SessionCatalog

2019-09-11 Thread GitBox
cloud-fan commented on issue #25104: [SPARK-28341][SQL] create a public API for V2SessionCatalog URL: https://github.com/apache/spark/pull/25104#issuecomment-530467238 We can do it if `V2SessionCatalog` doesn't refer to anything in sql/core.

[GitHub] [spark] rdblue commented on a change in pull request #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes

2019-09-11 Thread GitBox
rdblue commented on a change in pull request #25700: [SPARK-28998][SQL] reorganize the packages of DS v2 interfaces/classes URL: https://github.com/apache/spark/pull/25700#discussion_r323348920 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/connector/catalog/Namespac

[GitHub] [spark] srowen commented on a change in pull request #25762: [SPARK-29056] ThriftServerSessionPage displays 1970/01/01 finish and close time when unset

2019-09-11 Thread GitBox
srowen commented on a change in pull request #25762: [SPARK-29056] ThriftServerSessionPage displays 1970/01/01 finish and close time when unset URL: https://github.com/apache/spark/pull/25762#discussion_r323347377 ## File path: sql/hive-thriftserver/src/main/scala/org/apache/spark/

[GitHub] [spark] rdblue commented on issue #25104: [SPARK-28341][SQL] create a public API for V2SessionCatalog

2019-09-11 Thread GitBox
rdblue commented on issue #25104: [SPARK-28341][SQL] create a public API for V2SessionCatalog URL: https://github.com/apache/spark/pull/25104#issuecomment-530465058 @cloud-fan, if execution is intended to be private, should we move those classes into catalyst?

[GitHub] [spark] rdblue commented on issue #25681: [SPARK-28612][SQL] Add DataFrameWriterV2 API

2019-09-11 Thread GitBox
rdblue commented on issue #25681: [SPARK-28612][SQL] Add DataFrameWriterV2 API URL: https://github.com/apache/spark/pull/25681#issuecomment-530464148 @brkyvz. this is passing tests. Anything else we need to change? This is an

[GitHub] [spark] SparkQA commented on issue #25756: [MINOR][DOCS] Fix few typos in the java docs

2019-09-11 Thread GitBox
SparkQA commented on issue #25756: [MINOR][DOCS] Fix few typos in the java docs URL: https://github.com/apache/spark/pull/25756#issuecomment-530464237 **[Test build #4862 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4862/testReport)** for PR 25756 at c

[GitHub] [spark] SparkQA removed a comment on issue #25755: [SPARK-23243][CORE][FOLLOWUP] Remove todo added by SPARK-23207

2019-09-11 Thread GitBox
SparkQA removed a comment on issue #25755: [SPARK-23243][CORE][FOLLOWUP] Remove todo added by SPARK-23207 URL: https://github.com/apache/spark/pull/25755#issuecomment-530390285 **[Test build #4861 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4861/testR

[GitHub] [spark] SparkQA commented on issue #25755: [SPARK-23243][CORE][FOLLOWUP] Remove todo added by SPARK-23207

2019-09-11 Thread GitBox
SparkQA commented on issue #25755: [SPARK-23243][CORE][FOLLOWUP] Remove todo added by SPARK-23207 URL: https://github.com/apache/spark/pull/25755#issuecomment-530461593 **[Test build #4861 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4861/testReport)*

[GitHub] [spark] SparkQA removed a comment on issue #25756: [MINOR][DOCS] Fix few typos in the java docs

2019-09-11 Thread GitBox
SparkQA removed a comment on issue #25756: [MINOR][DOCS] Fix few typos in the java docs URL: https://github.com/apache/spark/pull/25756#issuecomment-530389830 **[Test build #4860 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4860/testReport)** for PR 2

[GitHub] [spark] SparkQA commented on issue #25756: [MINOR][DOCS] Fix few typos in the java docs

2019-09-11 Thread GitBox
SparkQA commented on issue #25756: [MINOR][DOCS] Fix few typos in the java docs URL: https://github.com/apache/spark/pull/25756#issuecomment-530458180 **[Test build #4860 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4860/testReport)** for PR 25756 at

[GitHub] [spark] planga82 commented on a change in pull request #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab

2019-09-11 Thread GitBox
planga82 commented on a change in pull request #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab URL: https://github.com/apache/spark/pull/25723#discussion_r323336051 ## File path: sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/ui/Thrift

[GitHub] [spark] rdblue commented on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2

2019-09-11 Thread GitBox
rdblue commented on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2 URL: https://github.com/apache/spark/pull/25626#issuecomment-530455450 @xianyinxin, could you answer my question about the use case for this? Are you actually building this push-down support in JDBC,

[GitHub] [spark] gatorsmile commented on a change in pull request #25754: [SPARK-29048] Improve performance on Column.isInCollection() with a large size collection

2019-09-11 Thread GitBox
gatorsmile commented on a change in pull request #25754: [SPARK-29048] Improve performance on Column.isInCollection() with a large size collection URL: https://github.com/apache/spark/pull/25754#discussion_r323334539 ## File path: sql/core/src/main/scala/org/apache/spark/sql/Column.

[GitHub] [spark] gatorsmile commented on a change in pull request #25754: [SPARK-29048] Improve performance on Column.isInCollection() with a large size collection

2019-09-11 Thread GitBox
gatorsmile commented on a change in pull request #25754: [SPARK-29048] Improve performance on Column.isInCollection() with a large size collection URL: https://github.com/apache/spark/pull/25754#discussion_r32775 ## File path: sql/core/src/main/scala/org/apache/spark/sql/Column.

[GitHub] [spark] rdblue commented on a change in pull request #25747: [SPARK-29039][SQL] centralize the catalog and table lookup logic

2019-09-11 Thread GitBox
rdblue commented on a change in pull request #25747: [SPARK-29039][SQL] centralize the catalog and table lookup logic URL: https://github.com/apache/spark/pull/25747#discussion_r323329608 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalog/v2/CatalogV2Implicits.s

[GitHub] [spark] AmplabJenkins removed a comment on issue #25762: [SPARK-29056] ThriftServerSessionPage displays 1970/01/01 finish and close time when unset

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25762: [SPARK-29056] ThriftServerSessionPage displays 1970/01/01 finish and close time when unset URL: https://github.com/apache/spark/pull/25762#issuecomment-530449585 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #25762: [SPARK-29056] ThriftServerSessionPage displays 1970/01/01 finish and close time when unset

2019-09-11 Thread GitBox
AmplabJenkins commented on issue #25762: [SPARK-29056] ThriftServerSessionPage displays 1970/01/01 finish and close time when unset URL: https://github.com/apache/spark/pull/25762#issuecomment-530449585 Test PASSed. Refer to this link for build results (access rights to CI server needed)

[GitHub] [spark] SparkQA removed a comment on issue #25762: [SPARK-29056] ThriftServerSessionPage displays 1970/01/01 finish and close time when unset

2019-09-11 Thread GitBox
SparkQA removed a comment on issue #25762: [SPARK-29056] ThriftServerSessionPage displays 1970/01/01 finish and close time when unset URL: https://github.com/apache/spark/pull/25762#issuecomment-530436606 **[Test build #110480 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPu

[GitHub] [spark] AmplabJenkins removed a comment on issue #25762: [SPARK-29056] ThriftServerSessionPage displays 1970/01/01 finish and close time when unset

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25762: [SPARK-29056] ThriftServerSessionPage displays 1970/01/01 finish and close time when unset URL: https://github.com/apache/spark/pull/25762#issuecomment-530449571 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #25762: [SPARK-29056] ThriftServerSessionPage displays 1970/01/01 finish and close time when unset

2019-09-11 Thread GitBox
AmplabJenkins commented on issue #25762: [SPARK-29056] ThriftServerSessionPage displays 1970/01/01 finish and close time when unset URL: https://github.com/apache/spark/pull/25762#issuecomment-530449571 Merged build finished. Test PASSed. ---

[GitHub] [spark] SparkQA commented on issue #25762: [SPARK-29056] ThriftServerSessionPage displays 1970/01/01 finish and close time when unset

2019-09-11 Thread GitBox
SparkQA commented on issue #25762: [SPARK-29056] ThriftServerSessionPage displays 1970/01/01 finish and close time when unset URL: https://github.com/apache/spark/pull/25762#issuecomment-530449439 **[Test build #110480 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullReque

[GitHub] [spark] dongjoon-hyun removed a comment on issue #25741: [SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet/Resource

2019-09-11 Thread GitBox
dongjoon-hyun removed a comment on issue #25741: [SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet/Resource URL: https://github.com/apache/spark/pull/25741#issuecomment-529817472 Also, cc @skonto . T

[GitHub] [spark] planga82 commented on issue #25718: [SPARK-28373][DOCS][WebUI] JDBC/ODBC Server Tab

2019-09-11 Thread GitBox
planga82 commented on issue #25718: [SPARK-28373][DOCS][WebUI] JDBC/ODBC Server Tab URL: https://github.com/apache/spark/pull/25718#issuecomment-530446743 @wangyum Yes, of course, updated. This is an automated message from th

[GitHub] [spark] SparkQA commented on issue #25762: [SPARK-29056] ThriftServerSessionPage displays 1970/01/01 finish and close time when unset

2019-09-11 Thread GitBox
SparkQA commented on issue #25762: [SPARK-29056] ThriftServerSessionPage displays 1970/01/01 finish and close time when unset URL: https://github.com/apache/spark/pull/25762#issuecomment-530436606 **[Test build #110480 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullReques

[GitHub] [spark] AmplabJenkins removed a comment on issue #25762: [SPARK-29056] ThriftServerSessionPage displays 1970/01/01 finish and close time when unset

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25762: [SPARK-29056] ThriftServerSessionPage displays 1970/01/01 finish and close time when unset URL: https://github.com/apache/spark/pull/25762#issuecomment-530435754 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #25762: [SPARK-29056] ThriftServerSessionPage displays 1970/01/01 finish and close time when unset

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25762: [SPARK-29056] ThriftServerSessionPage displays 1970/01/01 finish and close time when unset URL: https://github.com/apache/spark/pull/25762#issuecomment-530435745 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #25762: [SPARK-29056] ThriftServerSessionPage displays 1970/01/01 finish and close time when unset

2019-09-11 Thread GitBox
AmplabJenkins commented on issue #25762: [SPARK-29056] ThriftServerSessionPage displays 1970/01/01 finish and close time when unset URL: https://github.com/apache/spark/pull/25762#issuecomment-530435745 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #25762: [SPARK-29056] ThriftServerSessionPage displays 1970/01/01 finish and close time when unset

2019-09-11 Thread GitBox
AmplabJenkins commented on issue #25762: [SPARK-29056] ThriftServerSessionPage displays 1970/01/01 finish and close time when unset URL: https://github.com/apache/spark/pull/25762#issuecomment-530435754 Test PASSed. Refer to this link for build results (access rights to CI server needed)

[GitHub] [spark] juliuszsompolski commented on issue #25762: [SPARK-29056] ThriftServerSessionPage displays 1970/01/01 finish and close time when unset

2019-09-11 Thread GitBox
juliuszsompolski commented on issue #25762: [SPARK-29056] ThriftServerSessionPage displays 1970/01/01 finish and close time when unset URL: https://github.com/apache/spark/pull/25762#issuecomment-530433614 cc @wangyum This i

[GitHub] [spark] juliuszsompolski opened a new pull request #25762: [SPARK-29056] ThriftServerSessionPage displays 1970/01/01 finish and close time when unset

2019-09-11 Thread GitBox
juliuszsompolski opened a new pull request #25762: [SPARK-29056] ThriftServerSessionPage displays 1970/01/01 finish and close time when unset URL: https://github.com/apache/spark/pull/25762 ### What changes were proposed in this pull request? ThriftServerSessionPage displays timestam

[GitHub] [spark] AmplabJenkins removed a comment on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530431962 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530431976 Test PASSed. Refer to this link for build results (access rights to CI server needed

[GitHub] [spark] AmplabJenkins commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-11 Thread GitBox
AmplabJenkins commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530431976 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-11 Thread GitBox
AmplabJenkins commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530431962 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #25761: [SPARK-29029][SQL] - Using AttributeMap in PhysicalOperation.collectProjectsAndFilters

2019-09-11 Thread GitBox
AmplabJenkins removed a comment on issue #25761: [SPARK-29029][SQL] - Using AttributeMap in PhysicalOperation.collectProjectsAndFilters URL: https://github.com/apache/spark/pull/25761#issuecomment-530428085 Can one of the admins verify this patch? --

[GitHub] [spark] SparkQA commented on issue #25760: [WIP][SPARK-29054][SS] Invalidate Kafka consumer when new delegation token available

2019-09-11 Thread GitBox
SparkQA commented on issue #25760: [WIP][SPARK-29054][SS] Invalidate Kafka consumer when new delegation token available URL: https://github.com/apache/spark/pull/25760#issuecomment-530429179 **[Test build #110478 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuild

[GitHub] [spark] SparkQA commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-11 Thread GitBox
SparkQA commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530429178 **[Test build #110479 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilde

[GitHub] [spark] dongjoon-hyun edited a comment on issue #25641: [SPARK-28921][BUILD][K8S][2.4] Update kubernetes client to 4.4.2

2019-09-11 Thread GitBox
dongjoon-hyun edited a comment on issue #25641: [SPARK-28921][BUILD][K8S][2.4] Update kubernetes client to 4.4.2 URL: https://github.com/apache/spark/pull/25641#issuecomment-530428413 Thank you so much, @Jeffwan . In Apache project community, everything should be processed on mailing

<    1   2   3   4   5   6   7   >