[GitHub] [spark] planga82 commented on a change in pull request #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab

2019-09-10 Thread GitBox
planga82 commented on a change in pull request #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab URL: https://github.com/apache/spark/pull/25723#discussion_r322974690 ## File path: core/src/main/scala/org/apache/spark/ui/ToolTips.scala ## @@ -99,4 +99,16 @@

[GitHub] [spark] gatorsmile commented on issue #25569: [SPARK-28863][SQL] Introduce AlreadyPlanned, a node that speeds-up planning

2019-09-10 Thread GitBox
gatorsmile commented on issue #25569: [SPARK-28863][SQL] Introduce AlreadyPlanned, a node that speeds-up planning URL: https://github.com/apache/spark/pull/25569#issuecomment-530131138 cc @maryannxue This is an automated mes

[GitHub] [spark] SparkQA commented on issue #25718: [SPARK-28373][DOCS][WebUI] JDBC/ODBC Server Tab

2019-09-10 Thread GitBox
SparkQA commented on issue #25718: [SPARK-28373][DOCS][WebUI] JDBC/ODBC Server Tab URL: https://github.com/apache/spark/pull/25718#issuecomment-530131896 **[Test build #110439 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110439/testReport)** for PR 2571

[GitHub] [spark] AmplabJenkins commented on issue #25718: [SPARK-28373][DOCS][WebUI] JDBC/ODBC Server Tab

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25718: [SPARK-28373][DOCS][WebUI] JDBC/ODBC Server Tab URL: https://github.com/apache/spark/pull/25718#issuecomment-530131978 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkin

[GitHub] [spark] AmplabJenkins commented on issue #25718: [SPARK-28373][DOCS][WebUI] JDBC/ODBC Server Tab

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25718: [SPARK-28373][DOCS][WebUI] JDBC/ODBC Server Tab URL: https://github.com/apache/spark/pull/25718#issuecomment-530131972 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] AmplabJenkins removed a comment on issue #25718: [SPARK-28373][DOCS][WebUI] JDBC/ODBC Server Tab

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25718: [SPARK-28373][DOCS][WebUI] JDBC/ODBC Server Tab URL: https://github.com/apache/spark/pull/25718#issuecomment-530131978 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.ed

[GitHub] [spark] SparkQA removed a comment on issue #25718: [SPARK-28373][DOCS][WebUI] JDBC/ODBC Server Tab

2019-09-10 Thread GitBox
SparkQA removed a comment on issue #25718: [SPARK-28373][DOCS][WebUI] JDBC/ODBC Server Tab URL: https://github.com/apache/spark/pull/25718#issuecomment-530128738 **[Test build #110439 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110439/testReport)** for

[GitHub] [spark] AmplabJenkins removed a comment on issue #25718: [SPARK-28373][DOCS][WebUI] JDBC/ODBC Server Tab

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25718: [SPARK-28373][DOCS][WebUI] JDBC/ODBC Server Tab URL: https://github.com/apache/spark/pull/25718#issuecomment-530131972 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] SparkQA commented on issue #25748: [SPARK-28904][KUBERNETES] Create mount for PvTestSuire

2019-09-10 Thread GitBox
SparkQA commented on issue #25748: [SPARK-28904][KUBERNETES] Create mount for PvTestSuire URL: https://github.com/apache/spark/pull/25748#issuecomment-530133688 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-u

[GitHub] [spark] dongjoon-hyun commented on issue #25742: [SPARK-28939][SQL][FOLLOWUP] Avoid useless Properties

2019-09-10 Thread GitBox
dongjoon-hyun commented on issue #25742: [SPARK-28939][SQL][FOLLOWUP] Avoid useless Properties URL: https://github.com/apache/spark/pull/25742#issuecomment-530135163 Late LGTM. Thank you all! This is an automated message from

[GitHub] [spark] AmplabJenkins commented on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab URL: https://github.com/apache/spark/pull/25723#issuecomment-530136996 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley

[GitHub] [spark] AmplabJenkins commented on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab URL: https://github.com/apache/spark/pull/25723#issuecomment-530136988 Merged build finished. Test PASSed. This is an automate

[GitHub] [spark] AmplabJenkins removed a comment on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab URL: https://github.com/apache/spark/pull/25723#issuecomment-530136988 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab URL: https://github.com/apache/spark/pull/25723#issuecomment-530136996 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.

[GitHub] [spark] SparkQA commented on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab

2019-09-10 Thread GitBox
SparkQA commented on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab URL: https://github.com/apache/spark/pull/25723#issuecomment-530137667 **[Test build #110441 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110441/testReport)** fo

[GitHub] [spark] maryannxue commented on issue #25569: [SPARK-28863][SQL] Introduce AlreadyPlanned, a node that speeds-up planning

2019-09-10 Thread GitBox
maryannxue commented on issue #25569: [SPARK-28863][SQL] Introduce AlreadyPlanned, a node that speeds-up planning URL: https://github.com/apache/spark/pull/25569#issuecomment-530137925 > In addition, if you have queries which you re-run over again with minor parameter changes, you can leve

[GitHub] [spark] juliuszsompolski commented on a change in pull request #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab

2019-09-10 Thread GitBox
juliuszsompolski commented on a change in pull request #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab URL: https://github.com/apache/spark/pull/25723#discussion_r322982490 ## File path: sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/u

[GitHub] [spark] dongjoon-hyun edited a comment on issue #25641: [SPARK-28921][BUILD][K8S][2.4] Update kubernetes client to 4.4.2

2019-09-10 Thread GitBox
dongjoon-hyun edited a comment on issue #25641: [SPARK-28921][BUILD][K8S][2.4] Update kubernetes client to 4.4.2 URL: https://github.com/apache/spark/pull/25641#issuecomment-530138420 Thank you for your understanding, @Jeffwan . I know you guys have own Spark versions, but we want to colla

[GitHub] [spark] dongjoon-hyun commented on issue #25641: [SPARK-28921][BUILD][K8S][2.4] Update kubernetes client to 4.4.2

2019-09-10 Thread GitBox
dongjoon-hyun commented on issue #25641: [SPARK-28921][BUILD][K8S][2.4] Update kubernetes client to 4.4.2 URL: https://github.com/apache/spark/pull/25641#issuecomment-530138420 Thank you for your understanding, @Jeffwan . I know you guys have own Spark versions, but we want to collaborate

[GitHub] [spark] dongjoon-hyun edited a comment on issue #25641: [SPARK-28921][BUILD][K8S][2.4] Update kubernetes client to 4.4.2

2019-09-10 Thread GitBox
dongjoon-hyun edited a comment on issue #25641: [SPARK-28921][BUILD][K8S][2.4] Update kubernetes client to 4.4.2 URL: https://github.com/apache/spark/pull/25641#issuecomment-530138420 Thank you for your understanding, @Jeffwan . I know you guys have own Spark versions, but we want to colla

[GitHub] [spark] SparkQA commented on issue #25748: [SPARK-28904][KUBERNETES] Create mount for PvTestSuire

2019-09-10 Thread GitBox
SparkQA commented on issue #25748: [SPARK-28904][KUBERNETES] Create mount for PvTestSuire URL: https://github.com/apache/spark/pull/25748#issuecomment-530139175 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribu

[GitHub] [spark] AmplabJenkins commented on issue #25748: [SPARK-28904][KUBERNETES] Create mount for PvTestSuire

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25748: [SPARK-28904][KUBERNETES] Create mount for PvTestSuire URL: https://github.com/apache/spark/pull/25748#issuecomment-530139308 Merged build finished. Test FAILed. This is an automated m

[GitHub] [spark] AmplabJenkins removed a comment on issue #25748: [SPARK-28904][KUBERNETES] Create mount for PvTestSuire

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25748: [SPARK-28904][KUBERNETES] Create mount for PvTestSuire URL: https://github.com/apache/spark/pull/25748#issuecomment-530139308 Merged build finished. Test FAILed. This is an aut

[GitHub] [spark] AmplabJenkins commented on issue #25748: [SPARK-28904][KUBERNETES] Create mount for PvTestSuire

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25748: [SPARK-28904][KUBERNETES] Create mount for PvTestSuire URL: https://github.com/apache/spark/pull/25748#issuecomment-530139313 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.ed

[GitHub] [spark] AmplabJenkins removed a comment on issue #25748: [SPARK-28904][KUBERNETES] Create mount for PvTestSuire

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25748: [SPARK-28904][KUBERNETES] Create mount for PvTestSuire URL: https://github.com/apache/spark/pull/25748#issuecomment-530139313 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.ber

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25748: [SPARK-28904][KUBERNETES] Create mount for PvTestSuire

2019-09-10 Thread GitBox
dongjoon-hyun commented on a change in pull request #25748: [SPARK-28904][KUBERNETES] Create mount for PvTestSuire URL: https://github.com/apache/spark/pull/25748#discussion_r322984460 ## File path: resource-managers/kubernetes/integration-tests/src/test/scala/org/apache/spark/depl

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25748: [SPARK-28904][KUBERNETES] Create mount for PvTestSuire

2019-09-10 Thread GitBox
dongjoon-hyun commented on a change in pull request #25748: [SPARK-28904][KUBERNETES] Create mount for PvTestSuire URL: https://github.com/apache/spark/pull/25748#discussion_r322984460 ## File path: resource-managers/kubernetes/integration-tests/src/test/scala/org/apache/spark/depl

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25748: [SPARK-28904][KUBERNETES] Create mount for PvTestSuire

2019-09-10 Thread GitBox
dongjoon-hyun commented on a change in pull request #25748: [SPARK-28904][KUBERNETES] Create mount for PvTestSuire URL: https://github.com/apache/spark/pull/25748#discussion_r322984460 ## File path: resource-managers/kubernetes/integration-tests/src/test/scala/org/apache/spark/depl

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25748: [SPARK-28904][KUBERNETES] Create mount for PvTestSuire

2019-09-10 Thread GitBox
dongjoon-hyun commented on a change in pull request #25748: [SPARK-28904][KUBERNETES] Create mount for PvTestSuire URL: https://github.com/apache/spark/pull/25748#discussion_r322984460 ## File path: resource-managers/kubernetes/integration-tests/src/test/scala/org/apache/spark/depl

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25748: [SPARK-28904][KUBERNETES] Create mount for PvTestSuire

2019-09-10 Thread GitBox
dongjoon-hyun commented on a change in pull request #25748: [SPARK-28904][KUBERNETES] Create mount for PvTestSuire URL: https://github.com/apache/spark/pull/25748#discussion_r322984460 ## File path: resource-managers/kubernetes/integration-tests/src/test/scala/org/apache/spark/depl

[GitHub] [spark] maryannxue commented on a change in pull request #25569: [SPARK-28863][SQL] Introduce AlreadyPlanned, a node that speeds-up planning

2019-09-10 Thread GitBox
maryannxue commented on a change in pull request #25569: [SPARK-28863][SQL] Introduce AlreadyPlanned, a node that speeds-up planning URL: https://github.com/apache/spark/pull/25569#discussion_r322987005 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkStrat

[GitHub] [spark] SparkQA commented on issue #25741: [SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet/Resource

2019-09-10 Thread GitBox
SparkQA commented on issue #25741: [SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet/Resource URL: https://github.com/apache/spark/pull/25741#issuecomment-530142938 **[Test build #110434 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuil

[GitHub] [spark] SparkQA removed a comment on issue #25741: [SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet/Resource

2019-09-10 Thread GitBox
SparkQA removed a comment on issue #25741: [SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet/Resource URL: https://github.com/apache/spark/pull/25741#issuecomment-530097893 **[Test build #110434 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequ

[GitHub] [spark] maryannxue commented on a change in pull request #25569: [SPARK-28863][SQL] Introduce AlreadyPlanned, a node that speeds-up planning

2019-09-10 Thread GitBox
maryannxue commented on a change in pull request #25569: [SPARK-28863][SQL] Introduce AlreadyPlanned, a node that speeds-up planning URL: https://github.com/apache/spark/pull/25569#discussion_r322987833 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasource

[GitHub] [spark] AmplabJenkins commented on issue #25741: [SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet/Resource

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25741: [SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet/Resource URL: https://github.com/apache/spark/pull/25741#issuecomment-530143466 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25741: [SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet/Resource

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25741: [SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet/Resource URL: https://github.com/apache/spark/pull/25741#issuecomment-530143458 Merged build finished. Test PASSed. -

[GitHub] [spark] dongjoon-hyun commented on issue #25734: [SPARK-28939][SQL][2.4] Propagate SQLConf for plans executed by toRdd

2019-09-10 Thread GitBox
dongjoon-hyun commented on issue #25734: [SPARK-28939][SQL][2.4] Propagate SQLConf for plans executed by toRdd URL: https://github.com/apache/spark/pull/25734#issuecomment-530143643 Yes. I'm +1 for @hvanhovell 's advice for the flag. Please add a document for that flag, too. cc @gatorsm

[GitHub] [spark] AmplabJenkins removed a comment on issue #25741: [SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet/Resource

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25741: [SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet/Resource URL: https://github.com/apache/spark/pull/25741#issuecomment-530143458 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins removed a comment on issue #25741: [SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet/Resource

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25741: [SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet/Resource URL: https://github.com/apache/spark/pull/25741#issuecomment-530143466 Test PASSed. Refer to this link for build results (access rights to CI server neede

[GitHub] [spark] maropu commented on issue #25710: [SPARK-29008][SQL] Define an individual method for each common subexpression in HashAggregateExec

2019-09-10 Thread GitBox
maropu commented on issue #25710: [SPARK-29008][SQL] Define an individual method for each common subexpression in HashAggregateExec URL: https://github.com/apache/spark/pull/25710#issuecomment-530144242 ``` (base) maropu@~:$system_profiler SPHardwareDataType Hardware: Hardware

[GitHub] [spark] maropu edited a comment on issue #25710: [SPARK-29008][SQL] Define an individual method for each common subexpression in HashAggregateExec

2019-09-10 Thread GitBox
maropu edited a comment on issue #25710: [SPARK-29008][SQL] Define an individual method for each common subexpression in HashAggregateExec URL: https://github.com/apache/spark/pull/25710#issuecomment-530144242 ``` (base) maropu@~:$system_profiler SPHardwareDataType Hardware: Ha

[GitHub] [spark] maropu edited a comment on issue #25710: [SPARK-29008][SQL] Define an individual method for each common subexpression in HashAggregateExec

2019-09-10 Thread GitBox
maropu edited a comment on issue #25710: [SPARK-29008][SQL] Define an individual method for each common subexpression in HashAggregateExec URL: https://github.com/apache/spark/pull/25710#issuecomment-530144242 I updated the PR description; ``` (base) maropu@~:$system_profiler SPHardwa

[GitHub] [spark] dongjoon-hyun commented on issue #25706: [SPARK-26989][CORE][TEST] DAGSchedulerSuite: ensure listeners are fully processed before checking recorded values

2019-09-10 Thread GitBox
dongjoon-hyun commented on issue #25706: [SPARK-26989][CORE][TEST] DAGSchedulerSuite: ensure listeners are fully processed before checking recorded values URL: https://github.com/apache/spark/pull/25706#issuecomment-530149107 Retest this please. ---

[GitHub] [spark] SparkQA commented on issue #25706: [SPARK-26989][CORE][TEST] DAGSchedulerSuite: ensure listeners are fully processed before checking recorded values

2019-09-10 Thread GitBox
SparkQA commented on issue #25706: [SPARK-26989][CORE][TEST] DAGSchedulerSuite: ensure listeners are fully processed before checking recorded values URL: https://github.com/apache/spark/pull/25706#issuecomment-530149705 **[Test build #110442 has started](https://amplab.cs.berkeley.edu/jenk

[GitHub] [spark] maropu commented on issue #25734: [SPARK-28939][SQL][2.4] Propagate SQLConf for plans executed by toRdd

2019-09-10 Thread GitBox
maropu commented on issue #25734: [SPARK-28939][SQL][2.4] Propagate SQLConf for plans executed by toRdd URL: https://github.com/apache/spark/pull/25734#issuecomment-530149623 +1 for the flag to keep the legacy behaivour. Is that document @dongjoon-hyun suggested the migration guide? Yea, w

[GitHub] [spark] dongjoon-hyun commented on issue #25706: [SPARK-26989][CORE][TEST] DAGSchedulerSuite: ensure listeners are fully processed before checking recorded values

2019-09-10 Thread GitBox
dongjoon-hyun commented on issue #25706: [SPARK-26989][CORE][TEST] DAGSchedulerSuite: ensure listeners are fully processed before checking recorded values URL: https://github.com/apache/spark/pull/25706#issuecomment-530150570 For me, this PR looks fine. Could you review this once more, @va

[GitHub] [spark] AmplabJenkins commented on issue #25706: [SPARK-26989][CORE][TEST] DAGSchedulerSuite: ensure listeners are fully processed before checking recorded values

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25706: [SPARK-26989][CORE][TEST] DAGSchedulerSuite: ensure listeners are fully processed before checking recorded values URL: https://github.com/apache/spark/pull/25706#issuecomment-530150976 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #25706: [SPARK-26989][CORE][TEST] DAGSchedulerSuite: ensure listeners are fully processed before checking recorded values

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25706: [SPARK-26989][CORE][TEST] DAGSchedulerSuite: ensure listeners are fully processed before checking recorded values URL: https://github.com/apache/spark/pull/25706#issuecomment-530150980 Test PASSed. Refer to this link for build results (access rig

[GitHub] [spark] AmplabJenkins removed a comment on issue #25706: [SPARK-26989][CORE][TEST] DAGSchedulerSuite: ensure listeners are fully processed before checking recorded values

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25706: [SPARK-26989][CORE][TEST] DAGSchedulerSuite: ensure listeners are fully processed before checking recorded values URL: https://github.com/apache/spark/pull/25706#issuecomment-530150980 Test PASSed. Refer to this link for build results (ac

[GitHub] [spark] AmplabJenkins removed a comment on issue #25706: [SPARK-26989][CORE][TEST] DAGSchedulerSuite: ensure listeners are fully processed before checking recorded values

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25706: [SPARK-26989][CORE][TEST] DAGSchedulerSuite: ensure listeners are fully processed before checking recorded values URL: https://github.com/apache/spark/pull/25706#issuecomment-530150976 Merged build finished. Test PASSed. ---

[GitHub] [spark] imback82 commented on a change in pull request #25601: [SPARK-28856][SQL] Implement SHOW DATABASES for Data Source V2 Tables

2019-09-10 Thread GitBox
imback82 commented on a change in pull request #25601: [SPARK-28856][SQL] Implement SHOW DATABASES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25601#discussion_r323000931 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSo

[GitHub] [spark] Jeffwan commented on issue #25641: [SPARK-28921][BUILD][K8S][2.4] Update kubernetes client to 4.4.2

2019-09-10 Thread GitBox
Jeffwan commented on issue #25641: [SPARK-28921][BUILD][K8S][2.4] Update kubernetes client to 4.4.2 URL: https://github.com/apache/spark/pull/25641#issuecomment-530157785 @dongjoon-hyun > 1. It would be great if you guys can participate Apache Spark RC vote at the early stages (RC1

[GitHub] [spark] HyukjinKwon opened a new pull request #25749: [SPARK-27995][PYTHON] Allows createDataFrame to accept bytes as binary type

2019-09-10 Thread GitBox
HyukjinKwon opened a new pull request #25749: [SPARK-27995][PYTHON] Allows createDataFrame to accept bytes as binary type URL: https://github.com/apache/spark/pull/25749 ### What changes were proposed in this pull request? This PR proposes to allow `bytes` as an acceptable type for b

[GitHub] [spark] AmplabJenkins removed a comment on issue #24939: [SPARK-18569][ML][R] Support RFormula arithmetic, I() and spark functions

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #24939: [SPARK-18569][ML][R] Support RFormula arithmetic, I() and spark functions URL: https://github.com/apache/spark/pull/24939#issuecomment-530159219 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24939: [SPARK-18569][ML][R] Support RFormula arithmetic, I() and spark functions

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #24939: [SPARK-18569][ML][R] Support RFormula arithmetic, I() and spark functions URL: https://github.com/apache/spark/pull/24939#issuecomment-530159222 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://am

[GitHub] [spark] AmplabJenkins commented on issue #25749: [SPARK-27995][PYTHON] Allows createDataFrame to accept bytes as binary type

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25749: [SPARK-27995][PYTHON] Allows createDataFrame to accept bytes as binary type URL: https://github.com/apache/spark/pull/25749#issuecomment-530159234 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://

[GitHub] [spark] AmplabJenkins commented on issue #25749: [SPARK-27995][PYTHON] Allows createDataFrame to accept bytes as binary type

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25749: [SPARK-27995][PYTHON] Allows createDataFrame to accept bytes as binary type URL: https://github.com/apache/spark/pull/25749#issuecomment-530159229 Merged build finished. Test PASSed. T

[GitHub] [spark] ozancicek commented on a change in pull request #24939: [SPARK-18569][ML][R] Support RFormula arithmetic, I() and spark functions

2019-09-10 Thread GitBox
ozancicek commented on a change in pull request #24939: [SPARK-18569][ML][R] Support RFormula arithmetic, I() and spark functions URL: https://github.com/apache/spark/pull/24939#discussion_r323005147 ## File path: mllib/src/main/scala/org/apache/spark/ml/feature/RFormulaParser.scal

[GitHub] [spark] AmplabJenkins commented on issue #24939: [SPARK-18569][ML][R] Support RFormula arithmetic, I() and spark functions

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #24939: [SPARK-18569][ML][R] Support RFormula arithmetic, I() and spark functions URL: https://github.com/apache/spark/pull/24939#issuecomment-530159219 Merged build finished. Test PASSed. Thi

[GitHub] [spark] SparkQA removed a comment on issue #25741: [SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet/Resource

2019-09-10 Thread GitBox
SparkQA removed a comment on issue #25741: [SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet/Resource URL: https://github.com/apache/spark/pull/25741#issuecomment-530120139 **[Test build #110436 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequ

[GitHub] [spark] AmplabJenkins removed a comment on issue #24939: [SPARK-18569][ML][R] Support RFormula arithmetic, I() and spark functions

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #24939: [SPARK-18569][ML][R] Support RFormula arithmetic, I() and spark functions URL: https://github.com/apache/spark/pull/24939#issuecomment-530159222 Test PASSed. Refer to this link for build results (access rights to CI server needed): ht

[GitHub] [spark] SparkQA commented on issue #25741: [SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet/Resource

2019-09-10 Thread GitBox
SparkQA commented on issue #25741: [SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet/Resource URL: https://github.com/apache/spark/pull/25741#issuecomment-530159359 **[Test build #110436 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuil

[GitHub] [spark] SparkQA commented on issue #24939: [SPARK-18569][ML][R] Support RFormula arithmetic, I() and spark functions

2019-09-10 Thread GitBox
SparkQA commented on issue #24939: [SPARK-18569][ML][R] Support RFormula arithmetic, I() and spark functions URL: https://github.com/apache/spark/pull/24939#issuecomment-530159650 **[Test build #110444 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110444/t

[GitHub] [spark] SparkQA commented on issue #25749: [SPARK-27995][PYTHON] Allows createDataFrame to accept bytes as binary type

2019-09-10 Thread GitBox
SparkQA commented on issue #25749: [SPARK-27995][PYTHON] Allows createDataFrame to accept bytes as binary type URL: https://github.com/apache/spark/pull/25749#issuecomment-530159653 **[Test build #110443 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110443

[GitHub] [spark] AmplabJenkins removed a comment on issue #25749: [SPARK-27995][PYTHON] Allows createDataFrame to accept bytes as binary type

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25749: [SPARK-27995][PYTHON] Allows createDataFrame to accept bytes as binary type URL: https://github.com/apache/spark/pull/25749#issuecomment-530159234 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25741: [SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet/Resource

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25741: [SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet/Resource URL: https://github.com/apache/spark/pull/25741#issuecomment-530159766 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins removed a comment on issue #25741: [SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet/Resource

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25741: [SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet/Resource URL: https://github.com/apache/spark/pull/25741#issuecomment-530159766 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins removed a comment on issue #25749: [SPARK-27995][PYTHON] Allows createDataFrame to accept bytes as binary type

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25749: [SPARK-27995][PYTHON] Allows createDataFrame to accept bytes as binary type URL: https://github.com/apache/spark/pull/25749#issuecomment-530159229 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #25741: [SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet/Resource

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25741: [SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet/Resource URL: https://github.com/apache/spark/pull/25741#issuecomment-530159773 Test PASSed. Refer to this link for build results (access rights to CI server neede

[GitHub] [spark] AmplabJenkins commented on issue #25741: [SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet/Resource

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25741: [SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet/Resource URL: https://github.com/apache/spark/pull/25741#issuecomment-530159773 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] imback82 commented on a change in pull request #25747: [SPARK-29039][SQL] centralize the catalog and table lookup logic

2019-09-10 Thread GitBox
imback82 commented on a change in pull request #25747: [SPARK-29039][SQL] centralize the catalog and table lookup logic URL: https://github.com/apache/spark/pull/25747#discussion_r323006151 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSourceR

[GitHub] [spark] HyukjinKwon commented on issue #25749: [SPARK-27995][PYTHON] Allows createDataFrame to accept bytes as binary type

2019-09-10 Thread GitBox
HyukjinKwon commented on issue #25749: [SPARK-27995][PYTHON] Allows createDataFrame to accept bytes as binary type URL: https://github.com/apache/spark/pull/25749#issuecomment-530160130 cc @ueshin @BryanCutler BTW, I would like to backport this into branch-2.4 if you guys won't mind.

[GitHub] [spark] AmplabJenkins commented on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process URL: https://github.com/apache/spark/pull/25702#issuecomment-530160813 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.c

[GitHub] [spark] AmplabJenkins commented on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process URL: https://github.com/apache/spark/pull/25702#issuecomment-530160810 Merged build finished. Test PASSed. This is a

[GitHub] [spark] AmplabJenkins removed a comment on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process URL: https://github.com/apache/spark/pull/25702#issuecomment-530160813 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://

[GitHub] [spark] AmplabJenkins removed a comment on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process URL: https://github.com/apache/spark/pull/25702#issuecomment-530160810 Merged build finished. Test PASSed. T

[GitHub] [spark] SparkQA commented on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process

2019-09-10 Thread GitBox
SparkQA commented on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process URL: https://github.com/apache/spark/pull/25702#issuecomment-530161220 **[Test build #110445 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110445/testRep

[GitHub] [spark] HyukjinKwon commented on issue #25736: [SPARK-29026][SQL] Improve error message in `schemaFor` in trait without companion object constructor

2019-09-10 Thread GitBox
HyukjinKwon commented on issue #25736: [SPARK-29026][SQL] Improve error message in `schemaFor` in trait without companion object constructor URL: https://github.com/apache/spark/pull/25736#issuecomment-530161511 Merged to master.

[GitHub] [spark] HeartSaVioR commented on a change in pull request #25702: [SPARK-29001][CORE] Print events that take too long time to process

2019-09-10 Thread GitBox
HeartSaVioR commented on a change in pull request #25702: [SPARK-29001][CORE] Print events that take too long time to process URL: https://github.com/apache/spark/pull/25702#discussion_r323007421 ## File path: core/src/main/scala/org/apache/spark/util/ListenerBus.scala ##

[GitHub] [spark] HeartSaVioR commented on a change in pull request #25702: [SPARK-29001][CORE] Print events that take too long time to process

2019-09-10 Thread GitBox
HeartSaVioR commented on a change in pull request #25702: [SPARK-29001][CORE] Print events that take too long time to process URL: https://github.com/apache/spark/pull/25702#discussion_r323007421 ## File path: core/src/main/scala/org/apache/spark/util/ListenerBus.scala ##

[GitHub] [spark] HyukjinKwon closed pull request #25736: [SPARK-29026][SQL] Improve error message in `schemaFor` in trait without companion object constructor

2019-09-10 Thread GitBox
HyukjinKwon closed pull request #25736: [SPARK-29026][SQL] Improve error message in `schemaFor` in trait without companion object constructor URL: https://github.com/apache/spark/pull/25736 This is an automated message from

[GitHub] [spark] jiangxb1987 commented on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process

2019-09-10 Thread GitBox
jiangxb1987 commented on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process URL: https://github.com/apache/spark/pull/25702#issuecomment-530161660 Investigated more and now I think we shall directly log the events that take too log to process. We already have

[GitHub] [spark] HeartSaVioR commented on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server

2019-09-10 Thread GitBox
HeartSaVioR commented on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server URL: https://github.com/apache/spark/pull/25705#issuecomment-530161932 You can find all implementations for ApplicationHistoryProvider in IDE, for me, IntelliJ. Other than FsHistoryPr

[GitHub] [spark] HeartSaVioR edited a comment on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server

2019-09-10 Thread GitBox
HeartSaVioR edited a comment on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server URL: https://github.com/apache/spark/pull/25705#issuecomment-530161932 You can find all implementations for ApplicationHistoryProvider in IDE, for me, IntelliJ. Other than FsHi

[GitHub] [spark] AmplabJenkins removed a comment on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process URL: https://github.com/apache/spark/pull/25702#issuecomment-530162332 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://

[GitHub] [spark] AmplabJenkins commented on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process URL: https://github.com/apache/spark/pull/25702#issuecomment-530162332 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.c

[GitHub] [spark] AmplabJenkins removed a comment on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process URL: https://github.com/apache/spark/pull/25702#issuecomment-530162331 Merged build finished. Test PASSed. T

[GitHub] [spark] AmplabJenkins commented on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process URL: https://github.com/apache/spark/pull/25702#issuecomment-530162331 Merged build finished. Test PASSed. This is a

[GitHub] [spark] SparkQA commented on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process

2019-09-10 Thread GitBox
SparkQA commented on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process URL: https://github.com/apache/spark/pull/25702#issuecomment-530162729 **[Test build #110446 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110446/testRep

[GitHub] [spark] imback82 commented on a change in pull request #25747: [SPARK-29039][SQL] centralize the catalog and table lookup logic

2019-09-10 Thread GitBox
imback82 commented on a change in pull request #25747: [SPARK-29039][SQL] centralize the catalog and table lookup logic URL: https://github.com/apache/spark/pull/25747#discussion_r323009111 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalog/v2/LookupCatalog.scal

[GitHub] [spark] SparkQA commented on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab

2019-09-10 Thread GitBox
SparkQA commented on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab URL: https://github.com/apache/spark/pull/25723#issuecomment-530163414 **[Test build #110440 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110440/testReport)** f

[GitHub] [spark] SparkQA removed a comment on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab

2019-09-10 Thread GitBox
SparkQA removed a comment on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab URL: https://github.com/apache/spark/pull/25723#issuecomment-530131036 **[Test build #110440 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110440/testRepor

[GitHub] [spark] AmplabJenkins commented on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab URL: https://github.com/apache/spark/pull/25723#issuecomment-530163757 Merged build finished. Test PASSed. This is an automate

[GitHub] [spark] AmplabJenkins commented on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab URL: https://github.com/apache/spark/pull/25723#issuecomment-530163762 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.

[GitHub] [spark] ulysses-you commented on issue #25464: [SPARK-28746][SQL] Add partitionby hint for sql queries

2019-09-10 Thread GitBox
ulysses-you commented on issue #25464: [SPARK-28746][SQL] Add partitionby hint for sql queries URL: https://github.com/apache/spark/pull/25464#issuecomment-530163688 retest this please This is an automated message from the A

[GitHub] [spark] AmplabJenkins removed a comment on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab URL: https://github.com/apache/spark/pull/25723#issuecomment-530163762 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.b

[GitHub] [spark] AmplabJenkins removed a comment on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab URL: https://github.com/apache/spark/pull/25723#issuecomment-530163757 Merged build finished. Test PASSed. This is an

[GitHub] [spark] vanzin commented on a change in pull request #25725: [SPARK-24663][STREAMING][TESTS] StreamingContextSuite: Wait until slow receiver has been initialized, but with hard timeout

2019-09-10 Thread GitBox
vanzin commented on a change in pull request #25725: [SPARK-24663][STREAMING][TESTS] StreamingContextSuite: Wait until slow receiver has been initialized, but with hard timeout URL: https://github.com/apache/spark/pull/25725#discussion_r323011921 ## File path: streaming/src/test/s

[GitHub] [spark] SparkQA commented on issue #25749: [SPARK-29041][PYTHON] Allows createDataFrame to accept bytes as binary type

2019-09-10 Thread GitBox
SparkQA commented on issue #25749: [SPARK-29041][PYTHON] Allows createDataFrame to accept bytes as binary type URL: https://github.com/apache/spark/pull/25749#issuecomment-530165971 **[Test build #110443 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/11044

[GitHub] [spark] vanzin commented on a change in pull request #25725: [SPARK-24663][STREAMING][TESTS] StreamingContextSuite: Wait until slow receiver has been initialized, but with hard timeout

2019-09-10 Thread GitBox
vanzin commented on a change in pull request #25725: [SPARK-24663][STREAMING][TESTS] StreamingContextSuite: Wait until slow receiver has been initialized, but with hard timeout URL: https://github.com/apache/spark/pull/25725#discussion_r323011921 ## File path: streaming/src/test/s

<    3   4   5   6   7   8   9   10   11   >