[GitHub] [spark] SparkQA commented on issue #26250: [SPARK-28560][SQL][followup] change the local shuffle reader from leaf node to unary node

2019-10-27 Thread GitBox
SparkQA commented on issue #26250: [SPARK-28560][SQL][followup] change the local shuffle reader from leaf node to unary node URL: https://github.com/apache/spark/pull/26250#issuecomment-546802365 **[Test build #112748 has

[GitHub] [spark] SparkQA removed a comment on issue #26277: [DO-NOT-MERGE] Investigate Appveyor failure of preview

2019-10-27 Thread GitBox
SparkQA removed a comment on issue #26277: [DO-NOT-MERGE] Investigate Appveyor failure of preview URL: https://github.com/apache/spark/pull/26277#issuecomment-546773407 **[Test build #112751 has

[GitHub] [spark] AmplabJenkins commented on issue #26277: [DO-NOT-MERGE] Investigate Appveyor failure of preview

2019-10-27 Thread GitBox
AmplabJenkins commented on issue #26277: [DO-NOT-MERGE] Investigate Appveyor failure of preview URL: https://github.com/apache/spark/pull/26277#issuecomment-546800087 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26277: [DO-NOT-MERGE] Investigate Appveyor failure of preview

2019-10-27 Thread GitBox
AmplabJenkins commented on issue #26277: [DO-NOT-MERGE] Investigate Appveyor failure of preview URL: https://github.com/apache/spark/pull/26277#issuecomment-546800083 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #26277: [DO-NOT-MERGE] Investigate Appveyor failure of preview

2019-10-27 Thread GitBox
AmplabJenkins removed a comment on issue #26277: [DO-NOT-MERGE] Investigate Appveyor failure of preview URL: https://github.com/apache/spark/pull/26277#issuecomment-546800087 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26277: [DO-NOT-MERGE] Investigate Appveyor failure of preview

2019-10-27 Thread GitBox
AmplabJenkins removed a comment on issue #26277: [DO-NOT-MERGE] Investigate Appveyor failure of preview URL: https://github.com/apache/spark/pull/26277#issuecomment-546800083 Merged build finished. Test PASSed. This is an

[GitHub] [spark] SparkQA commented on issue #26277: [DO-NOT-MERGE] Investigate Appveyor failure of preview

2019-10-27 Thread GitBox
SparkQA commented on issue #26277: [DO-NOT-MERGE] Investigate Appveyor failure of preview URL: https://github.com/apache/spark/pull/26277#issuecomment-546799754 **[Test build #112751 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112751/testReport)** for

[GitHub] [spark] maropu commented on a change in pull request #26238: [SPARK-29110][SQL][TESTS] Port window.sql (Part 4)

2019-10-27 Thread GitBox
maropu commented on a change in pull request #26238: [SPARK-29110][SQL][TESTS] Port window.sql (Part 4) URL: https://github.com/apache/spark/pull/26238#discussion_r339405667 ## File path: sql/core/src/test/resources/sql-tests/results/postgreSQL/window_part4.sql.out ## @@

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3)

2019-10-27 Thread GitBox
dongjoon-hyun commented on a change in pull request #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3) URL: https://github.com/apache/spark/pull/26274#discussion_r339405612 ## File path: sql/core/src/test/resources/sql-tests/inputs/postgreSQL/window_part3.sql ##

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3)

2019-10-27 Thread GitBox
dongjoon-hyun commented on a change in pull request #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3) URL: https://github.com/apache/spark/pull/26274#discussion_r339404965 ## File path: sql/core/src/test/resources/sql-tests/inputs/postgreSQL/window_part3.sql ##

[GitHub] [spark] vibhutisawant commented on a change in pull request #26254: [SPARK-26985][CORE] Fix "access only some column of the all of columns " for big endian architecture

2019-10-27 Thread GitBox
vibhutisawant commented on a change in pull request #26254: [SPARK-26985][CORE] Fix "access only some column of the all of columns " for big endian architecture URL: https://github.com/apache/spark/pull/26254#discussion_r339404850 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3)

2019-10-27 Thread GitBox
dongjoon-hyun commented on a change in pull request #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3) URL: https://github.com/apache/spark/pull/26274#discussion_r339404721 ## File path: sql/core/src/test/resources/sql-tests/inputs/postgreSQL/window_part3.sql ##

[GitHub] [spark] zhengruifeng commented on issue #26247: [SPARK-29566][ML] Imputer should support single-column input/output

2019-10-27 Thread GitBox
zhengruifeng commented on issue #26247: [SPARK-29566][ML] Imputer should support single-column input/output URL: https://github.com/apache/spark/pull/26247#issuecomment-546793406 @huaxingao You need to rebase this PR. This

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3)

2019-10-27 Thread GitBox
dongjoon-hyun commented on a change in pull request #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3) URL: https://github.com/apache/spark/pull/26274#discussion_r339404243 ## File path: sql/core/src/test/resources/sql-tests/inputs/postgreSQL/window_part3.sql ##

[GitHub] [spark] zhengruifeng commented on issue #26265: [SPARK-29565][ML][PYTHON] OneHotEncoder should support single-column input/output

2019-10-27 Thread GitBox
zhengruifeng commented on issue #26265: [SPARK-29565][ML][PYTHON] OneHotEncoder should support single-column input/output URL: https://github.com/apache/spark/pull/26265#issuecomment-546793321 @huaxingao You need to rebase this PR.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3)

2019-10-27 Thread GitBox
AmplabJenkins removed a comment on issue #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3) URL: https://github.com/apache/spark/pull/26274#issuecomment-546792742 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3)

2019-10-27 Thread GitBox
AmplabJenkins removed a comment on issue #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3) URL: https://github.com/apache/spark/pull/26274#issuecomment-546792736 Merged build finished. Test PASSed. This is an

[GitHub] [spark] fuwhu closed pull request #26275: [SPARK-29615][SQL]Add a new insertInto method with byName parameter in DataFrameWriter.

2019-10-27 Thread GitBox
fuwhu closed pull request #26275: [SPARK-29615][SQL]Add a new insertInto method with byName parameter in DataFrameWriter. URL: https://github.com/apache/spark/pull/26275 This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins commented on issue #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3)

2019-10-27 Thread GitBox
AmplabJenkins commented on issue #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3) URL: https://github.com/apache/spark/pull/26274#issuecomment-546792736 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3)

2019-10-27 Thread GitBox
AmplabJenkins commented on issue #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3) URL: https://github.com/apache/spark/pull/26274#issuecomment-546792742 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] fuwhu commented on issue #26275: [SPARK-29615][SQL]Add a new insertInto method with byName parameter in DataFrameWriter.

2019-10-27 Thread GitBox
fuwhu commented on issue #26275: [SPARK-29615][SQL]Add a new insertInto method with byName parameter in DataFrameWriter. URL: https://github.com/apache/spark/pull/26275#issuecomment-546792636 @maropu ok, make sense, thanks. Will close this PR.

[GitHub] [spark] SparkQA removed a comment on issue #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3)

2019-10-27 Thread GitBox
SparkQA removed a comment on issue #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3) URL: https://github.com/apache/spark/pull/26274#issuecomment-546758084 **[Test build #112744 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112744/testReport)**

[GitHub] [spark] SparkQA commented on issue #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3)

2019-10-27 Thread GitBox
SparkQA commented on issue #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3) URL: https://github.com/apache/spark/pull/26274#issuecomment-546792421 **[Test build #112744 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112744/testReport)** for PR

[GitHub] [spark] cloud-fan commented on a change in pull request #26262: [SPARK-29609][SQL] DataSourceV2: Support DROP NAMESPACE

2019-10-27 Thread GitBox
cloud-fan commented on a change in pull request #26262: [SPARK-29609][SQL] DataSourceV2: Support DROP NAMESPACE URL: https://github.com/apache/spark/pull/26262#discussion_r339403430 ## File path:

[GitHub] [spark] dongjoon-hyun commented on issue #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3)

2019-10-27 Thread GitBox
dongjoon-hyun commented on issue #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3) URL: https://github.com/apache/spark/pull/26274#issuecomment-546791988 Thank you for pinging me, @maropu . I'll take a look now.

[GitHub] [spark] maropu edited a comment on issue #26275: [SPARK-29615][SQL]Add a new insertInto method with byName parameter in DataFrameWriter.

2019-10-27 Thread GitBox
maropu edited a comment on issue #26275: [SPARK-29615][SQL]Add a new insertInto method with byName parameter in DataFrameWriter. URL: https://github.com/apache/spark/pull/26275#issuecomment-546790898 > When we write SQL query to insert data, we can hardly trigger such problem, but if we

[GitHub] [spark] viirya commented on a change in pull request #26265: [SPARK-29565][ML][PYTHON] OneHotEncoder should support single-column input/output

2019-10-27 Thread GitBox
viirya commented on a change in pull request #26265: [SPARK-29565][ML][PYTHON] OneHotEncoder should support single-column input/output URL: https://github.com/apache/spark/pull/26265#discussion_r339402791 ## File path:

[GitHub] [spark] maropu commented on issue #26275: [SPARK-29615][SQL]Add a new insertInto method with byName parameter in DataFrameWriter.

2019-10-27 Thread GitBox
maropu commented on issue #26275: [SPARK-29615][SQL]Add a new insertInto method with byName parameter in DataFrameWriter. URL: https://github.com/apache/spark/pull/26275#issuecomment-546790898 > When we write SQL query to insert data, we can hardly trigger such problem, but if we use the

[GitHub] [spark] cloud-fan commented on issue #26256: [SPARK-29605][SQL] Optimize string to interval casting

2019-10-27 Thread GitBox
cloud-fan commented on issue #26256: [SPARK-29605][SQL] Optimize string to interval casting URL: https://github.com/apache/spark/pull/26256#issuecomment-546790394 This might be different from `INTERVAL'...'`. Does casting string to interval type allows leading "interval" in the string?

[GitHub] [spark] cloud-fan commented on issue #26267: [SPARK-29008][SQL][FOLLOW-UP] Checks correct param lengths of split methods

2019-10-27 Thread GitBox
cloud-fan commented on issue #26267: [SPARK-29008][SQL][FOLLOW-UP] Checks correct param lengths of split methods URL: https://github.com/apache/spark/pull/26267#issuecomment-546789988 late LGTM, good catch! This is an

[GitHub] [spark] maropu commented on issue #26267: [SPARK-29008][SQL][FOLLOW-UP] Checks correct param lengths of split methods

2019-10-27 Thread GitBox
maropu commented on issue #26267: [SPARK-29008][SQL][FOLLOW-UP] Checks correct param lengths of split methods URL: https://github.com/apache/spark/pull/26267#issuecomment-546789913 Thanks for the merging, @dongjoon-hyun !

[GitHub] [spark] maropu commented on issue #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3)

2019-10-27 Thread GitBox
maropu commented on issue #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3) URL: https://github.com/apache/spark/pull/26274#issuecomment-546789734 cc: @HyukjinKwon @dongjoon-hyun This is an automated message from

[GitHub] [spark] dongjoon-hyun closed pull request #26267: [SPARK-29008][SQL][FOLLOW-UP] Checks correct param lengths of split methods

2019-10-27 Thread GitBox
dongjoon-hyun closed pull request #26267: [SPARK-29008][SQL][FOLLOW-UP] Checks correct param lengths of split methods URL: https://github.com/apache/spark/pull/26267 This is an automated message from the Apache Git Service.

[GitHub] [spark] turboFei commented on issue #26272: [SPARK-27736][Core][SHUFFLE] Improve handling of FetchFailures caused by ExternalShuffleService losing track of executor registrations

2019-10-27 Thread GitBox
turboFei commented on issue #26272: [SPARK-27736][Core][SHUFFLE] Improve handling of FetchFailures caused by ExternalShuffleService losing track of executor registrations URL: https://github.com/apache/spark/pull/26272#issuecomment-546788624 cc @JoshRosen @tgravescs

[GitHub] [spark] turboFei commented on issue #26086: [SPARK-29302] Make the file name of a task for dynamic partition overwrite be unique

2019-10-27 Thread GitBox
turboFei commented on issue #26086: [SPARK-29302] Make the file name of a task for dynamic partition overwrite be unique URL: https://github.com/apache/spark/pull/26086#issuecomment-546787001 @vanzin Hi, Could you help take a look? Thanks in advance.

[GitHub] [spark] AmplabJenkins commented on issue #26201: [SPARK-29543][SS][UI] Init structured streaming ui

2019-10-27 Thread GitBox
AmplabJenkins commented on issue #26201: [SPARK-29543][SS][UI] Init structured streaming ui URL: https://github.com/apache/spark/pull/26201#issuecomment-546785292 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26243: Prepare Spark release v3.0.0-preview-rc1

2019-10-27 Thread GitBox
AmplabJenkins removed a comment on issue #26243: Prepare Spark release v3.0.0-preview-rc1 URL: https://github.com/apache/spark/pull/26243#issuecomment-546785249 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26201: [SPARK-29543][SS][UI] Init structured streaming ui

2019-10-27 Thread GitBox
AmplabJenkins removed a comment on issue #26201: [SPARK-29543][SS][UI] Init structured streaming ui URL: https://github.com/apache/spark/pull/26201#issuecomment-546785287 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #26201: [SPARK-29543][SS][UI] Init structured streaming ui

2019-10-27 Thread GitBox
AmplabJenkins removed a comment on issue #26201: [SPARK-29543][SS][UI] Init structured streaming ui URL: https://github.com/apache/spark/pull/26201#issuecomment-546785292 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] HyukjinKwon commented on issue #26243: Prepare Spark release v3.0.0-preview-rc1

2019-10-27 Thread GitBox
HyukjinKwon commented on issue #26243: Prepare Spark release v3.0.0-preview-rc1 URL: https://github.com/apache/spark/pull/26243#issuecomment-546784155 AppVeyor failure seems related with scala-maven-plugin upgrade from a cursory look, which I will continue to investigate at

[GitHub] [spark] HyukjinKwon closed pull request #26277: [DO-NOT-MERGE] Investigate Appveyor failure of preview

2019-10-27 Thread GitBox
HyukjinKwon closed pull request #26277: [DO-NOT-MERGE] Investigate Appveyor failure of preview URL: https://github.com/apache/spark/pull/26277 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] AmplabJenkins removed a comment on issue #26201: [SPARK-29543][SS][UI] Init structured streaming ui

2019-10-27 Thread GitBox
AmplabJenkins removed a comment on issue #26201: [SPARK-29543][SS][UI] Init structured streaming ui URL: https://github.com/apache/spark/pull/26201#issuecomment-546783690 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] dongjoon-hyun closed pull request #26276: [SPARK-29617][BUILD] Upgrade to ORC 1.5.7

2019-10-27 Thread GitBox
dongjoon-hyun closed pull request #26276: [SPARK-29617][BUILD] Upgrade to ORC 1.5.7 URL: https://github.com/apache/spark/pull/26276 This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins removed a comment on issue #26201: [SPARK-29543][SS][UI] Init structured streaming ui

2019-10-27 Thread GitBox
AmplabJenkins removed a comment on issue #26201: [SPARK-29543][SS][UI] Init structured streaming ui URL: https://github.com/apache/spark/pull/26201#issuecomment-546783687 Merged build finished. Test FAILed. This is an

[GitHub] [spark] SparkQA removed a comment on issue #26201: [SPARK-29543][SS][UI] Init structured streaming ui

2019-10-27 Thread GitBox
SparkQA removed a comment on issue #26201: [SPARK-29543][SS][UI] Init structured streaming ui URL: https://github.com/apache/spark/pull/26201#issuecomment-546782914 **[Test build #112753 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112753/testReport)**

[GitHub] [spark] dongjoon-hyun commented on issue #26276: [SPARK-29617][BUILD] Upgrade to ORC 1.5.7

2019-10-27 Thread GitBox
dongjoon-hyun commented on issue #26276: [SPARK-29617][BUILD] Upgrade to ORC 1.5.7 URL: https://github.com/apache/spark/pull/26276#issuecomment-546783817 Thank you for review and approval, @HyukjinKwon . Merged to master!

[GitHub] [spark] SparkQA commented on issue #26201: [SPARK-29543][SS][UI] Init structured streaming ui

2019-10-27 Thread GitBox
SparkQA commented on issue #26201: [SPARK-29543][SS][UI] Init structured streaming ui URL: https://github.com/apache/spark/pull/26201#issuecomment-546783681 **[Test build #112753 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112753/testReport)** for PR

[GitHub] [spark] AmplabJenkins removed a comment on issue #25964: [SPARK-29287][Core] Add ExecutorConstructed message to tell driver which executor is ready for making offers

2019-10-27 Thread GitBox
AmplabJenkins removed a comment on issue #25964: [SPARK-29287][Core] Add ExecutorConstructed message to tell driver which executor is ready for making offers URL: https://github.com/apache/spark/pull/25964#issuecomment-546783534 Test FAILed. Refer to this link for build results (access

[GitHub] [spark] AmplabJenkins commented on issue #26201: [SPARK-29543][SS][UI] Init structured streaming ui

2019-10-27 Thread GitBox
AmplabJenkins commented on issue #26201: [SPARK-29543][SS][UI] Init structured streaming ui URL: https://github.com/apache/spark/pull/26201#issuecomment-546783690 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] uncleGen commented on a change in pull request #26201: [SPARK-29543][SS][UI] Init structured streaming ui

2019-10-27 Thread GitBox
uncleGen commented on a change in pull request #26201: [SPARK-29543][SS][UI] Init structured streaming ui URL: https://github.com/apache/spark/pull/26201#discussion_r339397373 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/ProgressReporter.scala

[GitHub] [spark] AmplabJenkins commented on issue #26201: [SPARK-29543][SS][UI] Init structured streaming ui

2019-10-27 Thread GitBox
AmplabJenkins commented on issue #26201: [SPARK-29543][SS][UI] Init structured streaming ui URL: https://github.com/apache/spark/pull/26201#issuecomment-546783687 Merged build finished. Test FAILed. This is an automated

[GitHub] [spark] uncleGen commented on a change in pull request #26201: [SPARK-29543][SS][UI] Init structured streaming ui

2019-10-27 Thread GitBox
uncleGen commented on a change in pull request #26201: [SPARK-29543][SS][UI] Init structured streaming ui URL: https://github.com/apache/spark/pull/26201#discussion_r339397373 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/ProgressReporter.scala

[GitHub] [spark] AmplabJenkins commented on issue #25964: [SPARK-29287][Core] Add ExecutorConstructed message to tell driver which executor is ready for making offers

2019-10-27 Thread GitBox
AmplabJenkins commented on issue #25964: [SPARK-29287][Core] Add ExecutorConstructed message to tell driver which executor is ready for making offers URL: https://github.com/apache/spark/pull/25964#issuecomment-546783531 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #25964: [SPARK-29287][Core] Add ExecutorConstructed message to tell driver which executor is ready for making offers

2019-10-27 Thread GitBox
SparkQA removed a comment on issue #25964: [SPARK-29287][Core] Add ExecutorConstructed message to tell driver which executor is ready for making offers URL: https://github.com/apache/spark/pull/25964#issuecomment-546765849 **[Test build #112746 has

[GitHub] [spark] AmplabJenkins commented on issue #25964: [SPARK-29287][Core] Add ExecutorConstructed message to tell driver which executor is ready for making offers

2019-10-27 Thread GitBox
AmplabJenkins commented on issue #25964: [SPARK-29287][Core] Add ExecutorConstructed message to tell driver which executor is ready for making offers URL: https://github.com/apache/spark/pull/25964#issuecomment-546783534 Test FAILed. Refer to this link for build results (access rights

[GitHub] [spark] AmplabJenkins removed a comment on issue #25964: [SPARK-29287][Core] Add ExecutorConstructed message to tell driver which executor is ready for making offers

2019-10-27 Thread GitBox
AmplabJenkins removed a comment on issue #25964: [SPARK-29287][Core] Add ExecutorConstructed message to tell driver which executor is ready for making offers URL: https://github.com/apache/spark/pull/25964#issuecomment-546783531 Merged build finished. Test FAILed.

[GitHub] [spark] uncleGen commented on a change in pull request #26201: [SPARK-29543][SS][UI] Init structured streaming ui

2019-10-27 Thread GitBox
uncleGen commented on a change in pull request #26201: [SPARK-29543][SS][UI] Init structured streaming ui URL: https://github.com/apache/spark/pull/26201#discussion_r338354384 ## File path: core/src/main/scala/org/apache/spark/ui/UIUtils.scala ## @@ -119,6 +119,59 @@

[GitHub] [spark] SparkQA commented on issue #25964: [SPARK-29287][Core] Add ExecutorConstructed message to tell driver which executor is ready for making offers

2019-10-27 Thread GitBox
SparkQA commented on issue #25964: [SPARK-29287][Core] Add ExecutorConstructed message to tell driver which executor is ready for making offers URL: https://github.com/apache/spark/pull/25964#issuecomment-546783435 **[Test build #112746 has

[GitHub] [spark] uncleGen commented on a change in pull request #26201: [SPARK-29543][SS][UI] Init structured streaming ui

2019-10-27 Thread GitBox
uncleGen commented on a change in pull request #26201: [SPARK-29543][SS][UI] Init structured streaming ui URL: https://github.com/apache/spark/pull/26201#discussion_r338353460 ## File path: core/src/main/scala/org/apache/spark/ui/GraphUIData.scala ## @@ -0,0 +1,169 @@ +/*

[GitHub] [spark] AmplabJenkins removed a comment on issue #26201: [SPARK-29543][SS][UI] Init structured streaming ui

2019-10-27 Thread GitBox
AmplabJenkins removed a comment on issue #26201: [SPARK-29543][SS][UI] Init structured streaming ui URL: https://github.com/apache/spark/pull/26201#issuecomment-546783110 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26201: [SPARK-29543][SS][UI] Init structured streaming ui

2019-10-27 Thread GitBox
AmplabJenkins commented on issue #26201: [SPARK-29543][SS][UI] Init structured streaming ui URL: https://github.com/apache/spark/pull/26201#issuecomment-546783110 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26201: [SPARK-29543][SS][UI] Init structured streaming ui

2019-10-27 Thread GitBox
AmplabJenkins removed a comment on issue #26201: [SPARK-29543][SS][UI] Init structured streaming ui URL: https://github.com/apache/spark/pull/26201#issuecomment-546783106 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #26201: [SPARK-29543][SS][UI] Init structured streaming ui

2019-10-27 Thread GitBox
AmplabJenkins commented on issue #26201: [SPARK-29543][SS][UI] Init structured streaming ui URL: https://github.com/apache/spark/pull/26201#issuecomment-546783106 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] uncleGen commented on a change in pull request #26201: [SPARK-29543][SS][UI] Init structured streaming ui

2019-10-27 Thread GitBox
uncleGen commented on a change in pull request #26201: [SPARK-29543][SS][UI] Init structured streaming ui URL: https://github.com/apache/spark/pull/26201#discussion_r338353460 ## File path: core/src/main/scala/org/apache/spark/ui/GraphUIData.scala ## @@ -0,0 +1,169 @@ +/*

[GitHub] [spark] SparkQA commented on issue #26201: [SPARK-29543][SS][UI] Init structured streaming ui

2019-10-27 Thread GitBox
SparkQA commented on issue #26201: [SPARK-29543][SS][UI] Init structured streaming ui URL: https://github.com/apache/spark/pull/26201#issuecomment-546782914 **[Test build #112753 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112753/testReport)** for PR

[GitHub] [spark] uncleGen commented on a change in pull request #26201: [SPARK-29543][SS][UI] Init structured streaming ui

2019-10-27 Thread GitBox
uncleGen commented on a change in pull request #26201: [SPARK-29543][SS][UI] Init structured streaming ui URL: https://github.com/apache/spark/pull/26201#discussion_r339396889 ## File path: sql/core/src/main/scala/org/apache/spark/sql/internal/SharedState.scala ## @@

[GitHub] [spark] AmplabJenkins removed a comment on issue #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3)

2019-10-27 Thread GitBox
AmplabJenkins removed a comment on issue #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3) URL: https://github.com/apache/spark/pull/26274#issuecomment-546782473 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3)

2019-10-27 Thread GitBox
AmplabJenkins removed a comment on issue #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3) URL: https://github.com/apache/spark/pull/26274#issuecomment-546782475 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3)

2019-10-27 Thread GitBox
AmplabJenkins commented on issue #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3) URL: https://github.com/apache/spark/pull/26274#issuecomment-546782473 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3)

2019-10-27 Thread GitBox
AmplabJenkins commented on issue #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3) URL: https://github.com/apache/spark/pull/26274#issuecomment-546782475 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3)

2019-10-27 Thread GitBox
SparkQA removed a comment on issue #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3) URL: https://github.com/apache/spark/pull/26274#issuecomment-546751332 **[Test build #112741 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112741/testReport)**

[GitHub] [spark] SparkQA commented on issue #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3)

2019-10-27 Thread GitBox
SparkQA commented on issue #26274: [SPARK-29109][SQL][TESTS] Port window.sql (Part 3) URL: https://github.com/apache/spark/pull/26274#issuecomment-546782230 **[Test build #112741 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112741/testReport)** for PR

[GitHub] [spark] AmplabJenkins removed a comment on issue #26278: [DO-NOT-MERBE] Investigate Appveyor failure of master

2019-10-27 Thread GitBox
AmplabJenkins removed a comment on issue #26278: [DO-NOT-MERBE] Investigate Appveyor failure of master URL: https://github.com/apache/spark/pull/26278#issuecomment-546780452 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #26278: [DO-NOT-MERBE] Investigate Appveyor failure of master

2019-10-27 Thread GitBox
AmplabJenkins removed a comment on issue #26278: [DO-NOT-MERBE] Investigate Appveyor failure of master URL: https://github.com/apache/spark/pull/26278#issuecomment-546780455 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #26278: [DO-NOT-MERBE] Investigate Appveyor failure of master

2019-10-27 Thread GitBox
SparkQA removed a comment on issue #26278: [DO-NOT-MERBE] Investigate Appveyor failure of master URL: https://github.com/apache/spark/pull/26278#issuecomment-546774608 **[Test build #112752 has

[GitHub] [spark] AmplabJenkins commented on issue #26278: [DO-NOT-MERBE] Investigate Appveyor failure of master

2019-10-27 Thread GitBox
AmplabJenkins commented on issue #26278: [DO-NOT-MERBE] Investigate Appveyor failure of master URL: https://github.com/apache/spark/pull/26278#issuecomment-546780455 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26278: [DO-NOT-MERBE] Investigate Appveyor failure of master

2019-10-27 Thread GitBox
AmplabJenkins commented on issue #26278: [DO-NOT-MERBE] Investigate Appveyor failure of master URL: https://github.com/apache/spark/pull/26278#issuecomment-546780452 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] SparkQA commented on issue #26278: [DO-NOT-MERBE] Investigate Appveyor failure of master

2019-10-27 Thread GitBox
SparkQA commented on issue #26278: [DO-NOT-MERBE] Investigate Appveyor failure of master URL: https://github.com/apache/spark/pull/26278#issuecomment-546780392 **[Test build #112752 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112752/testReport)** for

[GitHub] [spark] zhengruifeng commented on issue #26232: [SPARK-29093][PYTHON][ML] Remove automatically generated param setters in _shared_params_code_gen.py

2019-10-27 Thread GitBox
zhengruifeng commented on issue #26232: [SPARK-29093][PYTHON][ML] Remove automatically generated param setters in _shared_params_code_gen.py URL: https://github.com/apache/spark/pull/26232#issuecomment-546779142 merged to master, thanks @huaxingao ! After this PR, the py hierarchy

[GitHub] [spark] zhengruifeng closed pull request #26232: [SPARK-29093][PYTHON][ML] Remove automatically generated param setters in _shared_params_code_gen.py

2019-10-27 Thread GitBox
zhengruifeng closed pull request #26232: [SPARK-29093][PYTHON][ML] Remove automatically generated param setters in _shared_params_code_gen.py URL: https://github.com/apache/spark/pull/26232 This is an automated message from

[GitHub] [spark] AmplabJenkins removed a comment on issue #26276: [SPARK-29617][BUILD] Upgrade to ORC 1.5.7

2019-10-27 Thread GitBox
AmplabJenkins removed a comment on issue #26276: [SPARK-29617][BUILD] Upgrade to ORC 1.5.7 URL: https://github.com/apache/spark/pull/26276#issuecomment-546778491 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26276: [SPARK-29617][BUILD] Upgrade to ORC 1.5.7

2019-10-27 Thread GitBox
AmplabJenkins removed a comment on issue #26276: [SPARK-29617][BUILD] Upgrade to ORC 1.5.7 URL: https://github.com/apache/spark/pull/26276#issuecomment-546778487 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] turboFei commented on issue #26272: [SPARK-27736][Core][SHUFFLE] Improve handling of FetchFailures caused by ExternalShuffleService losing track of executor registrations

2019-10-27 Thread GitBox
turboFei commented on issue #26272: [SPARK-27736][Core][SHUFFLE] Improve handling of FetchFailures caused by ExternalShuffleService losing track of executor registrations URL: https://github.com/apache/spark/pull/26272#issuecomment-546778459 @squito Hi, can you help take a look at this

[GitHub] [spark] AmplabJenkins commented on issue #26276: [SPARK-29617][BUILD] Upgrade to ORC 1.5.7

2019-10-27 Thread GitBox
AmplabJenkins commented on issue #26276: [SPARK-29617][BUILD] Upgrade to ORC 1.5.7 URL: https://github.com/apache/spark/pull/26276#issuecomment-546778491 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26276: [SPARK-29617][BUILD] Upgrade to ORC 1.5.7

2019-10-27 Thread GitBox
AmplabJenkins commented on issue #26276: [SPARK-29617][BUILD] Upgrade to ORC 1.5.7 URL: https://github.com/apache/spark/pull/26276#issuecomment-546778487 Merged build finished. Test PASSed. This is an automated message from

[GitHub] [spark] SparkQA removed a comment on issue #26276: [SPARK-29617][BUILD] Upgrade to ORC 1.5.7

2019-10-27 Thread GitBox
SparkQA removed a comment on issue #26276: [SPARK-29617][BUILD] Upgrade to ORC 1.5.7 URL: https://github.com/apache/spark/pull/26276#issuecomment-546755977 **[Test build #112743 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112743/testReport)** for PR

[GitHub] [spark] SparkQA commented on issue #26276: [SPARK-29617][BUILD] Upgrade to ORC 1.5.7

2019-10-27 Thread GitBox
SparkQA commented on issue #26276: [SPARK-29617][BUILD] Upgrade to ORC 1.5.7 URL: https://github.com/apache/spark/pull/26276#issuecomment-546778167 **[Test build #112743 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112743/testReport)** for PR 26276 at

[GitHub] [spark] AmplabJenkins commented on issue #26277: [DO-NOT-MERBE] Investigate Appveyor failure of preview

2019-10-27 Thread GitBox
AmplabJenkins commented on issue #26277: [DO-NOT-MERBE] Investigate Appveyor failure of preview URL: https://github.com/apache/spark/pull/26277#issuecomment-546772373 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #26277: [DO-NOT-MERBE] Investigate Appveyor failure of preview

2019-10-27 Thread GitBox
AmplabJenkins commented on issue #26277: [DO-NOT-MERBE] Investigate Appveyor failure of preview URL: https://github.com/apache/spark/pull/26277#issuecomment-546772378 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #26277: [DO-NOT-MERBE] Investigate Appveyor failure of preview

2019-10-27 Thread GitBox
SparkQA commented on issue #26277: [DO-NOT-MERBE] Investigate Appveyor failure of preview URL: https://github.com/apache/spark/pull/26277#issuecomment-546772095 **[Test build #112750 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112750/testReport)** for

[GitHub] [spark] HyukjinKwon commented on a change in pull request #26243: Prepare Spark release v3.0.0-preview-rc1

2019-10-27 Thread GitBox
HyukjinKwon commented on a change in pull request #26243: Prepare Spark release v3.0.0-preview-rc1 URL: https://github.com/apache/spark/pull/26243#discussion_r339388097 ## File path: R/pkg/R/sparkR.R ## @@ -334,17 +334,6 @@ sparkR.session <- function(

[GitHub] [spark] HyukjinKwon commented on a change in pull request #26243: Prepare Spark release v3.0.0-preview-rc1

2019-10-27 Thread GitBox
HyukjinKwon commented on a change in pull request #26243: Prepare Spark release v3.0.0-preview-rc1 URL: https://github.com/apache/spark/pull/26243#discussion_r339388701 ## File path: R/pkg/R/sparkR.R ## @@ -334,17 +334,6 @@ sparkR.session <- function(

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25870: [SPARK-27936][K8S] Support python deps

2019-10-27 Thread GitBox
dongjoon-hyun commented on a change in pull request #25870: [SPARK-27936][K8S] Support python deps URL: https://github.com/apache/spark/pull/25870#discussion_r339388453 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25870: [SPARK-27936][K8S] Support python deps

2019-10-27 Thread GitBox
dongjoon-hyun commented on a change in pull request #25870: [SPARK-27936][K8S] Support python deps URL: https://github.com/apache/spark/pull/25870#discussion_r339388453 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25870: [SPARK-27936][K8S] Support python deps

2019-10-27 Thread GitBox
dongjoon-hyun commented on a change in pull request #25870: [SPARK-27936][K8S] Support python deps URL: https://github.com/apache/spark/pull/25870#discussion_r339388453 ## File path:

[GitHub] [spark] HyukjinKwon opened a new pull request #26277: [DO-NOT-MERBE] Investigate Appveyor failure of preview

2019-10-27 Thread GitBox
HyukjinKwon opened a new pull request #26277: [DO-NOT-MERBE] Investigate Appveyor failure of preview URL: https://github.com/apache/spark/pull/26277 ### What changes were proposed in this pull request? Do not merge. ### Why are the changes needed? ### Does this PR

[GitHub] [spark] uncleGen commented on a change in pull request #26201: [SPARK-29543][SS][UI] Init structured streaming ui

2019-10-27 Thread GitBox
uncleGen commented on a change in pull request #26201: [SPARK-29543][SS][UI] Init structured streaming ui URL: https://github.com/apache/spark/pull/26201#discussion_r339388295 ## File path: sql/core/src/main/scala/org/apache/spark/sql/streaming/ui/UIUtils.scala ## @@

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25870: [SPARK-27936][K8S] Support python deps

2019-10-27 Thread GitBox
dongjoon-hyun commented on a change in pull request #25870: [SPARK-27936][K8S] Support python deps URL: https://github.com/apache/spark/pull/25870#discussion_r339388240 ## File path:

[GitHub] [spark] uncleGen commented on a change in pull request #26201: [SPARK-29543][SS][UI] Init structured streaming ui

2019-10-27 Thread GitBox
uncleGen commented on a change in pull request #26201: [SPARK-29543][SS][UI] Init structured streaming ui URL: https://github.com/apache/spark/pull/26201#discussion_r339388295 ## File path: sql/core/src/main/scala/org/apache/spark/sql/streaming/ui/UIUtils.scala ## @@

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25870: [SPARK-27936][K8S] Support python deps

2019-10-27 Thread GitBox
dongjoon-hyun commented on a change in pull request #25870: [SPARK-27936][K8S] Support python deps URL: https://github.com/apache/spark/pull/25870#discussion_r339388162 ## File path:

  1   2   3   4   5   >