[GitHub] [spark] sarutak commented on pull request #28806: [SPARK-31967][UI] UI Perf regression: Loading jobs UI page takes 40 seconds

2020-06-12 Thread GitBox
sarutak commented on pull request #28806: URL: https://github.com/apache/spark/pull/28806#issuecomment-643085539 I can't still get from the URL but can get from https://almende.github.io/vis/ anyway. This is an automated

[GitHub] [spark] gaborgsomogyi commented on pull request #28391: [SPARK-31593][SS] Remove unnecessary streaming query progress update

2020-06-12 Thread GitBox
gaborgsomogyi commented on pull request #28391: URL: https://github.com/apache/spark/pull/28391#issuecomment-643118308 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] sarutak commented on pull request #28806: [SPARK-31967][UI] UI Perf regression: Loading jobs UI page takes 40 seconds

2020-06-12 Thread GitBox
sarutak commented on pull request #28806: URL: https://github.com/apache/spark/pull/28806#issuecomment-643129288 LGTM. The updated version seems to work fine. This is an automated message from the Apache Git Service. To

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28556: [SPARK-31736][SQL] Nested column aliasing for RepartitionByExpression/Join

2020-06-12 Thread GitBox
HyukjinKwon commented on a change in pull request #28556: URL: https://github.com/apache/spark/pull/28556#discussion_r439264530 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/NestedColumnAliasing.scala ## @@ -34,7 +34,8 @@ object

[GitHub] [spark] SparkQA commented on pull request #28810: [SPARK-31705][SQL][FOLLOWUP] Avoid the unnecessary CNF computation for full-outer joins

2020-06-12 Thread GitBox
SparkQA commented on pull request #28810: URL: https://github.com/apache/spark/pull/28810#issuecomment-643139749 **[Test build #123908 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123908/testReport)** for PR 28810 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28812: [SPARK-31977][SQL] Returns the plan directly from NestedColumnAliasing

2020-06-12 Thread GitBox
AmplabJenkins commented on pull request #28812: URL: https://github.com/apache/spark/pull/28812#issuecomment-643147344 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28812: [SPARK-31977][SQL] Returns the plan directly from NestedColumnAliasing

2020-06-12 Thread GitBox
AmplabJenkins removed a comment on pull request #28812: URL: https://github.com/apache/spark/pull/28812#issuecomment-643147344 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28813: [2.4][SPARK-31967][UI] UI Perf regression: Loading jobs UI page takes 40 seconds

2020-06-12 Thread GitBox
AmplabJenkins removed a comment on pull request #28813: URL: https://github.com/apache/spark/pull/28813#issuecomment-643147065 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28813: [2.4][SPARK-31967][UI] UI Perf regression: Loading jobs UI page takes 40 seconds

2020-06-12 Thread GitBox
AmplabJenkins commented on pull request #28813: URL: https://github.com/apache/spark/pull/28813#issuecomment-643147065 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28808: [SPARK-31975][SQL] Throw user facing error when use WindowFunction directly

2020-06-12 Thread GitBox
SparkQA commented on pull request #28808: URL: https://github.com/apache/spark/pull/28808#issuecomment-643153484 **[Test build #123913 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123913/testReport)** for PR 28808 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28808: [SPARK-31975][SQL] Throw user facing error when use WindowFunction directly

2020-06-12 Thread GitBox
AmplabJenkins commented on pull request #28808: URL: https://github.com/apache/spark/pull/28808#issuecomment-643153905 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28808: [SPARK-31975][SQL] Throw user facing error when use WindowFunction directly

2020-06-12 Thread GitBox
AmplabJenkins removed a comment on pull request #28808: URL: https://github.com/apache/spark/pull/28808#issuecomment-643153905 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] cloud-fan commented on a change in pull request #28810: [SPARK-31705][SQL][FOLLOWUP] Avoid the unnecessary CNF computation for full-outer joins

2020-06-12 Thread GitBox
cloud-fan commented on a change in pull request #28810: URL: https://github.com/apache/spark/pull/28810#discussion_r439323594 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala ## @@ -1334,13 +1340,13 @@ object

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28808: [SPARK-31975][SQL] Throw user facing error when use WindowFunction directly

2020-06-12 Thread GitBox
AmplabJenkins removed a comment on pull request #28808: URL: https://github.com/apache/spark/pull/28808#issuecomment-643196646 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #27690: [SPARK-21514][SQL] Added a new option to use non-blobstore storage when writing into blobstore storage

2020-06-12 Thread GitBox
AmplabJenkins commented on pull request #27690: URL: https://github.com/apache/spark/pull/27690#issuecomment-643202104 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] maropu opened a new pull request #28807: [WIP][SPARK-26905][SQL][TESTS] Follow the SQL:2016 reserved keywords

2020-06-12 Thread GitBox
maropu opened a new pull request #28807: URL: https://github.com/apache/spark/pull/28807 ### What changes were proposed in this pull request? This PR intends to move keywords `ANTI`, `SEMI`, and `MINUS` from reserved to non-reserved. ### Why are the changes needed?

[GitHub] [spark] SparkQA removed a comment on pull request #28685: [SPARK-27951][SQL] Support ANSI SQL NTH_VALUE window function

2020-06-12 Thread GitBox
SparkQA removed a comment on pull request #28685: URL: https://github.com/apache/spark/pull/28685#issuecomment-643043305 **[Test build #123881 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123881/testReport)** for PR 28685 at commit

[GitHub] [spark] SparkQA commented on pull request #28685: [SPARK-27951][SQL] Support ANSI SQL NTH_VALUE window function

2020-06-12 Thread GitBox
SparkQA commented on pull request #28685: URL: https://github.com/apache/spark/pull/28685#issuecomment-643100973 **[Test build #123881 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123881/testReport)** for PR 28685 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28801: [SPARK-31970][CORE] Make MDC configuration step be consistent between setLocalProperty and log4j.properties

2020-06-12 Thread GitBox
SparkQA removed a comment on pull request #28801: URL: https://github.com/apache/spark/pull/28801#issuecomment-643053148 **[Test build #123884 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123884/testReport)** for PR 28801 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28391: [SPARK-31593][SS] Remove unnecessary streaming query progress update

2020-06-12 Thread GitBox
SparkQA removed a comment on pull request #28391: URL: https://github.com/apache/spark/pull/28391#issuecomment-643065075 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28788: [SPARK-31960][Yarn][Build] Only populate Hadoop classpath for no-hadoop build

2020-06-12 Thread GitBox
AmplabJenkins commented on pull request #28788: URL: https://github.com/apache/spark/pull/28788#issuecomment-643106480 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28807: [WIP][SPARK-26905][SQL] Follow the SQL:2016 reserved keywords

2020-06-12 Thread GitBox
AmplabJenkins removed a comment on pull request #28807: URL: https://github.com/apache/spark/pull/28807#issuecomment-643105992 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #28802: [SPARK-31950][SQL][TESTS] Extract SQL keywords from the SqlBase.g4 file

2020-06-12 Thread GitBox
SparkQA removed a comment on pull request #28802: URL: https://github.com/apache/spark/pull/28802#issuecomment-643010480 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28806: [SPARK-31967][UI] UI Perf regression: Loading jobs UI page takes 40 seconds

2020-06-12 Thread GitBox
AmplabJenkins removed a comment on pull request #28806: URL: https://github.com/apache/spark/pull/28806#issuecomment-643106703 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28806: [SPARK-31967][UI] UI Perf regression: Loading jobs UI page takes 40 seconds

2020-06-12 Thread GitBox
AmplabJenkins commented on pull request #28806: URL: https://github.com/apache/spark/pull/28806#issuecomment-643106703 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28593: [SPARK-31710][SQL] Fail casting numeric to timestamp by default

2020-06-12 Thread GitBox
SparkQA removed a comment on pull request #28593: URL: https://github.com/apache/spark/pull/28593#issuecomment-643053181 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28641: [SPARK-31824][CORE][TESTS] DAGSchedulerSuite: Improve and reuse completeShuffleMapStageSuccessfully

2020-06-12 Thread GitBox
SparkQA removed a comment on pull request #28641: URL: https://github.com/apache/spark/pull/28641#issuecomment-643041446 **[Test build #123880 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123880/testReport)** for PR 28641 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28802: [SPARK-31950][SQL][TESTS] Extract SQL keywords from the SqlBase.g4 file

2020-06-12 Thread GitBox
AmplabJenkins removed a comment on pull request #28802: URL: https://github.com/apache/spark/pull/28802#issuecomment-643106234 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28556: [SPARK-31736][SQL] Nested column aliasing for RepartitionByExpression/Join

2020-06-12 Thread GitBox
HyukjinKwon commented on a change in pull request #28556: URL: https://github.com/apache/spark/pull/28556#discussion_r439245169 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/NestedColumnAliasing.scala ## @@ -34,7 +34,8 @@ object

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28801: [SPARK-31970][CORE] Make MDC configuration step be consistent between setLocalProperty and log4j.properties

2020-06-12 Thread GitBox
AmplabJenkins removed a comment on pull request #28801: URL: https://github.com/apache/spark/pull/28801#issuecomment-643106551 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28802: [SPARK-31950][SQL][TESTS] Extract SQL keywords from the SqlBase.g4 file

2020-06-12 Thread GitBox
AmplabJenkins commented on pull request #28802: URL: https://github.com/apache/spark/pull/28802#issuecomment-643106925 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28788: [SPARK-31960][Yarn][Build] Only populate Hadoop classpath for no-hadoop build

2020-06-12 Thread GitBox
AmplabJenkins removed a comment on pull request #28788: URL: https://github.com/apache/spark/pull/28788#issuecomment-643106484 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28123: [SPARK-31350][SQL] Coalesce bucketed tables for sort merge join if applicable

2020-06-12 Thread GitBox
AmplabJenkins removed a comment on pull request #28123: URL: https://github.com/apache/spark/pull/28123#issuecomment-643106630 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28593: [SPARK-31710][SQL] Fail casting numeric to timestamp by default

2020-06-12 Thread GitBox
AmplabJenkins removed a comment on pull request #28593: URL: https://github.com/apache/spark/pull/28593#issuecomment-643106490 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28805: [SPARK-28169][SQL] Convert scan predicate condition to CNF

2020-06-12 Thread GitBox
AmplabJenkins removed a comment on pull request #28805: URL: https://github.com/apache/spark/pull/28805#issuecomment-643106083 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28797: [SPARK-31926][SQL][TEST-HIVE1.2][test-maven] Fix concurrency issue for ThriftCLIService to getPortNumber

2020-06-12 Thread GitBox
AmplabJenkins removed a comment on pull request #28797: URL: https://github.com/apache/spark/pull/28797#issuecomment-643106219 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] maropu commented on pull request #28123: [SPARK-31350][SQL] Coalesce bucketed tables for sort merge join if applicable

2020-06-12 Thread GitBox
maropu commented on pull request #28123: URL: https://github.com/apache/spark/pull/28123#issuecomment-643107248 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28391: [SPARK-31593][SS] Remove unnecessary streaming query progress update

2020-06-12 Thread GitBox
AmplabJenkins removed a comment on pull request #28391: URL: https://github.com/apache/spark/pull/28391#issuecomment-643106222 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28801: [SPARK-31970][CORE] Make MDC configuration step be consistent between setLocalProperty and log4j.properties

2020-06-12 Thread GitBox
AmplabJenkins removed a comment on pull request #28801: URL: https://github.com/apache/spark/pull/28801#issuecomment-643106562 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28593: [SPARK-31710][SQL] Fail casting numeric to timestamp by default

2020-06-12 Thread GitBox
AmplabJenkins removed a comment on pull request #28593: URL: https://github.com/apache/spark/pull/28593#issuecomment-643106545 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28123: [SPARK-31350][SQL] Coalesce bucketed tables for sort merge join if applicable

2020-06-12 Thread GitBox
AmplabJenkins removed a comment on pull request #28123: URL: https://github.com/apache/spark/pull/28123#issuecomment-643106639 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #28641: [SPARK-31824][CORE][TESTS] DAGSchedulerSuite: Improve and reuse completeShuffleMapStageSuccessfully

2020-06-12 Thread GitBox
AmplabJenkins commented on pull request #28641: URL: https://github.com/apache/spark/pull/28641#issuecomment-643107717 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28806: [SPARK-31967][UI] UI Perf regression: Loading jobs UI page takes 40 seconds

2020-06-12 Thread GitBox
AmplabJenkins removed a comment on pull request #28806: URL: https://github.com/apache/spark/pull/28806#issuecomment-643106715 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] yaooqinn commented on pull request #28797: [SPARK-31926][SQL][TEST-HIVE1.2][test-maven] Fix concurrency issue for ThriftCLIService to getPortNumber

2020-06-12 Thread GitBox
yaooqinn commented on pull request #28797: URL: https://github.com/apache/spark/pull/28797#issuecomment-643107851 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] maropu commented on pull request #28807: [WIP][SPARK-26905][SQL] Follow the SQL:2016 reserved keywords

2020-06-12 Thread GitBox
maropu commented on pull request #28807: URL: https://github.com/apache/spark/pull/28807#issuecomment-643106992 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28807: [WIP][SPARK-26905][SQL] Follow the SQL:2016 reserved keywords

2020-06-12 Thread GitBox
AmplabJenkins removed a comment on pull request #28807: URL: https://github.com/apache/spark/pull/28807#issuecomment-643106001 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #28802: [SPARK-31950][SQL][TESTS] Extract SQL keywords from the SqlBase.g4 file

2020-06-12 Thread GitBox
AmplabJenkins commented on pull request #28802: URL: https://github.com/apache/spark/pull/28802#issuecomment-643107613 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28808: [SPARK-31975][SQL] Throw user facing error when use WindowFunction directly

2020-06-12 Thread GitBox
SparkQA commented on pull request #28808: URL: https://github.com/apache/spark/pull/28808#issuecomment-643121390 **[Test build #123895 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123895/testReport)** for PR 28808 at commit

[GitHub] [spark] beliefer commented on pull request #28641: [SPARK-31824][CORE][TESTS] DAGSchedulerSuite: Improve and reuse completeShuffleMapStageSuccessfully

2020-06-12 Thread GitBox
beliefer commented on pull request #28641: URL: https://github.com/apache/spark/pull/28641#issuecomment-643120902 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] maropu commented on a change in pull request #28802: [SPARK-31950][SQL][TESTS] Extract SQL keywords from the SqlBase.g4 file

2020-06-12 Thread GitBox
maropu commented on a change in pull request #28802: URL: https://github.com/apache/spark/pull/28802#discussion_r439262758 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/parser/TableIdentifierParserSuite.scala ## @@ -285,334 +290,86 @@ class

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28641: [SPARK-31824][CORE][TESTS] DAGSchedulerSuite: Improve and reuse completeShuffleMapStageSuccessfully

2020-06-12 Thread GitBox
AmplabJenkins removed a comment on pull request #28641: URL: https://github.com/apache/spark/pull/28641#issuecomment-643161089 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28788: [SPARK-31960][Yarn][Build] Only populate Hadoop classpath for no-hadoop build

2020-06-12 Thread GitBox
AmplabJenkins removed a comment on pull request #28788: URL: https://github.com/apache/spark/pull/28788#issuecomment-643167509 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SaurabhChawla100 edited a comment on pull request #27636: [SPARK-30873][CORE][YARN]Handling Node Decommissioning for Yarn cluster manger in Spark

2020-06-12 Thread GitBox
SaurabhChawla100 edited a comment on pull request #27636: URL: https://github.com/apache/spark/pull/27636#issuecomment-642102323 @agrawaldevesh - Thanks for checking this PR, Sure will check this PR https://github.com/apache/spark/pull/27864 and tried to use this in the current PR

[GitHub] [spark] cloud-fan opened a new pull request #28815: [SPARK-31979] release script should not fail when remove non-existing files

2020-06-12 Thread GitBox
cloud-fan opened a new pull request #28815: URL: https://github.com/apache/spark/pull/28815 ### What changes were proposed in this pull request? When removing non-existing files in the release script, do not fail. ### Why are the changes needed? This is to make

[GitHub] [spark] maropu commented on pull request #27690: [SPARK-21514][SQL] Added a new option to use non-blobstore storage when writing into blobstore storage

2020-06-12 Thread GitBox
maropu commented on pull request #27690: URL: https://github.com/apache/spark/pull/27690#issuecomment-643202716 @HyukjinKwon Still busy? I'm thinking I will merge this to the master if other reviewers have no more comments. WDTY?

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27690: [SPARK-21514][SQL] Added a new option to use non-blobstore storage when writing into blobstore storage

2020-06-12 Thread GitBox
AmplabJenkins removed a comment on pull request #27690: URL: https://github.com/apache/spark/pull/27690#issuecomment-643202104 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28781: [SPARK-31953][SS] Add Spark Structured Streaming History Server Support

2020-06-12 Thread GitBox
SparkQA commented on pull request #28781: URL: https://github.com/apache/spark/pull/28781#issuecomment-643202653 **[Test build #123907 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123907/testReport)** for PR 28781 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28781: [SPARK-31953][SS] Add Spark Structured Streaming History Server Support

2020-06-12 Thread GitBox
AmplabJenkins removed a comment on pull request #28781: URL: https://github.com/apache/spark/pull/28781#issuecomment-643202806 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28781: [SPARK-31953][SS] Add Spark Structured Streaming History Server Support

2020-06-12 Thread GitBox
AmplabJenkins commented on pull request #28781: URL: https://github.com/apache/spark/pull/28781#issuecomment-643202806 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28781: [SPARK-31953][SS] Add Spark Structured Streaming History Server Support

2020-06-12 Thread GitBox
SparkQA removed a comment on pull request #28781: URL: https://github.com/apache/spark/pull/28781#issuecomment-643133365 **[Test build #123907 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123907/testReport)** for PR 28781 at commit

[GitHub] [spark] cloud-fan closed pull request #28787: [SPARK-31959][SQL][test-java11] Fix Gregorian-Julian micros rebasing while switching standard time zone offset

2020-06-12 Thread GitBox
cloud-fan closed pull request #28787: URL: https://github.com/apache/spark/pull/28787 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [spark] cloud-fan edited a comment on pull request #28787: [SPARK-31959][SQL][test-java11] Fix Gregorian-Julian micros rebasing while switching standard time zone offset

2020-06-12 Thread GitBox
cloud-fan edited a comment on pull request #28787: URL: https://github.com/apache/spark/pull/28787#issuecomment-643086118 More context: To do datetime rebase more efficiently, we put the diffs between two calendars in JSON files, to avoid calculating the diffs every time. To

[GitHub] [spark] cloud-fan commented on pull request #28787: [SPARK-31959][SQL][test-java11] Fix Gregorian-Julian micros rebasing while switching standard time zone offset

2020-06-12 Thread GitBox
cloud-fan commented on pull request #28787: URL: https://github.com/apache/spark/pull/28787#issuecomment-643087372 thanks, merging to master/3.0! This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28391: [SPARK-31593][SS] Remove unnecessary streaming query progress update

2020-06-12 Thread GitBox
AmplabJenkins removed a comment on pull request #28391: URL: https://github.com/apache/spark/pull/28391#issuecomment-643088381 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] wangyum commented on a change in pull request #28805: [SPARK-28169][SQL] Convert scan predicate condition to CNF

2020-06-12 Thread GitBox
wangyum commented on a change in pull request #28805: URL: https://github.com/apache/spark/pull/28805#discussion_r439236301 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/predicates.scala ## @@ -253,6 +253,58 @@ trait PredicateHelper

[GitHub] [spark] SparkQA commented on pull request #28808: [SPARK-31975][SQL] Throw user facing error when use WindowFunction directly

2020-06-12 Thread GitBox
SparkQA commented on pull request #28808: URL: https://github.com/apache/spark/pull/28808#issuecomment-643104851 **[Test build #123895 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123895/testReport)** for PR 28808 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28806: [SPARK-31967][UI] UI Perf regression: Loading jobs UI page takes 40 seconds

2020-06-12 Thread GitBox
AmplabJenkins commented on pull request #28806: URL: https://github.com/apache/spark/pull/28806#issuecomment-643116193 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27617: [SPARK-30865][SQL] Refactor DateTimeUtils

2020-06-12 Thread GitBox
AmplabJenkins removed a comment on pull request #27617: URL: https://github.com/apache/spark/pull/27617#issuecomment-643116013 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28806: [SPARK-31967][UI] UI Perf regression: Loading jobs UI page takes 40 seconds

2020-06-12 Thread GitBox
AmplabJenkins removed a comment on pull request #28806: URL: https://github.com/apache/spark/pull/28806#issuecomment-643116193 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] MaxGekk commented on pull request #27617: [SPARK-30865][SQL] Refactor DateTimeUtils

2020-06-12 Thread GitBox
MaxGekk commented on pull request #27617: URL: https://github.com/apache/spark/pull/27617#issuecomment-643115232 jenkins, retest this, please This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] gengliangwang commented on pull request #28806: [SPARK-31967][UI] UI Perf regression: Loading jobs UI page takes 40 seconds

2020-06-12 Thread GitBox
gengliangwang commented on pull request #28806: URL: https://github.com/apache/spark/pull/28806#issuecomment-643115448 @sarutak ok I have replaced with the one from https://almende.github.io/vis/ Thanks for trying! This

[GitHub] [spark] maropu commented on pull request #28810: [SPARK-31705][SQL][FOLLOWUP] Avoid the unnecessary CNF computation for full-outer joins

2020-06-12 Thread GitBox
maropu commented on pull request #28810: URL: https://github.com/apache/spark/pull/28810#issuecomment-643137556 cc: @gengliangwang @cloud-fan This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] HyukjinKwon opened a new pull request #28812: [SPARK-31977][SQL] Returns the plan directly from NestedColumnAliasing

2020-06-12 Thread GitBox
HyukjinKwon opened a new pull request #28812: URL: https://github.com/apache/spark/pull/28812 ### What changes were proposed in this pull request? This proposes a minor refactoring to match `NestedColumnAliasing` to `GeneratorNestedColumnAliasing` so it returns the pruned plan

[GitHub] [spark] AmplabJenkins commented on pull request #28811: [3.0][SPARK-31967][UI] UI Perf regression: Loading jobs UI page takes 40 seconds

2020-06-12 Thread GitBox
AmplabJenkins commented on pull request #28811: URL: https://github.com/apache/spark/pull/28811#issuecomment-643143480 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28811: [3.0][SPARK-31967][UI] UI Perf regression: Loading jobs UI page takes 40 seconds

2020-06-12 Thread GitBox
SparkQA commented on pull request #28811: URL: https://github.com/apache/spark/pull/28811#issuecomment-643142975 **[Test build #123909 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123909/testReport)** for PR 28811 at commit

[GitHub] [spark] SparkQA commented on pull request #28593: [SPARK-31710][SQL] Fail casting numeric to timestamp by default

2020-06-12 Thread GitBox
SparkQA commented on pull request #28593: URL: https://github.com/apache/spark/pull/28593#issuecomment-643150016 **[Test build #123912 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123912/testReport)** for PR 28593 at commit

[GitHub] [spark] SparkQA commented on pull request #28641: [SPARK-31824][CORE][TESTS] DAGSchedulerSuite: Improve and reuse completeShuffleMapStageSuccessfully

2020-06-12 Thread GitBox
SparkQA commented on pull request #28641: URL: https://github.com/apache/spark/pull/28641#issuecomment-643160492 **[Test build #123914 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123914/testReport)** for PR 28641 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28641: [SPARK-31824][CORE][TESTS] DAGSchedulerSuite: Improve and reuse completeShuffleMapStageSuccessfully

2020-06-12 Thread GitBox
AmplabJenkins commented on pull request #28641: URL: https://github.com/apache/spark/pull/28641#issuecomment-643161089 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] wangyum closed pull request #26804: [SPARK-26346][BUILD][SQL] Upgrade parquet to 1.11.0

2020-06-12 Thread GitBox
wangyum closed pull request #26804: URL: https://github.com/apache/spark/pull/26804 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [spark] wangyum closed pull request #22038: [SPARK-25056][SQL] Unify the InConversion and BinaryComparison behavior

2020-06-12 Thread GitBox
wangyum closed pull request #22038: URL: https://github.com/apache/spark/pull/22038 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27518: [SPARK-30768][SQL] Constraints inferred from inequality attributes

2020-06-12 Thread GitBox
AmplabJenkins removed a comment on pull request #27518: URL: https://github.com/apache/spark/pull/27518#issuecomment-643190492 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28815: [SPARK-31979] release script should not fail when remove non-existing files

2020-06-12 Thread GitBox
AmplabJenkins removed a comment on pull request #28815: URL: https://github.com/apache/spark/pull/28815#issuecomment-643190523 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] maropu commented on pull request #27690: [SPARK-21514][SQL] Added a new option to use non-blobstore storage when writing into blobstore storage

2020-06-12 Thread GitBox
maropu commented on pull request #27690: URL: https://github.com/apache/spark/pull/27690#issuecomment-643201503 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] ulysses-you opened a new pull request #28808: [SPARK-31975][SQL] Throw user facing error when use WindowFunction directly

2020-06-12 Thread GitBox
ulysses-you opened a new pull request #28808: URL: https://github.com/apache/spark/pull/28808 ### What changes were proposed in this pull request? Add WindowFunction check at `CheckAnalysis`. ### Why are the changes needed? Provide friendly error msg. ###

[GitHub] [spark] SparkQA commented on pull request #28806: [SPARK-31967][UI] UI Perf regression: Loading jobs UI page takes 40 seconds

2020-06-12 Thread GitBox
SparkQA commented on pull request #28806: URL: https://github.com/apache/spark/pull/28806#issuecomment-643119119 **[Test build #123900 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123900/testReport)** for PR 28806 at commit

[GitHub] [spark] SparkQA commented on pull request #27617: [SPARK-30865][SQL] Refactor DateTimeUtils

2020-06-12 Thread GitBox
SparkQA commented on pull request #27617: URL: https://github.com/apache/spark/pull/27617#issuecomment-643119200 **[Test build #123902 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123902/testReport)** for PR 27617 at commit

[GitHub] [spark] gengliangwang commented on pull request #28806: [SPARK-31967][UI] UI Perf regression: Loading jobs UI page takes 40 seconds

2020-06-12 Thread GitBox
gengliangwang commented on pull request #28806: URL: https://github.com/apache/spark/pull/28806#issuecomment-643118078 well, in my setup, if the "Enable zooming" checkbox is not clicked, the infinite redrawing won't happen. > Maybe, we compromise either infinite redrawing issue or

[GitHub] [spark] MaxGekk opened a new pull request #28809: [SPARK-31959][SQL][3.0] Fix Gregorian-Julian micros rebasing while switching standard time zone offset

2020-06-12 Thread GitBox
MaxGekk opened a new pull request #28809: URL: https://github.com/apache/spark/pull/28809 ### What changes were proposed in this pull request? Fix the bug in microseconds rebasing during transitions from one standard time zone offset to another one. In the PR, I propose to change the

[GitHub] [spark] SparkQA commented on pull request #28802: [SPARK-31950][SQL][TESTS] Extract SQL keywords from the SqlBase.g4 file

2020-06-12 Thread GitBox
SparkQA commented on pull request #28802: URL: https://github.com/apache/spark/pull/28802#issuecomment-643129837 **[Test build #123905 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123905/testReport)** for PR 28802 at commit

[GitHub] [spark] HyukjinKwon commented on pull request #28556: [SPARK-31736][SQL] Nested column aliasing for RepartitionByExpression/Join

2020-06-12 Thread GitBox
HyukjinKwon commented on pull request #28556: URL: https://github.com/apache/spark/pull/28556#issuecomment-643129998 Merged to master. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] maropu opened a new pull request #28810: [SPARK-31705][SQL][FOLLOWUP] Avoid the unnecessary CNF computation for full-outer joins

2020-06-12 Thread GitBox
maropu opened a new pull request #28810: URL: https://github.com/apache/spark/pull/28810 ### What changes were proposed in this pull request? To avoid the unnecessary CNF computation for full-outer joins, this PR fixes code for filtering out full-outer joins at the entrance

[GitHub] [spark] gengliangwang opened a new pull request #28811: [3.0][SPARK-31967][UI] UI Perf regression: Loading jobs UI page takes 40 seconds

2020-06-12 Thread GitBox
gengliangwang opened a new pull request #28811: URL: https://github.com/apache/spark/pull/28811 ### What changes were proposed in this pull request? After #28192, the job list page becomes very slow. For example, after the following operation, the UI loading can take >40

[GitHub] [spark] gengliangwang commented on pull request #28811: [3.0][SPARK-31967][UI] UI Perf regression: Loading jobs UI page takes 40 seconds

2020-06-12 Thread GitBox
gengliangwang commented on pull request #28811: URL: https://github.com/apache/spark/pull/28811#issuecomment-643141787 This PR backports https://github.com/apache/spark/pull/28806 to branch-3.0 This is an automated message

[GitHub] [spark] AmplabJenkins commented on pull request #28814: [SPARK-31968][CORE]Duplicate partition column check when write data

2020-06-12 Thread GitBox
AmplabJenkins commented on pull request #28814: URL: https://github.com/apache/spark/pull/28814#issuecomment-643164644 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28814: [SPARK-31968][CORE]Duplicate partition column check when write data

2020-06-12 Thread GitBox
AmplabJenkins removed a comment on pull request #28814: URL: https://github.com/apache/spark/pull/28814#issuecomment-643164066 Can one of the admins verify this patch? This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins commented on pull request #28805: [SPARK-28169][SQL] Convert scan predicate condition to CNF

2020-06-12 Thread GitBox
AmplabJenkins commented on pull request #28805: URL: https://github.com/apache/spark/pull/28805#issuecomment-643164956 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28797: [SPARK-31926][SQL][TEST-HIVE1.2][test-maven] Fix concurrency issue for ThriftCLIService to getPortNumber

2020-06-12 Thread GitBox
AmplabJenkins commented on pull request #28797: URL: https://github.com/apache/spark/pull/28797#issuecomment-643109069 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28807: [WIP][SPARK-26905][SQL] Follow the SQL:2016 reserved keywords

2020-06-12 Thread GitBox
AmplabJenkins commented on pull request #28807: URL: https://github.com/apache/spark/pull/28807#issuecomment-643109052 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28807: [WIP][SPARK-26905][SQL] Follow the SQL:2016 reserved keywords

2020-06-12 Thread GitBox
AmplabJenkins removed a comment on pull request #28807: URL: https://github.com/apache/spark/pull/28807#issuecomment-643109052 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28797: [SPARK-31926][SQL][TEST-HIVE1.2][test-maven] Fix concurrency issue for ThriftCLIService to getPortNumber

2020-06-12 Thread GitBox
AmplabJenkins removed a comment on pull request #28797: URL: https://github.com/apache/spark/pull/28797#issuecomment-643109069 This is an automated message from the Apache Git Service. To respond to the message, please log on

  1   2   3   4   5   6   7   8   >