[GitHub] [spark] AmplabJenkins commented on pull request #29055: [SPARK-32251][SQL][DOCS][TESTS] Fix SQL keyword document

2020-07-09 Thread GitBox
AmplabJenkins commented on pull request #29055: URL: https://github.com/apache/spark/pull/29055#issuecomment-656499183 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29059: [SPARK-32256][SQL][test-hadoop2.7] Force to initialize Hadoop VersionInfo in HiveExternalCatalog

2020-07-09 Thread GitBox
SparkQA commented on pull request #29059: URL: https://github.com/apache/spark/pull/29059#issuecomment-656498937 **[Test build #125558 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125558/testReport)** for PR 29059 at commit

[GitHub] [spark] zsxwing commented on pull request #29059: [SPARK-32256][SQL][test-hadoop2.7] Force to initialize Hadoop VersionInfo in HiveExternalCatalog

2020-07-09 Thread GitBox
zsxwing commented on pull request #29059: URL: https://github.com/apache/spark/pull/29059#issuecomment-656498285 Although the temp ivy directory adds 1 minute to the test on my laptop, I think it should be okay since SBT tests run in parallel. It would be pretty complicated to coordinate

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

2020-07-09 Thread GitBox
AmplabJenkins removed a comment on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-656497640 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

2020-07-09 Thread GitBox
AmplabJenkins removed a comment on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-656497633 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28953: [SPARK-32013][SQL] Support query execution before reading DataFrame and before/after writing DataFrame over JDBC

2020-07-09 Thread GitBox
AmplabJenkins removed a comment on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-656496927 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

2020-07-09 Thread GitBox
AmplabJenkins commented on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-656497633 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28953: [SPARK-32013][SQL] Support query execution before reading DataFrame and before/after writing DataFrame over JDBC

2020-07-09 Thread GitBox
AmplabJenkins removed a comment on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-656496921 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28953: [SPARK-32013][SQL] Support query execution before reading DataFrame and before/after writing DataFrame over JDBC

2020-07-09 Thread GitBox
AmplabJenkins commented on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-656496921 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] huaxingao commented on a change in pull request #29056: [SPARK-31753][SQL][DOCS][WIP]Add missing keywords

2020-07-09 Thread GitBox
huaxingao commented on a change in pull request #29056: URL: https://github.com/apache/spark/pull/29056#discussion_r452635205 ## File path: docs/sql-ref-syntax-qry-select-case.md ## @@ -0,0 +1,115 @@ +--- +layout: global +title: CASE Clause +displayTitle: CASE Clause +license:

[GitHub] [spark] SparkQA removed a comment on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

2020-07-09 Thread GitBox
SparkQA removed a comment on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-656434653 **[Test build #125536 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125536/testReport)** for PR 28898 at commit

[GitHub] [spark] SparkQA commented on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

2020-07-09 Thread GitBox
SparkQA commented on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-656496831 **[Test build #125536 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125536/testReport)** for PR 28898 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28953: [SPARK-32013][SQL] Support query execution before reading DataFrame and before/after writing DataFrame over JDBC

2020-07-09 Thread GitBox
SparkQA removed a comment on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-656434657 **[Test build #125535 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125535/testReport)** for PR 28953 at commit

[GitHub] [spark] SparkQA commented on pull request #28953: [SPARK-32013][SQL] Support query execution before reading DataFrame and before/after writing DataFrame over JDBC

2020-07-09 Thread GitBox
SparkQA commented on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-656495958 **[Test build #125535 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125535/testReport)** for PR 28953 at commit

[GitHub] [spark] MaxGekk commented on pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

2020-07-09 Thread GitBox
MaxGekk commented on pull request #27366: URL: https://github.com/apache/spark/pull/27366#issuecomment-656495713 @HyukjinKwon Please, review this PR. This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] HyukjinKwon commented on pull request #28957: [WIP][SPARK-32138] Drop Python 2.7, 3.4 and 3.5

2020-07-09 Thread GitBox
HyukjinKwon commented on pull request #28957: URL: https://github.com/apache/spark/pull/28957#issuecomment-656494756 cc @BryanCutler, @ueshin, @holdenk, @dongjoon-hyun, @viirya, @srowen, this should be ready for a review.

[GitHub] [spark] wankunde commented on pull request #28850: [SPARK-32015][Core]Remote inheritable thread local variables after spark context is stopped

2020-07-09 Thread GitBox
wankunde commented on pull request #28850: URL: https://github.com/apache/spark/pull/28850#issuecomment-656494493 @Ngone51 @srowen Update PR, could we only remove the thread reference created by hive? This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29061: [SPARK-32258][SQL] NormalizeFloatingNumbers can directly normalize on IF and CaseWhen children expressions

2020-07-09 Thread GitBox
AmplabJenkins removed a comment on pull request #29061: URL: https://github.com/apache/spark/pull/29061#issuecomment-656493719 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29061: [SPARK-32258][SQL] NormalizeFloatingNumbers can directly normalize on IF and CaseWhen children expressions

2020-07-09 Thread GitBox
AmplabJenkins commented on pull request #29061: URL: https://github.com/apache/spark/pull/29061#issuecomment-656493719 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] zhengruifeng commented on pull request #29060: [SPARK-32232][ML][PySpark] Make sure ML has the same default solver values between Scala and Python

2020-07-09 Thread GitBox
zhengruifeng commented on pull request #29060: URL: https://github.com/apache/spark/pull/29060#issuecomment-656490664 LGTM! There is still something inconsistent between Scala side and Python side, after py.ml was refactored in 3.0.

[GitHub] [spark] maropu commented on pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should show error message

2020-07-09 Thread GitBox
maropu commented on pull request #29054: URL: https://github.com/apache/spark/pull/29054#issuecomment-656490867 Please describe exception messages before/after this PR in the description. This is an automated message from

[GitHub] [spark] maropu commented on a change in pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should show error message

2020-07-09 Thread GitBox
maropu commented on a change in pull request #29054: URL: https://github.com/apache/spark/pull/29054#discussion_r452627861 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveUDAFSuite.scala ## @@ -161,6 +161,21 @@ class HiveUDAFSuite extends

[GitHub] [spark] zhengruifeng commented on a change in pull request #29018: [SPARK-32202][ML][WIP] tree models auto infer compact integer type

2020-07-09 Thread GitBox
zhengruifeng commented on a change in pull request #29018: URL: https://github.com/apache/spark/pull/29018#discussion_r452627763 ## File path: mllib/src/main/scala/org/apache/spark/ml/util/MLUtils.scala ## @@ -0,0 +1,47 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [spark] maropu commented on a change in pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should show error message

2020-07-09 Thread GitBox
maropu commented on a change in pull request #29054: URL: https://github.com/apache/spark/pull/29054#discussion_r452627431 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveSessionCatalog.scala ## @@ -69,49 +69,56 @@ private[sql] class HiveSessionCatalog(

[GitHub] [spark] LantaoJin commented on a change in pull request #29062: [SPARK-32237][SQL] Resolve hint in CTE

2020-07-09 Thread GitBox
LantaoJin commented on a change in pull request #29062: URL: https://github.com/apache/spark/pull/29062#discussion_r452626883 ## File path: sql/core/src/test/scala/org/apache/spark/sql/connector/DataSourceV2SQLSuite.scala ## @@ -756,6 +756,19 @@ class DataSourceV2SQLSuite

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28957: [WIP][SPARK-32138] Drop Python 2.7, 3.4 and 3.5

2020-07-09 Thread GitBox
AmplabJenkins removed a comment on pull request #28957: URL: https://github.com/apache/spark/pull/28957#issuecomment-656487892 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28957: [WIP][SPARK-32138] Drop Python 2.7, 3.4 and 3.5

2020-07-09 Thread GitBox
AmplabJenkins commented on pull request #28957: URL: https://github.com/apache/spark/pull/28957#issuecomment-656487892 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] zhengruifeng commented on pull request #29018: [SPARK-32202][ML][WIP] tree models auto infer compact integer type

2020-07-09 Thread GitBox
zhengruifeng commented on pull request #29018: URL: https://github.com/apache/spark/pull/29018#issuecomment-656487627 I had removed the specialization in those methods, expect in `TreePoint`, but there seems no significant improvement. I need more time to figure out while it is slower.

[GitHub] [spark] maropu commented on a change in pull request #29062: [SPARK-32237][SQL] Resolve hint in CTE

2020-07-09 Thread GitBox
maropu commented on a change in pull request #29062: URL: https://github.com/apache/spark/pull/29062#discussion_r452625256 ## File path: sql/core/src/test/scala/org/apache/spark/sql/connector/DataSourceV2SQLSuite.scala ## @@ -756,6 +756,19 @@ class DataSourceV2SQLSuite }

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29055: [SPARK-32251][SQL][DOCS][TESTS] Fix SQL keyword document

2020-07-09 Thread GitBox
AmplabJenkins removed a comment on pull request #29055: URL: https://github.com/apache/spark/pull/29055#issuecomment-656485788 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #28957: [WIP][SPARK-32138] Drop Python 2.7, 3.4 and 3.5

2020-07-09 Thread GitBox
SparkQA removed a comment on pull request #28957: URL: https://github.com/apache/spark/pull/28957#issuecomment-656418767 **[Test build #125527 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125527/testReport)** for PR 28957 at commit

[GitHub] [spark] SparkQA commented on pull request #28957: [WIP][SPARK-32138] Drop Python 2.7, 3.4 and 3.5

2020-07-09 Thread GitBox
SparkQA commented on pull request #28957: URL: https://github.com/apache/spark/pull/28957#issuecomment-656485863 **[Test build #125527 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125527/testReport)** for PR 28957 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29055: [SPARK-32251][SQL][DOCS][TESTS] Fix SQL keyword document

2020-07-09 Thread GitBox
AmplabJenkins commented on pull request #29055: URL: https://github.com/apache/spark/pull/29055#issuecomment-656485788 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] maropu commented on a change in pull request #29062: [SPARK-32237][SQL] Resolve hint in CTE

2020-07-09 Thread GitBox
maropu commented on a change in pull request #29062: URL: https://github.com/apache/spark/pull/29062#discussion_r452624446 ## File path: sql/core/src/test/scala/org/apache/spark/sql/connector/DataSourceV2SQLSuite.scala ## @@ -756,6 +756,19 @@ class DataSourceV2SQLSuite }

[GitHub] [spark] SparkQA commented on pull request #29055: [SPARK-32251][SQL][DOCS][TESTS] Fix SQL keyword document

2020-07-09 Thread GitBox
SparkQA commented on pull request #29055: URL: https://github.com/apache/spark/pull/29055#issuecomment-656485472 **[Test build #125557 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125557/testReport)** for PR 29055 at commit

[GitHub] [spark] maropu commented on a change in pull request #29062: [SPARK-32237][SQL] Resolve hint in CTE

2020-07-09 Thread GitBox
maropu commented on a change in pull request #29062: URL: https://github.com/apache/spark/pull/29062#discussion_r452624446 ## File path: sql/core/src/test/scala/org/apache/spark/sql/connector/DataSourceV2SQLSuite.scala ## @@ -756,6 +756,19 @@ class DataSourceV2SQLSuite }

[GitHub] [spark] SparkQA commented on pull request #29034: [SPARK-32219][SQL] Add SHOW CACHED TABLES Command

2020-07-09 Thread GitBox
SparkQA commented on pull request #29034: URL: https://github.com/apache/spark/pull/29034#issuecomment-656484439 **[Test build #125556 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125556/testReport)** for PR 29034 at commit

[GitHub] [spark] maropu commented on pull request #29055: [SPARK-32251][SQL][DOCS][TESTS] Fix SQL keyword document

2020-07-09 Thread GitBox
maropu commented on pull request #29055: URL: https://github.com/apache/spark/pull/29055#issuecomment-656484216 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] maropu commented on a change in pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-09 Thread GitBox
maropu commented on a change in pull request #29045: URL: https://github.com/apache/spark/pull/29045#discussion_r452623395 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/orc/OrcColumnarBatchReaderSuite.scala ## @@ -77,4 +77,43 @@ class

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29034: [SPARK-32219][SQL] Add SHOW CACHED TABLES Command

2020-07-09 Thread GitBox
AmplabJenkins removed a comment on pull request #29034: URL: https://github.com/apache/spark/pull/29034#issuecomment-656483701 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29034: [SPARK-32219][SQL] Add SHOW CACHED TABLES Command

2020-07-09 Thread GitBox
AmplabJenkins commented on pull request #29034: URL: https://github.com/apache/spark/pull/29034#issuecomment-656483701 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] dilipbiswal edited a comment on pull request #28683: [SPARK-31875][SQL] Provide a option to disable user supplied Hints

2020-07-09 Thread GitBox
dilipbiswal edited a comment on pull request #28683: URL: https://github.com/apache/spark/pull/28683#issuecomment-656483187 @dongjoon-hyun @maropu @cloud-fan @ulysses-you Thanks a lot. This is an automated message from the

[GitHub] [spark] dilipbiswal commented on pull request #28683: [SPARK-31875][SQL] Provide a option to disable user supplied Hints

2020-07-09 Thread GitBox
dilipbiswal commented on pull request #28683: URL: https://github.com/apache/spark/pull/28683#issuecomment-656483187 @dongjoon-hyun Thank you very much :-) This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29055: [SPARK-32251][SQL][DOCS][TESTS] Fix SQL keyword document

2020-07-09 Thread GitBox
AmplabJenkins removed a comment on pull request #29055: URL: https://github.com/apache/spark/pull/29055#issuecomment-656482084 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29055: [SPARK-32251][SQL][DOCS][TESTS] Fix SQL keyword document

2020-07-09 Thread GitBox
AmplabJenkins removed a comment on pull request #29055: URL: https://github.com/apache/spark/pull/29055#issuecomment-656482077 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29055: [SPARK-32251][SQL][DOCS][TESTS] Fix SQL keyword document

2020-07-09 Thread GitBox
AmplabJenkins commented on pull request #29055: URL: https://github.com/apache/spark/pull/29055#issuecomment-656482077 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-09 Thread GitBox
AmplabJenkins removed a comment on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-656481931 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-09 Thread GitBox
AmplabJenkins commented on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-656481931 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-09 Thread GitBox
SparkQA commented on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-656481611 **[Test build #12 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/12/testReport)** for PR 29045 at commit

[GitHub] [spark] maropu commented on a change in pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-09 Thread GitBox
maropu commented on a change in pull request #29045: URL: https://github.com/apache/spark/pull/29045#discussion_r452621076 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/orc/OrcColumnarBatchReaderSuite.scala ## @@ -77,4 +77,43 @@ class

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29034: [SPARK-32219][SQL] Add SHOW CACHED TABLES Command

2020-07-09 Thread GitBox
AmplabJenkins removed a comment on pull request #29034: URL: https://github.com/apache/spark/pull/29034#issuecomment-656481034 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] maropu commented on a change in pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-09 Thread GitBox
maropu commented on a change in pull request #29045: URL: https://github.com/apache/spark/pull/29045#discussion_r452620989 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/orc/OrcColumnarBatchReaderSuite.scala ## @@ -77,4 +77,43 @@ class

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29034: [SPARK-32219][SQL] Add SHOW CACHED TABLES Command

2020-07-09 Thread GitBox
AmplabJenkins removed a comment on pull request #29034: URL: https://github.com/apache/spark/pull/29034#issuecomment-656481025 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #29055: [SPARK-32251][SQL][DOCS][TESTS] Fix SQL keyword document

2020-07-09 Thread GitBox
SparkQA removed a comment on pull request #29055: URL: https://github.com/apache/spark/pull/29055#issuecomment-656344977 **[Test build #125514 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125514/testReport)** for PR 29055 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29034: [SPARK-32219][SQL] Add SHOW CACHED TABLES Command

2020-07-09 Thread GitBox
AmplabJenkins commented on pull request #29034: URL: https://github.com/apache/spark/pull/29034#issuecomment-656481025 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] maropu commented on pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-09 Thread GitBox
maropu commented on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-656481035 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-09 Thread GitBox
AmplabJenkins removed a comment on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-656480364 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on pull request #29055: [SPARK-32251][SQL][DOCS][TESTS] Fix SQL keyword document

2020-07-09 Thread GitBox
SparkQA commented on pull request #29055: URL: https://github.com/apache/spark/pull/29055#issuecomment-656480655 **[Test build #125514 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125514/testReport)** for PR 29055 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28979: [SPARK-32154][SQL] Use ExpressionEncoder for the return type of ScalaUDF to convert to catalyst type

2020-07-09 Thread GitBox
AmplabJenkins removed a comment on pull request #28979: URL: https://github.com/apache/spark/pull/28979#issuecomment-656480264 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-09 Thread GitBox
AmplabJenkins removed a comment on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-656480361 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #29034: [SPARK-32219][SQL] Add SHOW CACHED TABLES Command

2020-07-09 Thread GitBox
SparkQA removed a comment on pull request #29034: URL: https://github.com/apache/spark/pull/29034#issuecomment-656434656 **[Test build #125534 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125534/testReport)** for PR 29034 at commit

[GitHub] [spark] SparkQA commented on pull request #28979: [SPARK-32154][SQL] Use ExpressionEncoder for the return type of ScalaUDF to convert to catalyst type

2020-07-09 Thread GitBox
SparkQA commented on pull request #28979: URL: https://github.com/apache/spark/pull/28979#issuecomment-656480373 **[Test build #125554 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125554/testReport)** for PR 28979 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-09 Thread GitBox
AmplabJenkins commented on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-656480361 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28979: [SPARK-32154][SQL] Use ExpressionEncoder for the return type of ScalaUDF to convert to catalyst type

2020-07-09 Thread GitBox
AmplabJenkins commented on pull request #28979: URL: https://github.com/apache/spark/pull/28979#issuecomment-656480264 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29034: [SPARK-32219][SQL] Add SHOW CACHED TABLES Command

2020-07-09 Thread GitBox
SparkQA commented on pull request #29034: URL: https://github.com/apache/spark/pull/29034#issuecomment-656480243 **[Test build #125534 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125534/testReport)** for PR 29034 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-09 Thread GitBox
SparkQA removed a comment on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-656384460 **[Test build #125520 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125520/testReport)** for PR 29045 at commit

[GitHub] [spark] maropu commented on pull request #28979: [SPARK-32154][SQL] Use ExpressionEncoder for the return type of ScalaUDF to convert to catalyst type

2020-07-09 Thread GitBox
maropu commented on pull request #28979: URL: https://github.com/apache/spark/pull/28979#issuecomment-656479376 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] SparkQA commented on pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-09 Thread GitBox
SparkQA commented on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-656479282 **[Test build #125520 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125520/testReport)** for PR 29045 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29062: [SPARK-32237][SQL] Resolve hint in CTE

2020-07-09 Thread GitBox
AmplabJenkins removed a comment on pull request #29062: URL: https://github.com/apache/spark/pull/29062#issuecomment-656478525 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29062: [SPARK-32237][SQL] Resolve hint in CTE

2020-07-09 Thread GitBox
AmplabJenkins commented on pull request #29062: URL: https://github.com/apache/spark/pull/29062#issuecomment-656478525 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29062: [SPARK-32237][SQL] Resolve hint in CTE

2020-07-09 Thread GitBox
SparkQA commented on pull request #29062: URL: https://github.com/apache/spark/pull/29062#issuecomment-656478192 **[Test build #125553 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125553/testReport)** for PR 29062 at commit

[GitHub] [spark] LantaoJin opened a new pull request #29062: [SPARK-32237][SQL] Resolve hint in CTE

2020-07-09 Thread GitBox
LantaoJin opened a new pull request #29062: URL: https://github.com/apache/spark/pull/29062 ### Why are the changes needed? Below SQL in Spark3.0 will throw AnalysisException, but it works in Spark2.x ``` WITH cte AS (SELECT /*+ REPARTITION(3) */ T.id, T.data FROM $t1 T) SELECT

[GitHub] [spark] AmplabJenkins commented on pull request #28967: [SPARK-32149][SHUFFLE] Improve file path name normalisation at block resolution within the external shuffle service

2020-07-09 Thread GitBox
AmplabJenkins commented on pull request #28967: URL: https://github.com/apache/spark/pull/28967#issuecomment-656476856 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28967: [SPARK-32149][SHUFFLE] Improve file path name normalisation at block resolution within the external shuffle service

2020-07-09 Thread GitBox
AmplabJenkins removed a comment on pull request #28967: URL: https://github.com/apache/spark/pull/28967#issuecomment-656476856 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28967: [SPARK-32149][SHUFFLE] Improve file path name normalisation at block resolution within the external shuffle service

2020-07-09 Thread GitBox
AmplabJenkins removed a comment on pull request #28967: URL: https://github.com/apache/spark/pull/28967#issuecomment-656475603 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on pull request #28967: [SPARK-32149][SHUFFLE] Improve file path name normalisation at block resolution within the external shuffle service

2020-07-09 Thread GitBox
SparkQA commented on pull request #28967: URL: https://github.com/apache/spark/pull/28967#issuecomment-656476651 **[Test build #125552 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125552/testReport)** for PR 28967 at commit

[GitHub] [spark] gengliangwang commented on a change in pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

2020-07-09 Thread GitBox
gengliangwang commented on a change in pull request #29057: URL: https://github.com/apache/spark/pull/29057#discussion_r452616560 ## File path: dev/run-tests.py ## @@ -595,13 +601,28 @@ def main(): changed_modules = None changed_files = None -if test_env ==

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28967: [SPARK-32149][SHUFFLE] Improve file path name normalisation at block resolution within the external shuffle service

2020-07-09 Thread GitBox
AmplabJenkins removed a comment on pull request #28967: URL: https://github.com/apache/spark/pull/28967#issuecomment-656475597 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28967: [SPARK-32149][SHUFFLE] Improve file path name normalisation at block resolution within the external shuffle service

2020-07-09 Thread GitBox
AmplabJenkins commented on pull request #28967: URL: https://github.com/apache/spark/pull/28967#issuecomment-656475597 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] HeartSaVioR commented on pull request #28967: [SPARK-32149][SHUFFLE] Improve file path name normalisation at block resolution within the external shuffle service

2020-07-09 Thread GitBox
HeartSaVioR commented on pull request #28967: URL: https://github.com/apache/spark/pull/28967#issuecomment-656475406 Retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] SparkQA removed a comment on pull request #28967: [SPARK-32149][SHUFFLE] Improve file path name normalisation at block resolution within the external shuffle service

2020-07-09 Thread GitBox
SparkQA removed a comment on pull request #28967: URL: https://github.com/apache/spark/pull/28967#issuecomment-656420486 **[Test build #125528 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125528/testReport)** for PR 28967 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28979: [SPARK-32154][SQL] Use ExpressionEncoder for the return type of ScalaUDF to convert to catalyst type

2020-07-09 Thread GitBox
AmplabJenkins removed a comment on pull request #28979: URL: https://github.com/apache/spark/pull/28979#issuecomment-656474785 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28979: [SPARK-32154][SQL] Use ExpressionEncoder for the return type of ScalaUDF to convert to catalyst type

2020-07-09 Thread GitBox
AmplabJenkins removed a comment on pull request #28979: URL: https://github.com/apache/spark/pull/28979#issuecomment-656474782 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] agrawaldevesh commented on pull request #29014: [SPARK-32199][SPARK-32198] Reduce job failures during decommissioning

2020-07-09 Thread GitBox
agrawaldevesh commented on pull request #29014: URL: https://github.com/apache/spark/pull/29014#issuecomment-656474975 @holdenk, @jiangxb1987 @cloud-fan @Ngone51 -- This PR is ready for your review please. Thanks ! This is

[GitHub] [spark] SparkQA commented on pull request #28967: [SPARK-32149][SHUFFLE] Improve file path name normalisation at block resolution within the external shuffle service

2020-07-09 Thread GitBox
SparkQA commented on pull request #28967: URL: https://github.com/apache/spark/pull/28967#issuecomment-656474900 **[Test build #125528 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125528/testReport)** for PR 28967 at commit

[GitHub] [spark] agrawaldevesh commented on pull request #29015: [SPARK-32215] Expose a (protected) /workers/kill endpoint on the MasterWebUI

2020-07-09 Thread GitBox
agrawaldevesh commented on pull request #29015: URL: https://github.com/apache/spark/pull/29015#issuecomment-656474929 @holdenk, @jiangxb1987 @cloud-fan @Ngone51 -- This PR is ready for your review please. Thanks ! This is

[GitHub] [spark] agrawaldevesh commented on pull request #29032: [SPARK-32217] Plumb whether a worker would also be decommissioned along with executor

2020-07-09 Thread GitBox
agrawaldevesh commented on pull request #29032: URL: https://github.com/apache/spark/pull/29032#issuecomment-656474836 @holdenk, @jiangxb1987 @cloud-fan @Ngone51 -- This PR is ready for your review please. Thanks ! This is

[GitHub] [spark] AmplabJenkins commented on pull request #28979: [SPARK-32154][SQL] Use ExpressionEncoder for the return type of ScalaUDF to convert to catalyst type

2020-07-09 Thread GitBox
AmplabJenkins commented on pull request #28979: URL: https://github.com/apache/spark/pull/28979#issuecomment-656474782 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] bharatviswa504 commented on pull request #29030: [WIP][SPARK-32093][BUILD] Add hadoop-ozone-filesystem jar.

2020-07-09 Thread GitBox
bharatviswa504 commented on pull request #29030: URL: https://github.com/apache/spark/pull/29030#issuecomment-656474666 > t not every app needs to include it, I can see trying to build it into a Spark distro. It wouldn't be enabled by default. It could go in hadoop-cloud though this isn't

[GitHub] [spark] SparkQA removed a comment on pull request #28979: [SPARK-32154][SQL] Use ExpressionEncoder for the return type of ScalaUDF to convert to catalyst type

2020-07-09 Thread GitBox
SparkQA removed a comment on pull request #28979: URL: https://github.com/apache/spark/pull/28979#issuecomment-656396975 **[Test build #125523 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125523/testReport)** for PR 28979 at commit

[GitHub] [spark] bharatviswa504 commented on a change in pull request #29030: [WIP][SPARK-32093][BUILD] Add hadoop-ozone-filesystem jar.

2020-07-09 Thread GitBox
bharatviswa504 commented on a change in pull request #29030: URL: https://github.com/apache/spark/pull/29030#discussion_r452614277 ## File path: pom.xml ## @@ -202,6 +202,9 @@ 0.15.1 org.fusesource.leveldbjni + + +0.5.0-beta Review comment:

[GitHub] [spark] SparkQA commented on pull request #28979: [SPARK-32154][SQL] Use ExpressionEncoder for the return type of ScalaUDF to convert to catalyst type

2020-07-09 Thread GitBox
SparkQA commented on pull request #28979: URL: https://github.com/apache/spark/pull/28979#issuecomment-656474181 **[Test build #125523 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125523/testReport)** for PR 28979 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should show error message

2020-07-09 Thread GitBox
AmplabJenkins removed a comment on pull request #29054: URL: https://github.com/apache/spark/pull/29054#issuecomment-656472339 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28996: [SPARK-29358][SQL] Make unionByName optionally fill missing columns with nulls

2020-07-09 Thread GitBox
AmplabJenkins commented on pull request #28996: URL: https://github.com/apache/spark/pull/28996#issuecomment-656472252 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28996: [SPARK-29358][SQL] Make unionByName optionally fill missing columns with nulls

2020-07-09 Thread GitBox
AmplabJenkins removed a comment on pull request #28996: URL: https://github.com/apache/spark/pull/28996#issuecomment-656472252 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should show error message

2020-07-09 Thread GitBox
AmplabJenkins commented on pull request #29054: URL: https://github.com/apache/spark/pull/29054#issuecomment-656472339 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] HeartSaVioR closed pull request #29036: [SPARK-32242][SQL] CliSuite flakiness fix via differentiating cli driver bootup timeout and query execution timeout

2020-07-09 Thread GitBox
HeartSaVioR closed pull request #29036: URL: https://github.com/apache/spark/pull/29036 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] SparkQA commented on pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should show error message

2020-07-09 Thread GitBox
SparkQA commented on pull request #29054: URL: https://github.com/apache/spark/pull/29054#issuecomment-656472024 **[Test build #125550 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125550/testReport)** for PR 29054 at commit

[GitHub] [spark] SparkQA commented on pull request #28996: [SPARK-29358][SQL] Make unionByName optionally fill missing columns with nulls

2020-07-09 Thread GitBox
SparkQA commented on pull request #28996: URL: https://github.com/apache/spark/pull/28996#issuecomment-656472034 **[Test build #125551 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125551/testReport)** for PR 28996 at commit

[GitHub] [spark] HeartSaVioR commented on pull request #29036: [SPARK-32242][SQL] CliSuite flakiness fix via differentiating cli driver bootup timeout and query execution timeout

2020-07-09 Thread GitBox
HeartSaVioR commented on pull request #29036: URL: https://github.com/apache/spark/pull/29036#issuecomment-656471953 Thanks for the feedbacks! Merging to master. As same as #29039, we can port back anytime when we find the flakiness in other branches, so it should be OK to start with only

  1   2   3   4   5   6   7   8   9   10   >