[GitHub] [spark] AmplabJenkins removed a comment on pull request #29074: [SPARK-32282][SQL] Improve EnsureRquirement.reorderJoinKeys to handle more scenarios such as PartitioningCollection

2020-07-12 Thread GitBox
AmplabJenkins removed a comment on pull request #29074: URL: https://github.com/apache/spark/pull/29074#issuecomment-657184241 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #29061: [SPARK-32258][SQL] NormalizeFloatingNumbers can directly normalize on IF and CaseWhen children expressions

2020-07-12 Thread GitBox
AmplabJenkins commented on pull request #29061: URL: https://github.com/apache/spark/pull/29061#issuecomment-657184578 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29061: [SPARK-32258][SQL] NormalizeFloatingNumbers can directly normalize on IF and CaseWhen children expressions

2020-07-12 Thread GitBox
AmplabJenkins removed a comment on pull request #29061: URL: https://github.com/apache/spark/pull/29061#issuecomment-657184578 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28425: [SPARK-31480][SQL] Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-07-12 Thread GitBox
AmplabJenkins removed a comment on pull request #28425: URL: https://github.com/apache/spark/pull/28425#issuecomment-657184567 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28425: [SPARK-31480][SQL] Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-07-12 Thread GitBox
AmplabJenkins removed a comment on pull request #28425: URL: https://github.com/apache/spark/pull/28425#issuecomment-657184174 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29074: [SPARK-32282][SQL] Improve EnsureRquirement.reorderJoinKeys to handle more scenarios such as PartitioningCollection

2020-07-12 Thread GitBox
AmplabJenkins removed a comment on pull request #29074: URL: https://github.com/apache/spark/pull/29074#issuecomment-657184238 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #29074: [SPARK-32282][SQL] Improve EnsureRquirement.reorderJoinKeys to handle more scenarios such as PartitioningCollection

2020-07-12 Thread GitBox
SparkQA removed a comment on pull request #29074: URL: https://github.com/apache/spark/pull/29074#issuecomment-657167295 **[Test build #125704 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125704/testReport)** for PR 29074 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28425: [SPARK-31480][SQL] Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-07-12 Thread GitBox
SparkQA removed a comment on pull request #28425: URL: https://github.com/apache/spark/pull/28425#issuecomment-657180494 **[Test build #125705 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125705/testReport)** for PR 28425 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29061: [SPARK-32258][SQL] NormalizeFloatingNumbers can directly normalize on IF and CaseWhen children expressions

2020-07-12 Thread GitBox
AmplabJenkins removed a comment on pull request #29061: URL: https://github.com/apache/spark/pull/29061#issuecomment-657183341 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28715: [SPARK-31897][SQL] Enable codegen for GenerateExec

2020-07-12 Thread GitBox
AmplabJenkins removed a comment on pull request #28715: URL: https://github.com/apache/spark/pull/28715#issuecomment-657183621 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28425: [SPARK-31480][SQL] Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-07-12 Thread GitBox
SparkQA commented on pull request #28425: URL: https://github.com/apache/spark/pull/28425#issuecomment-657184487 **[Test build #125708 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125708/testReport)** for PR 28425 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29061: [SPARK-32258][SQL] NormalizeFloatingNumbers can directly normalize on IF and CaseWhen children expressions

2020-07-12 Thread GitBox
SparkQA removed a comment on pull request #29061: URL: https://github.com/apache/spark/pull/29061#issuecomment-657183233 **[Test build #125706 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125706/testReport)** for PR 29061 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28715: [SPARK-31897][SQL] Enable codegen for GenerateExec

2020-07-12 Thread GitBox
SparkQA removed a comment on pull request #28715: URL: https://github.com/apache/spark/pull/28715#issuecomment-657163441 **[Test build #125703 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125703/testReport)** for PR 28715 at commit

[GitHub] [spark] SparkQA commented on pull request #29061: [SPARK-32258][SQL] NormalizeFloatingNumbers can directly normalize on IF and CaseWhen children expressions

2020-07-12 Thread GitBox
SparkQA commented on pull request #29061: URL: https://github.com/apache/spark/pull/29061#issuecomment-657184482 **[Test build #125707 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125707/testReport)** for PR 29061 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28425: [SPARK-31480][SQL] Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-07-12 Thread GitBox
AmplabJenkins commented on pull request #28425: URL: https://github.com/apache/spark/pull/28425#issuecomment-657184567 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-12 Thread GitBox
SparkQA commented on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-657187134 **[Test build #125710 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125710/testReport)** for PR 29045 at commit

[GitHub] [spark] maropu commented on pull request #29067: [SPARK-32274][SQL] Make SQL cache serialization pluggable

2020-07-12 Thread GitBox
maropu commented on pull request #29067: URL: https://github.com/apache/spark/pull/29067#issuecomment-657188271 Hi, @revans2 , thanks for the work. I have two questions now; > The use case we have right now is in connection with https://github.com/NVIDIA/spark-rapids where we would like

[GitHub] [spark] SparkQA commented on pull request #28953: [SPARK-32013][SQL] Support query execution before reading DataFrame and before/after writing DataFrame over JDBC

2020-07-12 Thread GitBox
SparkQA commented on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-657188392 **[Test build #125711 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125711/testReport)** for PR 28953 at commit

[GitHub] [spark] SparkQA commented on pull request #27690: [SPARK-21514][SQL] Added a new option to use non-blobstore storage when writing into blobstore storage

2020-07-12 Thread GitBox
SparkQA commented on pull request #27690: URL: https://github.com/apache/spark/pull/27690#issuecomment-657188395 **[Test build #125712 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125712/testReport)** for PR 27690 at commit

[GitHub] [spark] HeartSaVioR commented on pull request #29069: [SPARK-31831][SQL][TESTS] Use subclasses for mock in HiveSessionImplSuite

2020-07-12 Thread GitBox
HeartSaVioR commented on pull request #29069: URL: https://github.com/apache/spark/pull/29069#issuecomment-657190799 @frankyin-factual Thanks for the update. The approach looks good. Would you mind if we just put everything in the suite, so that we don't need to find things which is

[GitHub] [spark] dilipbiswal commented on a change in pull request #28425: [SPARK-31480][SQL] Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-07-12 Thread GitBox
dilipbiswal commented on a change in pull request #28425: URL: https://github.com/apache/spark/pull/28425#discussion_r453272686 ## File path: sql/core/src/test/scala/org/apache/spark/sql/ExplainSuite.scala ## @@ -360,6 +360,54 @@ class ExplainSuite extends ExplainSuiteHelper

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29013: [SPARK-32196][SQL] Extract In convertible part if it is not convertible

2020-07-12 Thread GitBox
AmplabJenkins removed a comment on pull request #29013: URL: https://github.com/apache/spark/pull/29013#issuecomment-657179793 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] dilipbiswal commented on a change in pull request #28425: [SPARK-31480][SQL] Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-07-12 Thread GitBox
dilipbiswal commented on a change in pull request #28425: URL: https://github.com/apache/spark/pull/28425#discussion_r453272871 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/FileScan.scala ## @@ -94,22 +96,27 @@ trait FileScan extends

[GitHub] [spark] AmplabJenkins commented on pull request #29013: [SPARK-32196][SQL] Extract In convertible part if it is not convertible

2020-07-12 Thread GitBox
AmplabJenkins commented on pull request #29013: URL: https://github.com/apache/spark/pull/29013#issuecomment-657179793 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] dilipbiswal commented on a change in pull request #28425: [SPARK-31480][SQL] Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-07-12 Thread GitBox
dilipbiswal commented on a change in pull request #28425: URL: https://github.com/apache/spark/pull/28425#discussion_r453272949 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/connector/SupportsMetadata.scala ## @@ -0,0 +1,28 @@ +/* + * Licensed to the

[GitHub] [spark] dilipbiswal commented on a change in pull request #28425: [SPARK-31480][SQL] Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-07-12 Thread GitBox
dilipbiswal commented on a change in pull request #28425: URL: https://github.com/apache/spark/pull/28425#discussion_r453272871 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/FileScan.scala ## @@ -94,22 +96,27 @@ trait FileScan extends

[GitHub] [spark] dilipbiswal commented on a change in pull request #28425: [SPARK-31480][SQL] Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-07-12 Thread GitBox
dilipbiswal commented on a change in pull request #28425: URL: https://github.com/apache/spark/pull/28425#discussion_r453272923 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/FileScan.scala ## @@ -94,22 +96,27 @@ trait FileScan extends

[GitHub] [spark] dilipbiswal commented on a change in pull request #28425: [SPARK-31480][SQL] Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-07-12 Thread GitBox
dilipbiswal commented on a change in pull request #28425: URL: https://github.com/apache/spark/pull/28425#discussion_r453272935 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/DataSourceV2ScanExecBase.scala ## @@ -43,7 +44,32 @@ trait

[GitHub] [spark] dilipbiswal commented on a change in pull request #28425: [SPARK-31480][SQL] Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-07-12 Thread GitBox
dilipbiswal commented on a change in pull request #28425: URL: https://github.com/apache/spark/pull/28425#discussion_r453272707 ## File path: sql/core/src/test/scala/org/apache/spark/sql/ExplainSuite.scala ## @@ -360,6 +360,54 @@ class ExplainSuite extends ExplainSuiteHelper

[GitHub] [spark] SparkQA commented on pull request #28425: [SPARK-31480][SQL] Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-07-12 Thread GitBox
SparkQA commented on pull request #28425: URL: https://github.com/apache/spark/pull/28425#issuecomment-657184154 **[Test build #125705 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125705/testReport)** for PR 28425 at commit

[GitHub] [spark] SparkQA commented on pull request #29061: [SPARK-32258][SQL] NormalizeFloatingNumbers can directly normalize on IF and CaseWhen children expressions

2020-07-12 Thread GitBox
SparkQA commented on pull request #29061: URL: https://github.com/apache/spark/pull/29061#issuecomment-657184155 **[Test build #125706 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125706/testReport)** for PR 29061 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29061: [SPARK-32258][SQL] NormalizeFloatingNumbers can directly normalize on IF and CaseWhen children expressions

2020-07-12 Thread GitBox
AmplabJenkins commented on pull request #29061: URL: https://github.com/apache/spark/pull/29061#issuecomment-657184162 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] maropu commented on pull request #29061: [SPARK-32258][SQL] NormalizeFloatingNumbers can directly normalize on IF and CaseWhen children expressions

2020-07-12 Thread GitBox
maropu commented on pull request #29061: URL: https://github.com/apache/spark/pull/29061#issuecomment-657184236 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins commented on pull request #29074: [SPARK-32282][SQL] Improve EnsureRquirement.reorderJoinKeys to handle more scenarios such as PartitioningCollection

2020-07-12 Thread GitBox
AmplabJenkins commented on pull request #29074: URL: https://github.com/apache/spark/pull/29074#issuecomment-657184238 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28425: [SPARK-31480][SQL] Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-07-12 Thread GitBox
SparkQA commented on pull request #28425: URL: https://github.com/apache/spark/pull/28425#issuecomment-657180494 **[Test build #125705 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125705/testReport)** for PR 28425 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28425: [SPARK-31480][SQL] Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-07-12 Thread GitBox
AmplabJenkins commented on pull request #28425: URL: https://github.com/apache/spark/pull/28425#issuecomment-657180591 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SaurabhChawla100 commented on a change in pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-12 Thread GitBox
SaurabhChawla100 commented on a change in pull request #29045: URL: https://github.com/apache/spark/pull/29045#discussion_r453278778 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/orc/OrcFileFormat.scala ## @@ -181,10 +183,19 @@ class

[GitHub] [spark] SparkQA commented on pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-12 Thread GitBox
SparkQA commented on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-657185105 **[Test build #125709 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125709/testReport)** for PR 29045 at commit

[GitHub] [spark] SaurabhChawla100 commented on pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-12 Thread GitBox
SaurabhChawla100 commented on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-657185061 > @SaurabhChawla100 . Thanks for updating. Apache Spark has two ORC implementations `native` and `hive`. Could you add the following test coverage more? > > 1.

[GitHub] [spark] SparkQA removed a comment on pull request #29013: [SPARK-32196][SQL] Extract In convertible part if it is not convertible

2020-07-12 Thread GitBox
SparkQA removed a comment on pull request #29013: URL: https://github.com/apache/spark/pull/29013#issuecomment-657157955 **[Test build #125700 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125700/testReport)** for PR 29013 at commit

[GitHub] [spark] SparkQA commented on pull request #29013: [SPARK-32196][SQL] Extract In convertible part if it is not convertible

2020-07-12 Thread GitBox
SparkQA commented on pull request #29013: URL: https://github.com/apache/spark/pull/29013#issuecomment-657179699 **[Test build #125700 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125700/testReport)** for PR 29013 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-12 Thread GitBox
AmplabJenkins removed a comment on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-657185244 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-12 Thread GitBox
AmplabJenkins commented on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-657185244 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] moomindani commented on pull request #28953: [SPARK-32013][SQL] Support query execution before reading DataFrame and before/after writing DataFrame over JDBC

2020-07-12 Thread GitBox
moomindani commented on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-657188173 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] moomindani commented on pull request #27690: [SPARK-21514][SQL] Added a new option to use non-blobstore storage when writing into blobstore storage

2020-07-12 Thread GitBox
moomindani commented on pull request #27690: URL: https://github.com/apache/spark/pull/27690#issuecomment-657187878 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] frankyin-factual commented on pull request #29069: [SPARK-31831][SQL][TESTS] Use subclasses for mock in HiveSessionImplSuite

2020-07-12 Thread GitBox
frankyin-factual commented on pull request #29069: URL: https://github.com/apache/spark/pull/29069#issuecomment-657193575 Just pushed such changes. This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28425: [SPARK-31480][SQL] Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-07-12 Thread GitBox
AmplabJenkins removed a comment on pull request #28425: URL: https://github.com/apache/spark/pull/28425#issuecomment-657180591 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] viirya commented on a change in pull request #29062: [SPARK-32237][SQL] Resolve hint in CTE

2020-07-12 Thread GitBox
viirya commented on a change in pull request #29062: URL: https://github.com/apache/spark/pull/29062#discussion_r453274376 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala ## @@ -200,18 +200,18 @@ class Analyzer( val

[GitHub] [spark] AmplabJenkins commented on pull request #29061: [SPARK-32258][SQL] NormalizeFloatingNumbers can directly normalize on IF and CaseWhen children expressions

2020-07-12 Thread GitBox
AmplabJenkins commented on pull request #29061: URL: https://github.com/apache/spark/pull/29061#issuecomment-657183341 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29061: [SPARK-32258][SQL] NormalizeFloatingNumbers can directly normalize on IF and CaseWhen children expressions

2020-07-12 Thread GitBox
SparkQA commented on pull request #29061: URL: https://github.com/apache/spark/pull/29061#issuecomment-657183233 **[Test build #125706 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125706/testReport)** for PR 29061 at commit

[GitHub] [spark] maropu commented on pull request #28425: [SPARK-31480][SQL] Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-07-12 Thread GitBox
maropu commented on pull request #28425: URL: https://github.com/apache/spark/pull/28425#issuecomment-657184219 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] SparkQA commented on pull request #29074: [SPARK-32282][SQL] Improve EnsureRquirement.reorderJoinKeys to handle more scenarios such as PartitioningCollection

2020-07-12 Thread GitBox
SparkQA commented on pull request #29074: URL: https://github.com/apache/spark/pull/29074#issuecomment-657184156 **[Test build #125704 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125704/testReport)** for PR 29074 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28425: [SPARK-31480][SQL] Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-07-12 Thread GitBox
AmplabJenkins commented on pull request #28425: URL: https://github.com/apache/spark/pull/28425#issuecomment-657184174 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] viirya commented on a change in pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

2020-07-12 Thread GitBox
viirya commented on a change in pull request #28898: URL: https://github.com/apache/spark/pull/28898#discussion_r453280182 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/SchemaPruningSuite.scala ## @@ -460,6 +460,60 @@ abstract class

[GitHub] [spark] viirya commented on a change in pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

2020-07-12 Thread GitBox
viirya commented on a change in pull request #28898: URL: https://github.com/apache/spark/pull/28898#discussion_r453280237 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/SchemaPruningSuite.scala ## @@ -460,6 +460,60 @@ abstract class

[GitHub] [spark] viirya commented on a change in pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

2020-07-12 Thread GitBox
viirya commented on a change in pull request #28898: URL: https://github.com/apache/spark/pull/28898#discussion_r453280293 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/SchemaPruningSuite.scala ## @@ -460,6 +460,60 @@ abstract class

[GitHub] [spark] SaurabhChawla100 commented on pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-12 Thread GitBox
SaurabhChawla100 commented on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-657186265 > Thank you for updating, but could you update the PR description with the reproducible example? If someone is following the example, it will not fail because they

[GitHub] [spark] AmplabJenkins commented on pull request #29069: [SPARK-31831][SQL][TESTS] Use subclasses for mock in HiveSessionImplSuite

2020-07-12 Thread GitBox
AmplabJenkins commented on pull request #29069: URL: https://github.com/apache/spark/pull/29069#issuecomment-657194726 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29069: [SPARK-31831][SQL][TESTS] Use subclasses for mock in HiveSessionImplSuite

2020-07-12 Thread GitBox
AmplabJenkins removed a comment on pull request #29069: URL: https://github.com/apache/spark/pull/29069#issuecomment-657194726 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28715: [SPARK-31897][SQL] Enable codegen for GenerateExec

2020-07-12 Thread GitBox
AmplabJenkins commented on pull request #28715: URL: https://github.com/apache/spark/pull/28715#issuecomment-657183621 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28715: [SPARK-31897][SQL] Enable codegen for GenerateExec

2020-07-12 Thread GitBox
SparkQA commented on pull request #28715: URL: https://github.com/apache/spark/pull/28715#issuecomment-657183513 **[Test build #125703 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125703/testReport)** for PR 28715 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-12 Thread GitBox
AmplabJenkins commented on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-657187214 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-12 Thread GitBox
AmplabJenkins removed a comment on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-657187214 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27690: [SPARK-21514][SQL] Added a new option to use non-blobstore storage when writing into blobstore storage

2020-07-12 Thread GitBox
AmplabJenkins removed a comment on pull request #27690: URL: https://github.com/apache/spark/pull/27690#issuecomment-657188477 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28953: [SPARK-32013][SQL] Support query execution before reading DataFrame and before/after writing DataFrame over JDBC

2020-07-12 Thread GitBox
AmplabJenkins commented on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-657188465 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #27690: [SPARK-21514][SQL] Added a new option to use non-blobstore storage when writing into blobstore storage

2020-07-12 Thread GitBox
AmplabJenkins commented on pull request #27690: URL: https://github.com/apache/spark/pull/27690#issuecomment-657188477 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28953: [SPARK-32013][SQL] Support query execution before reading DataFrame and before/after writing DataFrame over JDBC

2020-07-12 Thread GitBox
AmplabJenkins removed a comment on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-657188465 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #29069: [SPARK-31831][SQL][TESTS] Use subclasses for mock in HiveSessionImplSuite

2020-07-12 Thread GitBox
SparkQA commented on pull request #29069: URL: https://github.com/apache/spark/pull/29069#issuecomment-657194434 **[Test build #125713 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125713/testReport)** for PR 29069 at commit

[GitHub] [spark] SparkQA commented on pull request #29069: [SPARK-31831][SQL][TESTS] Use subclasses for mock in HiveSessionImplSuite

2020-07-12 Thread GitBox
SparkQA commented on pull request #29069: URL: https://github.com/apache/spark/pull/29069#issuecomment-657197498 **[Test build #125713 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125713/testReport)** for PR 29069 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29069: [SPARK-31831][SQL][TESTS] Use subclasses for mock in HiveSessionImplSuite

2020-07-12 Thread GitBox
AmplabJenkins commented on pull request #29069: URL: https://github.com/apache/spark/pull/29069#issuecomment-657197562 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] frankyin-factual commented on a change in pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

2020-07-12 Thread GitBox
frankyin-factual commented on a change in pull request #28898: URL: https://github.com/apache/spark/pull/28898#discussion_r453293880 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/SchemaPruningSuite.scala ## @@ -460,6 +460,60 @@ abstract

[GitHub] [spark] frankyin-factual commented on a change in pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

2020-07-12 Thread GitBox
frankyin-factual commented on a change in pull request #28898: URL: https://github.com/apache/spark/pull/28898#discussion_r453294078 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/SchemaPruningSuite.scala ## @@ -460,6 +460,60 @@ abstract

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28953: [SPARK-32013][SQL] Support query execution before reading DataFrame and before/after writing DataFrame over JDBC

2020-07-12 Thread GitBox
AmplabJenkins removed a comment on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-657203704 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28425: [SPARK-31480][SQL] Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-07-12 Thread GitBox
AmplabJenkins removed a comment on pull request #28425: URL: https://github.com/apache/spark/pull/28425#issuecomment-657212351 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-12 Thread GitBox
SparkQA commented on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-657212746 **[Test build #125709 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125709/testReport)** for PR 29045 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

2020-07-12 Thread GitBox
AmplabJenkins commented on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-657230025 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

2020-07-12 Thread GitBox
SparkQA removed a comment on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-657199034 **[Test build #125714 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125714/testReport)** for PR 28898 at commit

[GitHub] [spark] SparkQA commented on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

2020-07-12 Thread GitBox
SparkQA commented on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-657229858 **[Test build #125714 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125714/testReport)** for PR 28898 at commit

[GitHub] [spark] SparkQA commented on pull request #29073: Update ml-datasource.md

2020-07-12 Thread GitBox
SparkQA commented on pull request #29073: URL: https://github.com/apache/spark/pull/29073#issuecomment-657233451 **[Test build #125717 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125717/testReport)** for PR 29073 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29073: Update ml-datasource.md

2020-07-12 Thread GitBox
AmplabJenkins removed a comment on pull request #29073: URL: https://github.com/apache/spark/pull/29073#issuecomment-657233593 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29073: Update ml-datasource.md

2020-07-12 Thread GitBox
AmplabJenkins commented on pull request #29073: URL: https://github.com/apache/spark/pull/29073#issuecomment-657233593 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

2020-07-12 Thread GitBox
AmplabJenkins removed a comment on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-657199334 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] TJX2014 commented on pull request #29043: [SPARK-32205][SQL] Writing timestamp to mysql should be datetime type

2020-07-12 Thread GitBox
TJX2014 commented on pull request #29043: URL: https://github.com/apache/spark/pull/29043#issuecomment-657210050 @huaxingao Yeah, One of these could happen when user use mysql client in spark to execute `SET TIME_ZONE = "america/new_york"` to use mysql timezone index feature between

[GitHub] [spark] SparkQA removed a comment on pull request #28425: [SPARK-31480][SQL] Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-07-12 Thread GitBox
SparkQA removed a comment on pull request #28425: URL: https://github.com/apache/spark/pull/28425#issuecomment-657184487 **[Test build #125708 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125708/testReport)** for PR 28425 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28425: [SPARK-31480][SQL] Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-07-12 Thread GitBox
AmplabJenkins commented on pull request #28425: URL: https://github.com/apache/spark/pull/28425#issuecomment-657212351 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28425: [SPARK-31480][SQL] Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-07-12 Thread GitBox
SparkQA commented on pull request #28425: URL: https://github.com/apache/spark/pull/28425#issuecomment-657212199 **[Test build #125708 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125708/testReport)** for PR 28425 at commit

[GitHub] [spark] SparkQA commented on pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-12 Thread GitBox
SparkQA commented on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-657215383 **[Test build #125710 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125710/testReport)** for PR 29045 at commit

[GitHub] [spark] gengliangwang opened a new pull request #29075: [SPARK-32284][SQL] Avoid pushing down too many predicated in partition pruning

2020-07-12 Thread GitBox
gengliangwang opened a new pull request #29075: URL: https://github.com/apache/spark/pull/29075 ### What changes were proposed in this pull request? After https://github.com/apache/spark/pull/28805, the pushed down predicates for partition pruning can be very long.

[GitHub] [spark] SparkQA commented on pull request #29075: [SPARK-32284][SQL] Avoid pushing down too many predicated in partition pruning

2020-07-12 Thread GitBox
SparkQA commented on pull request #29075: URL: https://github.com/apache/spark/pull/29075#issuecomment-657222046 **[Test build #125715 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125715/testReport)** for PR 29075 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

2020-07-12 Thread GitBox
AmplabJenkins removed a comment on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-657230025 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #29073: Update ml-datasource.md

2020-07-12 Thread GitBox
SparkQA commented on pull request #29073: URL: https://github.com/apache/spark/pull/29073#issuecomment-657234796 **[Test build #125717 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125717/testReport)** for PR 29073 at commit

[GitHub] [spark] frankyin-factual commented on a change in pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

2020-07-12 Thread GitBox
frankyin-factual commented on a change in pull request #28898: URL: https://github.com/apache/spark/pull/28898#discussion_r453293832 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/SchemaPruningSuite.scala ## @@ -460,6 +460,60 @@ abstract

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28953: [SPARK-32013][SQL] Support query execution before reading DataFrame and before/after writing DataFrame over JDBC

2020-07-12 Thread GitBox
AmplabJenkins removed a comment on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-657203700 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #28953: [SPARK-32013][SQL] Support query execution before reading DataFrame and before/after writing DataFrame over JDBC

2020-07-12 Thread GitBox
SparkQA removed a comment on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-657188392 **[Test build #125711 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125711/testReport)** for PR 28953 at commit

[GitHub] [spark] SparkQA commented on pull request #28953: [SPARK-32013][SQL] Support query execution before reading DataFrame and before/after writing DataFrame over JDBC

2020-07-12 Thread GitBox
SparkQA commented on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-657203624 **[Test build #125711 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125711/testReport)** for PR 28953 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28953: [SPARK-32013][SQL] Support query execution before reading DataFrame and before/after writing DataFrame over JDBC

2020-07-12 Thread GitBox
AmplabJenkins commented on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-657203700 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29061: [SPARK-32258][SQL] NormalizeFloatingNumbers can directly normalize on IF and CaseWhen children expressions

2020-07-12 Thread GitBox
SparkQA commented on pull request #29061: URL: https://github.com/apache/spark/pull/29061#issuecomment-657211831 **[Test build #125707 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125707/testReport)** for PR 29061 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-12 Thread GitBox
AmplabJenkins removed a comment on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-657212938 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-12 Thread GitBox
SparkQA removed a comment on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-657185105 **[Test build #125709 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125709/testReport)** for PR 29045 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-12 Thread GitBox
AmplabJenkins commented on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-657212938 This is an automated message from the Apache Git Service. To respond to the message, please log on to

  1   2   3   4   5   >