[GitHub] [spark] SparkQA removed a comment on pull request #32712: [SPARK-35576][SQL] Redact the sensitive info in the result of Set command

SparkQA removed a comment on pull request #32712: URL: https://github.com/apache/spark/pull/32712#issuecomment-851413527 **[Test build #139111 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139111/testReport)** for PR 32712 at commit

[GitHub] [spark] SparkQA commented on pull request #32712: [SPARK-35576][SQL] Redact the sensitive info in the result of Set command

SparkQA commented on pull request #32712: URL: https://github.com/apache/spark/pull/32712#issuecomment-851570104 **[Test build #139111 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139111/testReport)** for PR 32712 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #32558: [SPARK-34953][CORE][SQL] Add the code change for adding the DateType in the infer schema while reading in CSV and JSON

SparkQA removed a comment on pull request #32558: URL: https://github.com/apache/spark/pull/32558#issuecomment-851247187 **[Test build #139098 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139098/testReport)** for PR 32558 at commit

[GitHub] [spark] SparkQA commented on pull request #32558: [SPARK-34953][CORE][SQL] Add the code change for adding the DateType in the infer schema while reading in CSV and JSON

SparkQA commented on pull request #32558: URL: https://github.com/apache/spark/pull/32558#issuecomment-851557465 **[Test build #139098 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139098/testReport)** for PR 32558 at commit

[GitHub] [spark] SparkQA commented on pull request #32700: [SPARK-35558] Optimizes for multi-quantile retrieval

SparkQA commented on pull request #32700: URL: https://github.com/apache/spark/pull/32700#issuecomment-851557044 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43638/ -- This is an automated message from the

[GitHub] [spark] cloud-fan commented on a change in pull request #32716: [SPARK-35578][SQL][TEST] Add a test case for a bug in janino

cloud-fan commented on a change in pull request #32716: URL: https://github.com/apache/spark/pull/32716#discussion_r642559066 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/CodeGenerationSuite.scala ## @@ -558,6 +558,53 @@ class

[GitHub] [spark] cloud-fan commented on pull request #32716: [SPARK-35578][SQL][TEST] Add a test case for a bug in janino

cloud-fan commented on pull request #32716: URL: https://github.com/apache/spark/pull/32716#issuecomment-851554841 cc @maropu @kiszk @dongjoon-hyun -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [spark] cloud-fan opened a new pull request #32716: [SPARK-35578][SQL][TEST] Add a test case for a bug in janino

cloud-fan opened a new pull request #32716: URL: https://github.com/apache/spark/pull/32716 ### What changes were proposed in this pull request? This PR adds a unit test to show a bug in the latest janino version which fails to compile valid Java code. Unfortunately, I can't

[GitHub] [spark] AmplabJenkins commented on pull request #32712: [SPARK-35576][SQL] Redact the sensitive info in the result of Set command

AmplabJenkins commented on pull request #32712: URL: https://github.com/apache/spark/pull/32712#issuecomment-851549644 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139110/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #32712: [SPARK-35576][SQL] Redact the sensitive info in the result of Set command

SparkQA removed a comment on pull request #32712: URL: https://github.com/apache/spark/pull/32712#issuecomment-851406618 **[Test build #139110 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139110/testReport)** for PR 32712 at commit

[GitHub] [spark] SparkQA commented on pull request #32712: [SPARK-35576][SQL] Redact the sensitive info in the result of Set command

SparkQA commented on pull request #32712: URL: https://github.com/apache/spark/pull/32712#issuecomment-851548409 **[Test build #139110 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139110/testReport)** for PR 32712 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32714: [WIP][SQL] Support special datetime values in typed literals only

AmplabJenkins removed a comment on pull request #32714: URL: https://github.com/apache/spark/pull/32714#issuecomment-851539680 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139115/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32709: [SPARK-35573][R][TESTS] Make SparkR tests pass with R 4.1+

AmplabJenkins removed a comment on pull request #32709: URL: https://github.com/apache/spark/pull/32709#issuecomment-851539682 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32715: [SPARK-35577][TESTS] Allow to log container output for docker integration tests

AmplabJenkins removed a comment on pull request #32715: URL: https://github.com/apache/spark/pull/32715#issuecomment-851539683 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43634/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32558: [SPARK-34953][CORE][SQL] Add the code change for adding the DateType in the infer schema while reading in CSV and JSON

AmplabJenkins removed a comment on pull request #32558: URL: https://github.com/apache/spark/pull/32558#issuecomment-851539684 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43633/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32710: [SPARK-35574][BUILD] Add a compile arg to turn compilation warnings related to `procedure syntax` to compilation errors in Scal

AmplabJenkins removed a comment on pull request #32710: URL: https://github.com/apache/spark/pull/32710#issuecomment-851539678 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139112/

[GitHub] [spark] AmplabJenkins commented on pull request #32558: [SPARK-34953][CORE][SQL] Add the code change for adding the DateType in the infer schema while reading in CSV and JSON

AmplabJenkins commented on pull request #32558: URL: https://github.com/apache/spark/pull/32558#issuecomment-851539684 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43633/ --

[GitHub] [spark] AmplabJenkins commented on pull request #32715: [SPARK-35577][TESTS] Allow to log container output for docker integration tests

AmplabJenkins commented on pull request #32715: URL: https://github.com/apache/spark/pull/32715#issuecomment-851539683 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43634/ --

[GitHub] [spark] AmplabJenkins commented on pull request #32709: [SPARK-35573][R][TESTS] Make SparkR tests pass with R 4.1+

AmplabJenkins commented on pull request #32709: URL: https://github.com/apache/spark/pull/32709#issuecomment-851539686 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] AmplabJenkins commented on pull request #32710: [SPARK-35574][BUILD] Add a compile arg to turn compilation warnings related to `procedure syntax` to compilation errors in Scala 2.13

AmplabJenkins commented on pull request #32710: URL: https://github.com/apache/spark/pull/32710#issuecomment-851539678 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139112/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32714: [WIP][SQL] Support special datetime values in typed literals only

AmplabJenkins commented on pull request #32714: URL: https://github.com/apache/spark/pull/32714#issuecomment-851539680 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139115/ -- This

[GitHub] [spark] SparkQA commented on pull request #32700: [SPARK-35558] Optimizes for multi-quantile retrieval

SparkQA commented on pull request #32700: URL: https://github.com/apache/spark/pull/32700#issuecomment-851539136 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43638/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #32709: [SPARK-35573][R][TESTS] Make SparkR tests pass with R 4.1+

SparkQA commented on pull request #32709: URL: https://github.com/apache/spark/pull/32709#issuecomment-851538106 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43637/ --

[GitHub] [spark] ivoson commented on pull request #32713: [SPARK-35411][SQL][FOLLOWUP] Handle Currying Product while serializing TreeNode to JSON

ivoson commented on pull request #32713: URL: https://github.com/apache/spark/pull/32713#issuecomment-851538084 Thanks for reviewing. @cloud-fan -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [spark] gengliangwang commented on a change in pull request #32686: [SPARK-35544][SQL] Add tree pattern pruning to Analyzer rules

gengliangwang commented on a change in pull request #32686: URL: https://github.com/apache/spark/pull/32686#discussion_r642492873 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala ## @@ -423,7 +424,9 @@ class Analyzer(override val

[GitHub] [spark] hvanhovell commented on pull request #32686: [SPARK-35544][SQL] Add tree pattern pruning to Analyzer rules

hvanhovell commented on pull request #32686: URL: https://github.com/apache/spark/pull/32686#issuecomment-851535158 One small ergonomic comment. I would be great if we can create some shorthand for the function closures. I would probably make the in individual value be matcher for itself

[GitHub] [spark] SparkQA removed a comment on pull request #32710: [SPARK-35574][BUILD] Add a compile arg to turn compilation warnings related to `procedure syntax` to compilation errors in Scala 2.13

SparkQA removed a comment on pull request #32710: URL: https://github.com/apache/spark/pull/32710#issuecomment-851436763 **[Test build #139112 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139112/testReport)** for PR 32710 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #32709: [SPARK-35573][R][TESTS] Make SparkR tests pass with R 4.1+

SparkQA removed a comment on pull request #32709: URL: https://github.com/apache/spark/pull/32709#issuecomment-851510697 **[Test build #139117 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139117/testReport)** for PR 32709 at commit

[GitHub] [spark] SparkQA commented on pull request #32710: [SPARK-35574][BUILD] Add a compile arg to turn compilation warnings related to `procedure syntax` to compilation errors in Scala 2.13

SparkQA commented on pull request #32710: URL: https://github.com/apache/spark/pull/32710#issuecomment-851531226 **[Test build #139112 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139112/testReport)** for PR 32710 at commit

[GitHub] [spark] SparkQA commented on pull request #32709: [SPARK-35573][R][TESTS] Make SparkR tests pass with R 4.1+

SparkQA commented on pull request #32709: URL: https://github.com/apache/spark/pull/32709#issuecomment-851530788 **[Test build #139117 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139117/testReport)** for PR 32709 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #32714: [WIP][SQL] Support special datetime values in typed literals only

SparkQA removed a comment on pull request #32714: URL: https://github.com/apache/spark/pull/32714#issuecomment-851470598 **[Test build #139115 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139115/testReport)** for PR 32714 at commit

[GitHub] [spark] SparkQA commented on pull request #32714: [WIP][SQL] Support special datetime values in typed literals only

SparkQA commented on pull request #32714: URL: https://github.com/apache/spark/pull/32714#issuecomment-851529568 **[Test build #139115 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139115/testReport)** for PR 32714 at commit

[GitHub] [spark] SparkQA commented on pull request #32715: [SPARK-35577][TESTS] Allow to log container output for docker integration tests

SparkQA commented on pull request #32715: URL: https://github.com/apache/spark/pull/32715#issuecomment-851525327 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43634/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #32558: [SPARK-34953][CORE][SQL] Add the code change for adding the DateType in the infer schema while reading in CSV and JSON

SparkQA commented on pull request #32558: URL: https://github.com/apache/spark/pull/32558#issuecomment-851520747 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43633/ -- This is an automated message from the

[GitHub] [spark] cloud-fan commented on pull request #32713: [SPARK-35411][SQL][FOLLOWUP] Handle Currying Product while serializing TreeNode to JSON

cloud-fan commented on pull request #32713: URL: https://github.com/apache/spark/pull/32713#issuecomment-851520194 thanks, merging to master/3.1! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [spark] cloud-fan closed pull request #32713: [SPARK-35411][SQL][FOLLOWUP] Handle Currying Product while serializing TreeNode to JSON

cloud-fan closed pull request #32713: URL: https://github.com/apache/spark/pull/32713 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [spark] SparkQA commented on pull request #32709: [SPARK-35573][R][TESTS] Make SparkR tests pass with R 4.1+

SparkQA commented on pull request #32709: URL: https://github.com/apache/spark/pull/32709#issuecomment-851519230 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43636/ -- This is an automated message from the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32714: [WIP][SQL] Support special datetime values in typed literals only

AmplabJenkins removed a comment on pull request #32714: URL: https://github.com/apache/spark/pull/32714#issuecomment-851515799 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43635/

[GitHub] [spark] AmplabJenkins commented on pull request #32714: [WIP][SQL] Support special datetime values in typed literals only

AmplabJenkins commented on pull request #32714: URL: https://github.com/apache/spark/pull/32714#issuecomment-851515799 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43635/ --

[GitHub] [spark] SparkQA commented on pull request #32714: [WIP][SQL] Support special datetime values in typed literals only

SparkQA commented on pull request #32714: URL: https://github.com/apache/spark/pull/32714#issuecomment-851515776 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43635/ -- This is an automated message from the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32686: [SPARK-35544][SQL] Add tree pattern pruning to Analyzer rules

AmplabJenkins removed a comment on pull request #32686: URL: https://github.com/apache/spark/pull/32686#issuecomment-851513473 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139104/

[GitHub] [spark] AmplabJenkins commented on pull request #32686: [SPARK-35544][SQL] Add tree pattern pruning to Analyzer rules

AmplabJenkins commented on pull request #32686: URL: https://github.com/apache/spark/pull/32686#issuecomment-851513473 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139104/ -- This

[GitHub] [spark] SparkQA commented on pull request #32700: [SPARK-35558] Optimizes for multi-quantile retrieval

SparkQA commented on pull request #32700: URL: https://github.com/apache/spark/pull/32700#issuecomment-851513136 **[Test build #139118 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139118/testReport)** for PR 32700 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #32686: [SPARK-35544][SQL] Add tree pattern pruning to Analyzer rules

SparkQA removed a comment on pull request #32686: URL: https://github.com/apache/spark/pull/32686#issuecomment-851332277 **[Test build #139104 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139104/testReport)** for PR 32686 at commit

[GitHub] [spark] SparkQA commented on pull request #32686: [SPARK-35544][SQL] Add tree pattern pruning to Analyzer rules

SparkQA commented on pull request #32686: URL: https://github.com/apache/spark/pull/32686#issuecomment-851511825 **[Test build #139104 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139104/testReport)** for PR 32686 at commit

[GitHub] [spark] srowen commented on pull request #32700: [SPARK-35558] Optimizes for multi-quantile retrieval

srowen commented on pull request #32700: URL: https://github.com/apache/spark/pull/32700#issuecomment-851511091 Jenkins retest this please -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] SparkQA commented on pull request #32709: [SPARK-35573][R][TESTS] Make SparkR tests pass with R 4.1+

SparkQA commented on pull request #32709: URL: https://github.com/apache/spark/pull/32709#issuecomment-851510697 **[Test build #139117 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139117/testReport)** for PR 32709 at commit

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32709: [SPARK-35573][R][TESTS] Make SparkR tests pass with R 4.1+

HyukjinKwon commented on a change in pull request #32709: URL: https://github.com/apache/spark/pull/32709#discussion_r642510089 ## File path: R/pkg/tests/fulltests/test_utils.R ## @@ -64,7 +64,12 @@ test_that("cleanClosure on R functions", { actual <- get("y", envir = env,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32704: [SPARK-35567][SQL] Fix: Explain cost is not showing statistics for all the nodes

AmplabJenkins removed a comment on pull request #32704: URL: https://github.com/apache/spark/pull/32704#issuecomment-851507041 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139107/

[GitHub] [spark] AmplabJenkins commented on pull request #32704: [SPARK-35567][SQL] Fix: Explain cost is not showing statistics for all the nodes

AmplabJenkins commented on pull request #32704: URL: https://github.com/apache/spark/pull/32704#issuecomment-851507041 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139107/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #32704: [SPARK-35567][SQL] Fix: Explain cost is not showing statistics for all the nodes

SparkQA removed a comment on pull request #32704: URL: https://github.com/apache/spark/pull/32704#issuecomment-851371944 **[Test build #139107 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139107/testReport)** for PR 32704 at commit

[GitHub] [spark] SparkQA commented on pull request #32704: [SPARK-35567][SQL] Fix: Explain cost is not showing statistics for all the nodes

SparkQA commented on pull request #32704: URL: https://github.com/apache/spark/pull/32704#issuecomment-851505443 **[Test build #139107 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139107/testReport)** for PR 32704 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32710: [SPARK-35574][BUILD] Add a compile arg to turn compilation warnings related to `procedure syntax` to compilation errors in Scal

AmplabJenkins removed a comment on pull request #32710: URL: https://github.com/apache/spark/pull/32710#issuecomment-851504871 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32709: [SPARK-35573][R][TESTS] Make SparkR tests pass with R 4.1+

AmplabJenkins removed a comment on pull request #32709: URL: https://github.com/apache/spark/pull/32709#issuecomment-851504875 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139116/

[GitHub] [spark] SparkQA commented on pull request #32715: [SPARK-35577][TESTS] Allow to log container output for docker integration tests

SparkQA commented on pull request #32715: URL: https://github.com/apache/spark/pull/32715#issuecomment-851505013 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43634/ -- This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins commented on pull request #32710: [SPARK-35574][BUILD] Add a compile arg to turn compilation warnings related to `procedure syntax` to compilation errors in Scala 2.13

AmplabJenkins commented on pull request #32710: URL: https://github.com/apache/spark/pull/32710#issuecomment-851504871 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] AmplabJenkins commented on pull request #32709: [SPARK-35573][R][TESTS] Make SparkR tests pass with R 4.1+

AmplabJenkins commented on pull request #32709: URL: https://github.com/apache/spark/pull/32709#issuecomment-851504875 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139116/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #32710: [SPARK-35574][BUILD] Add a compile arg to turn compilation warnings related to `procedure syntax` to compilation errors in Scala 2.13

SparkQA removed a comment on pull request #32710: URL: https://github.com/apache/spark/pull/32710#issuecomment-851404624 **[Test build #139109 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139109/testReport)** for PR 32710 at commit

[GitHub] [spark] SparkQA commented on pull request #32710: [SPARK-35574][BUILD] Add a compile arg to turn compilation warnings related to `procedure syntax` to compilation errors in Scala 2.13

SparkQA commented on pull request #32710: URL: https://github.com/apache/spark/pull/32710#issuecomment-851499524 **[Test build #139109 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139109/testReport)** for PR 32710 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #32709: [SPARK-35573][R][TESTS] Make SparkR tests pass with R 4.1+

SparkQA removed a comment on pull request #32709: URL: https://github.com/apache/spark/pull/32709#issuecomment-851470652 **[Test build #139116 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139116/testReport)** for PR 32709 at commit

[GitHub] [spark] SparkQA commented on pull request #32709: [SPARK-35573][R][TESTS] Make SparkR tests pass with R 4.1+

SparkQA commented on pull request #32709: URL: https://github.com/apache/spark/pull/32709#issuecomment-851498562 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43636/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #32709: [SPARK-35573][R][TESTS] Make SparkR tests pass with R 4.1+

SparkQA commented on pull request #32709: URL: https://github.com/apache/spark/pull/32709#issuecomment-851498302 **[Test build #139116 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139116/testReport)** for PR 32709 at commit

[GitHub] [spark] SparkQA commented on pull request #32714: [WIP][SQL] Support special datetime values in typed literals only

SparkQA commented on pull request #32714: URL: https://github.com/apache/spark/pull/32714#issuecomment-851497310 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43635/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #32710: [SPARK-35574][BUILD] Add a compile arg to turn compilation warnings related to `procedure syntax` to compilation errors in Scala 2.13

SparkQA commented on pull request #32710: URL: https://github.com/apache/spark/pull/32710#issuecomment-851489533 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43632/ -- This is an automated message from the

[GitHub] [spark] SaurabhChawla100 edited a comment on pull request #32558: [SPARK-34953][CORE][SQL] Add the code change for adding the DateType in the infer schema while reading in CSV and JSON

SaurabhChawla100 edited a comment on pull request #32558: URL: https://github.com/apache/spark/pull/32558#issuecomment-851428101 > I think we should also add the parameter at `csv` and `json` at `DataFrameWriter`, `DataFrameReader`, `DataStreamReader`, `DataStreamWriter` (and also

[GitHub] [spark] SparkQA removed a comment on pull request #32715: [SPARK-35577][TESTS] Allow to log container output for docker integration tests

SparkQA removed a comment on pull request #32715: URL: https://github.com/apache/spark/pull/32715#issuecomment-851470481 **[Test build #139114 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139114/testReport)** for PR 32715 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32715: [SPARK-35577][TESTS] Allow to log container output for docker integration tests

AmplabJenkins removed a comment on pull request #32715: URL: https://github.com/apache/spark/pull/32715#issuecomment-851480489 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139114/

[GitHub] [spark] AmplabJenkins commented on pull request #32715: [SPARK-35577][TESTS] Allow to log container output for docker integration tests

AmplabJenkins commented on pull request #32715: URL: https://github.com/apache/spark/pull/32715#issuecomment-851480489 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139114/ -- This

[GitHub] [spark] SparkQA commented on pull request #32715: [SPARK-35577][TESTS] Allow to log container output for docker integration tests

SparkQA commented on pull request #32715: URL: https://github.com/apache/spark/pull/32715#issuecomment-851480239 **[Test build #139114 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139114/testReport)** for PR 32715 at commit

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32709: [SPARK-35573][R][TESTS] Make SparkR tests pass with R 4.1+

HyukjinKwon commented on a change in pull request #32709: URL: https://github.com/apache/spark/pull/32709#discussion_r642464454 ## File path: R/pkg/tests/fulltests/test_sparkSQL_arrow.R ## @@ -68,7 +68,7 @@ test_that("createDataFrame/collect Arrow optimization - type

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32709: [SPARK-35573][R][TESTS] Make SparkR tests pass with R 4.1+

HyukjinKwon commented on a change in pull request #32709: URL: https://github.com/apache/spark/pull/32709#discussion_r642465330 ## File path: R/pkg/tests/fulltests/test_sparkSQL_arrow.R ## @@ -68,7 +68,7 @@ test_that("createDataFrame/collect Arrow optimization - type

[GitHub] [spark] SparkQA commented on pull request #32714: [WIP][SQL] Support special datetime values in typed literals only

SparkQA commented on pull request #32714: URL: https://github.com/apache/spark/pull/32714#issuecomment-851470598 **[Test build #139115 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139115/testReport)** for PR 32714 at commit

[GitHub] [spark] SparkQA commented on pull request #32709: [SPARK-35573][R][TESTS] Make SparkR tests pass with R 4.1+

SparkQA commented on pull request #32709: URL: https://github.com/apache/spark/pull/32709#issuecomment-851470652 **[Test build #139116 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139116/testReport)** for PR 32709 at commit

[GitHub] [spark] SparkQA commented on pull request #32715: [SPARK-35577][TESTS] Allow to log container output for docker integration tests

SparkQA commented on pull request #32715: URL: https://github.com/apache/spark/pull/32715#issuecomment-851470481 **[Test build #139114 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139114/testReport)** for PR 32715 at commit

[GitHub] [spark] HyukjinKwon commented on pull request #32709: [SPARK-35573][R][TESTS] Make SparkR tests pass with R 4.1+

HyukjinKwon commented on pull request #32709: URL: https://github.com/apache/spark/pull/32709#issuecomment-851470529 cc @shivaram, @felixcheung @falaki FYI -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32709: [SPARK-35573][R][TESTS] Make SparkR tests pass with R 4.1+

HyukjinKwon commented on a change in pull request #32709: URL: https://github.com/apache/spark/pull/32709#discussion_r642465330 ## File path: R/pkg/tests/fulltests/test_sparkSQL_arrow.R ## @@ -68,7 +68,7 @@ test_that("createDataFrame/collect Arrow optimization - type

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32712: [SPARK-35576][SQL] Redact the sensitive info in the result of Set command

AmplabJenkins removed a comment on pull request #32712: URL: https://github.com/apache/spark/pull/32712#issuecomment-851468883 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins commented on pull request #32712: [SPARK-35576][SQL] Redact the sensitive info in the result of Set command

AmplabJenkins commented on pull request #32712: URL: https://github.com/apache/spark/pull/32712#issuecomment-85146 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32709: [SPARK-35573][R][TESTS] Make SparkR tests pass with R 4.1+

HyukjinKwon commented on a change in pull request #32709: URL: https://github.com/apache/spark/pull/32709#discussion_r642464454 ## File path: R/pkg/tests/fulltests/test_sparkSQL_arrow.R ## @@ -68,7 +68,7 @@ test_that("createDataFrame/collect Arrow optimization - type

[GitHub] [spark] SparkQA commented on pull request #32710: [SPARK-35574][BUILD] Add a compile arg to turn compilation warnings related to `procedure syntax` to compilation errors in Scala 2.13

SparkQA commented on pull request #32710: URL: https://github.com/apache/spark/pull/32710#issuecomment-851466948 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43632/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #32558: [SPARK-34953][CORE][SQL] Add the code change for adding the DateType in the infer schema while reading in CSV and JSON

SparkQA commented on pull request #32558: URL: https://github.com/apache/spark/pull/32558#issuecomment-851466586 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43633/ -- This is an automated message from the Apache

[GitHub] [spark] LuciferYang commented on a change in pull request #32693: [SPARK-35556][SQL][TESTS] Avoid log NoSuchMethodError when HiveClientImpl.state close

LuciferYang commented on a change in pull request #32693: URL: https://github.com/apache/spark/pull/32693#discussion_r642460654 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveClientImpl.scala ## @@ -165,9 +165,15 @@ private[hive] class

[GitHub] [spark] SparkQA commented on pull request #32712: [SPARK-35576][SQL] Redact the sensitive info in the result of Set command

SparkQA commented on pull request #32712: URL: https://github.com/apache/spark/pull/32712#issuecomment-851463595 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43631/ -- This is an automated message from the

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32709: [SPARK-35573][R][TESTS] Make SparkR tests pass with R 4.1+

HyukjinKwon commented on a change in pull request #32709: URL: https://github.com/apache/spark/pull/32709#discussion_r642458108 ## File path: R/pkg/tests/fulltests/test_sparkSQL.R ## @@ -1451,7 +1451,7 @@ test_that("column functions", { expect_equal(collect(df2)[[3, 2]],

[GitHub] [spark] yaooqinn commented on a change in pull request #32693: [SPARK-35556][SQL][TESTS] Avoid log NoSuchMethodError when HiveClientImpl.state close

yaooqinn commented on a change in pull request #32693: URL: https://github.com/apache/spark/pull/32693#discussion_r642445742 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveClientImpl.scala ## @@ -165,9 +165,15 @@ private[hive] class HiveClientImpl(

[GitHub] [spark] SparkQA commented on pull request #32712: [SPARK-35576][SQL] Redact the sensitive info in the result of Set command

SparkQA commented on pull request #32712: URL: https://github.com/apache/spark/pull/32712#issuecomment-851451953 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43630/ -- This is an automated message from the

[GitHub] [spark] sarutak opened a new pull request #32715: [SPARK-35577][TESTS] Allow to log container output for docker integration tests

sarutak opened a new pull request #32715: URL: https://github.com/apache/spark/pull/32715 ### What changes were proposed in this pull request? This PR proposes to add a feature that logs container output for docker integration tests. With this change, if we run test with SBT, we

[GitHub] [spark] LuciferYang commented on a change in pull request #32693: [SPARK-35556][SQL][TESTS] Avoid log NoSuchMethodError when HiveClientImpl.state close

LuciferYang commented on a change in pull request #32693: URL: https://github.com/apache/spark/pull/32693#discussion_r642442840 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveClientImpl.scala ## @@ -165,9 +165,15 @@ private[hive] class

[GitHub] [spark] MaxGekk opened a new pull request #32714: [WIP][SQL] Support special datetime values in typed literals only

MaxGekk opened a new pull request #32714: URL: https://github.com/apache/spark/pull/32714 ### What changes were proposed in this pull request? ### Why are the changes needed? ### Does this PR introduce _any_ user-facing change? ### How

[GitHub] [spark] SparkQA commented on pull request #32712: [SPARK-35576][SQL] Redact the sensitive info in the result of Set command

SparkQA commented on pull request #32712: URL: https://github.com/apache/spark/pull/32712#issuecomment-85158 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43631/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #32558: [SPARK-34953][CORE][SQL] Add the code change for adding the DateType in the infer schema while reading in CSV and JSON

SparkQA commented on pull request #32558: URL: https://github.com/apache/spark/pull/32558#issuecomment-851436903 **[Test build #139113 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139113/testReport)** for PR 32558 at commit

[GitHub] [spark] SparkQA commented on pull request #32710: [SPARK-35574][BUILD] Add a compile arg to turn compilation warnings related to `procedure syntax` to errors in Scala 2.13

SparkQA commented on pull request #32710: URL: https://github.com/apache/spark/pull/32710#issuecomment-851436763 **[Test build #139112 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139112/testReport)** for PR 32710 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #32713: [SPARK-35411][SQL][FOLLOWUP] Handle Currying Product while serializing TreeNode to JSON

AmplabJenkins commented on pull request #32713: URL: https://github.com/apache/spark/pull/32713#issuecomment-851436300 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32709: [WIP][SPARK-35573][R] Support R 4.1.0 in SparkR

AmplabJenkins removed a comment on pull request #32709: URL: https://github.com/apache/spark/pull/32709#issuecomment-851435599 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43628/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32704: [SPARK-35567][SQL] Fix: Explain cost is not showing statistics for all the nodes

AmplabJenkins removed a comment on pull request #32704: URL: https://github.com/apache/spark/pull/32704#issuecomment-851435601 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43623/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32710: [SPARK-35574][BUILD] Add a compile arg to turn compilation warnings related to `procedure syntax` to errors in Scala 2.13

AmplabJenkins removed a comment on pull request #32710: URL: https://github.com/apache/spark/pull/32710#issuecomment-851435600 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43629/

[GitHub] [spark] AmplabJenkins commented on pull request #32710: [SPARK-35574][BUILD] Add a compile arg to turn compilation warnings related to `procedure syntax` to errors in Scala 2.13

AmplabJenkins commented on pull request #32710: URL: https://github.com/apache/spark/pull/32710#issuecomment-851435600 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43629/ --

[GitHub] [spark] AmplabJenkins commented on pull request #32704: [SPARK-35567][SQL] Fix: Explain cost is not showing statistics for all the nodes

AmplabJenkins commented on pull request #32704: URL: https://github.com/apache/spark/pull/32704#issuecomment-851435601 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43623/ --

[GitHub] [spark] AmplabJenkins commented on pull request #32709: [WIP][SPARK-35573][R] Support R 4.1.0 in SparkR

AmplabJenkins commented on pull request #32709: URL: https://github.com/apache/spark/pull/32709#issuecomment-851435599 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43628/ --

[GitHub] [spark] lxian commented on pull request #31998: [SPARK-34859][SQL] parquet vectorized reader - support column index with rowIndexes

lxian commented on pull request #31998: URL: https://github.com/apache/spark/pull/31998#issuecomment-851435041 @sunchao you are right. it's real tricky and would require a long of changes as well. VectorizedValuesReader currently read and put all values to columns vector for a single data

<    1   2   3   4   5   >