[GitHub] [spark] SaurabhChawla100 edited a comment on pull request #32558: [SPARK-34953][CORE][SQL] Add the code change for adding the DateType in the infer schema while reading in CSV and JSON

SaurabhChawla100 edited a comment on pull request #32558: URL: https://github.com/apache/spark/pull/32558#issuecomment-851428101 > I think we should also add the parameter at `csv` and `json` at `DataFrameWriter`, `DataFrameReader`, `DataStreamReader`, `DataStreamWriter` (and also

[GitHub] [spark] SparkQA commented on pull request #32712: [SPARK-35576][SQL] Redact the sensitive info in the result of Set command

SparkQA commented on pull request #32712: URL: https://github.com/apache/spark/pull/32712#issuecomment-851433273 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43630/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #32710: [SPARK-35574][BUILD] Add a compile arg to turn compilation warnings related to `procedure syntax` to errors in Scala 2.13

SparkQA commented on pull request #32710: URL: https://github.com/apache/spark/pull/32710#issuecomment-851431819 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43629/ --

[GitHub] [spark] SaurabhChawla100 commented on pull request #32558: [SPARK-34953][CORE][SQL] Add the code change for adding the DateType in the infer schema while reading in CSV and JSON

SaurabhChawla100 commented on pull request #32558: URL: https://github.com/apache/spark/pull/32558#issuecomment-851428101 > I think we should also add the parameter at `csv` and `json` at `DataFrameWriter`, `DataFrameReader`, `DataStreamReader`, `DataStreamWriter` (and also

[GitHub] [spark] SparkQA commented on pull request #32704: [SPARK-35567][SQL] Fix: Explain cost is not showing statistics for all the nodes

SparkQA commented on pull request #32704: URL: https://github.com/apache/spark/pull/32704#issuecomment-851428027 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43623/ -- This is an automated message from the

[GitHub] [spark] SaurabhChawla100 commented on a change in pull request #32558: [SPARK-34953][CORE][SQL] Add the code change for adding the DateType in the infer schema while reading in CSV and JSON

SaurabhChawla100 commented on a change in pull request #32558: URL: https://github.com/apache/spark/pull/32558#discussion_r642419455 ## File path: docs/sql-data-sources-json.md ## @@ -155,6 +155,12 @@ Data source options of JSON can be set via: Allows leading zeros in

[GitHub] [spark] SparkQA commented on pull request #32709: [WIP][SPARK-35573][R] Support R 4.1.0 in SparkR

SparkQA commented on pull request #32709: URL: https://github.com/apache/spark/pull/32709#issuecomment-851424007 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43628/ -- This is an automated message from the

[GitHub] [spark] ivoson edited a comment on pull request #32713: [SPARK-35411][SQL][FOLLOWUP] Handle Currying Product while serializing TreeNode to JSON

ivoson edited a comment on pull request #32713: URL: https://github.com/apache/spark/pull/32713#issuecomment-851419481 Hit a [failed UT](https://github.com/apache/spark/blob/branch-2.4/sql/core/src/test/scala/org/apache/spark/sql/execution/columnar/InMemoryColumnarQuerySuite.scala#L491)

[GitHub] [spark] LuciferYang edited a comment on pull request #32710: [SPARK-35574][BUILD] Add a compile arg to turn compilation warnings related to `procedure syntax` to errors in Scala 2.13

LuciferYang edited a comment on pull request #32710: URL: https://github.com/apache/spark/pull/32710#issuecomment-851419173 cc @dongjoon-hyun `org.scalastyle.scalariform.ProcedureDeclarationChecker ` only check `procedure syntax is deprecated`, not check `procedure syntax is

[GitHub] [spark] ivoson edited a comment on pull request #32713: [SPARK-35411][SQL][FOLLOWUP] Handle Currying Product while serializing TreeNode to JSON

ivoson edited a comment on pull request #32713: URL: https://github.com/apache/spark/pull/32713#issuecomment-851419481 Hit a [failed UT](https://github.com/apache/spark/blob/branch-2.4/sql/core/src/test/scala/org/apache/spark/sql/execution/columnar/InMemoryColumnarQuerySuite.scala#L491)

[GitHub] [spark] ivoson commented on pull request #32713: [SPARK-35411][SQL][FOLLOWUP] Handle Currying Product while serializing TreeNode to JSON

ivoson commented on pull request #32713: URL: https://github.com/apache/spark/pull/32713#issuecomment-851419481 Hit a [failed UT](https://github.com/apache/spark/blob/branch-2.4/sql/core/src/test/scala/org/apache/spark/sql/execution/columnar/InMemoryColumnarQuerySuite.scala#L491) which

[GitHub] [spark] LuciferYang commented on pull request #32710: [SPARK-35574][BUILD] Add a compile arg to turn compilation warnings related to `procedure syntax` to errors in Scala 2.13

LuciferYang commented on pull request #32710: URL: https://github.com/apache/spark/pull/32710#issuecomment-851419173 cc @dongjoon-hyun -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] ivoson opened a new pull request #32713: [SPARK-35411][SQL][FOLLOWUP] Handle Currying Product while serializing TreeNode to JSON

ivoson opened a new pull request #32713: URL: https://github.com/apache/spark/pull/32713 ### What changes were proposed in this pull request? Handle Currying Product while serializing TreeNode to JSON. While processing

[GitHub] [spark] SparkQA commented on pull request #32712: [SPARK-35576][SQL] Redact the sensitive info in the result of Set command

SparkQA commented on pull request #32712: URL: https://github.com/apache/spark/pull/32712#issuecomment-851413527 **[Test build #139111 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139111/testReport)** for PR 32712 at commit

[GitHub] [spark] gengliangwang edited a comment on pull request #32712: [SPARK-35576][SQL] Redact the sensitive info in the result of Set command

gengliangwang edited a comment on pull request #32712: URL: https://github.com/apache/spark/pull/32712#issuecomment-851406539 I will have another PR for `set -v` command, which has a different code path and we need to keep the `` results instead of redacting them. -- This is an

[GitHub] [spark] SparkQA commented on pull request #32712: [SPARK-35576][SQL] Redact the sensitive info in the result of Set command

SparkQA commented on pull request #32712: URL: https://github.com/apache/spark/pull/32712#issuecomment-851406618 **[Test build #139110 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139110/testReport)** for PR 32712 at commit

[GitHub] [spark] gengliangwang commented on pull request #32712: [SPARK-35576][SQL] Redact the sensitive info in the result of Set command

gengliangwang commented on pull request #32712: URL: https://github.com/apache/spark/pull/32712#issuecomment-851406539 I will have another PR for `set -v` command, which has a different code path and we need to keep the `` results instead of redacting it. -- This is an automated message

[GitHub] [spark] SparkQA commented on pull request #32709: [WIP][SPARK-35573][R] Support R 4.1.0 in SparkR

SparkQA commented on pull request #32709: URL: https://github.com/apache/spark/pull/32709#issuecomment-851405815 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43628/ -- This is an automated message from the Apache

[GitHub] [spark] gengliangwang opened a new pull request #32712: [SPARK-35576][SQL] Redact the sensitive info in the result of Set command

gengliangwang opened a new pull request #32712: URL: https://github.com/apache/spark/pull/32712 ### What changes were proposed in this pull request? Currently, the results of following SQL queries are not redacted: ``` SET [KEY]; SET; ``` For example:

[GitHub] [spark] SparkQA commented on pull request #32710: [SPARK-35574][BUILD] Add a compile arg to turn compilation warnings related to `procedure syntax` to errors in Scala 2.13

SparkQA commented on pull request #32710: URL: https://github.com/apache/spark/pull/32710#issuecomment-851404624 **[Test build #139109 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139109/testReport)** for PR 32710 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32704: [SPARK-35567][SQL] Fix: Explain cost is not showing statistics for all the nodes

AmplabJenkins removed a comment on pull request #32704: URL: https://github.com/apache/spark/pull/32704#issuecomment-851403230 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43627/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32513: [SPARK-35378][SQL] Eagerly execute non-root Command

AmplabJenkins removed a comment on pull request #32513: URL: https://github.com/apache/spark/pull/32513#issuecomment-851403239 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32709: [WIP][SPARK-35573][R] Support R 4.1.0 in SparkR

AmplabJenkins removed a comment on pull request #32709: URL: https://github.com/apache/spark/pull/32709#issuecomment-851403231 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32686: [SPARK-35544][SQL] Add tree pattern pruning to Analyzer rules

AmplabJenkins removed a comment on pull request #32686: URL: https://github.com/apache/spark/pull/32686#issuecomment-851403236 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43624/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32708: [WIP] [SPARK-35572] [K8S] add hostNetwork feature to executor

AmplabJenkins removed a comment on pull request #32708: URL: https://github.com/apache/spark/pull/32708#issuecomment-851369747 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins commented on pull request #32708: [WIP] [SPARK-35572] [K8S] add hostNetwork feature to executor

AmplabJenkins commented on pull request #32708: URL: https://github.com/apache/spark/pull/32708#issuecomment-851403235 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43626/ --

[GitHub] [spark] AmplabJenkins commented on pull request #32709: [WIP][SPARK-35573][R] Support R 4.1.0 in SparkR

AmplabJenkins commented on pull request #32709: URL: https://github.com/apache/spark/pull/32709#issuecomment-851403231 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] AmplabJenkins commented on pull request #32686: [SPARK-35544][SQL] Add tree pattern pruning to Analyzer rules

AmplabJenkins commented on pull request #32686: URL: https://github.com/apache/spark/pull/32686#issuecomment-851403236 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43624/ --

[GitHub] [spark] AmplabJenkins commented on pull request #32704: [SPARK-35567][SQL] Fix: Explain cost is not showing statistics for all the nodes

AmplabJenkins commented on pull request #32704: URL: https://github.com/apache/spark/pull/32704#issuecomment-851403230 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43627/ --

[GitHub] [spark] AmplabJenkins commented on pull request #32513: [SPARK-35378][SQL] Eagerly execute non-root Command

AmplabJenkins commented on pull request #32513: URL: https://github.com/apache/spark/pull/32513#issuecomment-851403240 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] SparkQA removed a comment on pull request #32709: [WIP][SPARK-35573][R] Support R 4.1.0 in SparkR

SparkQA removed a comment on pull request #32709: URL: https://github.com/apache/spark/pull/32709#issuecomment-851287479 **[Test build #139099 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139099/testReport)** for PR 32709 at commit

[GitHub] [spark] SparkQA commented on pull request #32709: [WIP][SPARK-35573][R] Support R 4.1.0 in SparkR

SparkQA commented on pull request #32709: URL: https://github.com/apache/spark/pull/32709#issuecomment-851401145 **[Test build #139099 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139099/testReport)** for PR 32709 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #32513: [SPARK-35378][SQL] Eagerly execute non-root Command

SparkQA removed a comment on pull request #32513: URL: https://github.com/apache/spark/pull/32513#issuecomment-851332318 **[Test build #139105 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139105/testReport)** for PR 32513 at commit

[GitHub] [spark] SparkQA commented on pull request #32513: [SPARK-35378][SQL] Eagerly execute non-root Command

SparkQA commented on pull request #32513: URL: https://github.com/apache/spark/pull/32513#issuecomment-851399050 **[Test build #139105 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139105/testReport)** for PR 32513 at commit

[GitHub] [spark] SparkQA commented on pull request #32513: [SPARK-35378][SQL] Eagerly execute non-root Command

SparkQA commented on pull request #32513: URL: https://github.com/apache/spark/pull/32513#issuecomment-851397050 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43625/ -- This is an automated message from the

[GitHub] [spark] HyukjinKwon commented on pull request #32711: [SPARK-35575][INFRA] Recover updating build status in GitHub Actions

HyukjinKwon commented on pull request #32711: URL: https://github.com/apache/spark/pull/32711#issuecomment-851396741 Seems working fine  : https://github.com/apache/spark/runs/2709914867?check_suite_focus=true -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] SparkQA commented on pull request #32704: [SPARK-35567][SQL] Fix: Explain cost is not showing statistics for all the nodes

SparkQA commented on pull request #32704: URL: https://github.com/apache/spark/pull/32704#issuecomment-851395499 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43627/ --

[GitHub] [spark] HyukjinKwon closed pull request #32711: [SPARK-35575][INFRA] Recover updating build status in GitHub Actions

HyukjinKwon closed pull request #32711: URL: https://github.com/apache/spark/pull/32711 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [spark] HyukjinKwon commented on pull request #32711: [SPARK-35575][INFRA] Recover updating build status in GitHub Actions

HyukjinKwon commented on pull request #32711: URL: https://github.com/apache/spark/pull/32711#issuecomment-851393656 Merged to master. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] HyukjinKwon commented on pull request #32711: [SPARK-35575][INFRA] Recover updating build status in GitHub Actions

HyukjinKwon commented on pull request #32711: URL: https://github.com/apache/spark/pull/32711#issuecomment-851393495 Thanks @gengliangwang. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] HyukjinKwon commented on pull request #32711: [SPARK-35575][INFRA] Recover updating build status in GitHub Actions

HyukjinKwon commented on pull request #32711: URL: https://github.com/apache/spark/pull/32711#issuecomment-851392510 The status update is already broken, and this PR doesn't affect anything in the actual build. I would just merge this in. Can you take a quick look please

[GitHub] [spark] HyukjinKwon opened a new pull request #32711: [SPARK-35575][INFRA] Recover updating build status in GitHub Actions

HyukjinKwon opened a new pull request #32711: URL: https://github.com/apache/spark/pull/32711 ### What changes were proposed in this pull request? This PR fixes the logic to be fault tolerant when it gets the status of the workflow run from PR author's forked repository.

[GitHub] [spark] SparkQA commented on pull request #32708: [WIP] [SPARK-35572] [K8S] add hostNetwork feature to executor

SparkQA commented on pull request #32708: URL: https://github.com/apache/spark/pull/32708#issuecomment-851390740 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43626/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #32686: [SPARK-35544][SQL] Add tree pattern pruning to Analyzer rules

SparkQA commented on pull request #32686: URL: https://github.com/apache/spark/pull/32686#issuecomment-851387890 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43624/ -- This is an automated message from the

[GitHub] [spark] wangyum commented on pull request #31908: [SPARK-34808][SQL] Removes outer join if it only has DISTINCT on streamed side

wangyum commented on pull request #31908: URL: https://github.com/apache/spark/pull/31908#issuecomment-851385826 Merged to master. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] wangyum closed pull request #31908: [SPARK-34808][SQL] Removes outer join if it only has DISTINCT on streamed side

wangyum closed pull request #31908: URL: https://github.com/apache/spark/pull/31908 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [spark] LuciferYang commented on a change in pull request #32710: [SPARK-35574][BUILD] Add a compile arg to turn compilation warnings related to `procedure syntax` to errors in Scala 2.13

LuciferYang commented on a change in pull request #32710: URL: https://github.com/apache/spark/pull/32710#discussion_r642378237 ## File path: core/src/main/scala/org/apache/spark/HeartbeatReceiver.scala ## @@ -67,7 +67,7 @@ private[spark] case class

[GitHub] [spark] SparkQA removed a comment on pull request #32709: [WIP][SPARK-35573][R] Support R 4.1.0 in SparkR

SparkQA removed a comment on pull request #32709: URL: https://github.com/apache/spark/pull/32709#issuecomment-851378560 **[Test build #139108 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139108/testReport)** for PR 32709 at commit

[GitHub] [spark] LuciferYang commented on a change in pull request #32710: [SPARK-35574][BUILD] Add a compile arg to turn compilation warnings related to `procedure syntax` to errors in Scala 2.13

LuciferYang commented on a change in pull request #32710: URL: https://github.com/apache/spark/pull/32710#discussion_r642378161 ## File path: core/src/main/scala/org/apache/spark/MapOutputTracker.scala ## @@ -720,7 +720,7 @@ private[spark] class MapOutputTrackerMaster( }

[GitHub] [spark] LuciferYang opened a new pull request #32710: [SPARK-35574][BUILD] Add a compile arg to turn compilation warnings related to `procedure syntax` to errors in Scala 2.13

LuciferYang opened a new pull request #32710: URL: https://github.com/apache/spark/pull/32710 ### What changes were proposed in this pull request? There are several pr to fix compilation warnings related to `procedure syntax` like SPARK-29291， SPARK-33352 and SPARK-35526, in order to

[GitHub] [spark] SparkQA commented on pull request #32709: [WIP][SPARK-35573][R] Support R 4.1.0 in SparkR

SparkQA commented on pull request #32709: URL: https://github.com/apache/spark/pull/32709#issuecomment-851381764 **[Test build #139108 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139108/testReport)** for PR 32709 at commit

[GitHub] [spark] SparkQA commented on pull request #32709: [WIP][SPARK-35573][R] Support R 4.1.0 in SparkR

SparkQA commented on pull request #32709: URL: https://github.com/apache/spark/pull/32709#issuecomment-851378560 **[Test build #139108 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139108/testReport)** for PR 32709 at commit

[GitHub] [spark] SparkQA commented on pull request #32704: [SPARK-35567][SQL] Fix: Explain cost is not showing statistics for all the nodes

SparkQA commented on pull request #32704: URL: https://github.com/apache/spark/pull/32704#issuecomment-851376629 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43623/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #32513: [SPARK-35378][SQL] Eagerly execute non-root Command

SparkQA commented on pull request #32513: URL: https://github.com/apache/spark/pull/32513#issuecomment-851374588 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43625/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #32704: [SPARK-35567][SQL] Fix: Explain cost is not showing statistics for all the nodes

SparkQA commented on pull request #32704: URL: https://github.com/apache/spark/pull/32704#issuecomment-851371944 **[Test build #139107 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139107/testReport)** for PR 32704 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32513: [SPARK-35378][SQL] Eagerly execute non-root Command

AmplabJenkins removed a comment on pull request #32513: URL: https://github.com/apache/spark/pull/32513#issuecomment-851369737 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43621/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32709: [WIP][SPARK-35573][R] Support R 4.1.0 in SparkR

AmplabJenkins removed a comment on pull request #32709: URL: https://github.com/apache/spark/pull/32709#issuecomment-851369735 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43620/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32708: [WIP] [SPARK-35572] [K8S] add hostNetwork feature to executor

AmplabJenkins removed a comment on pull request #32708: URL: https://github.com/apache/spark/pull/32708#issuecomment-851369729 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins commented on pull request #32708: [WIP] [SPARK-35572] [K8S] add hostNetwork feature to executor

AmplabJenkins commented on pull request #32708: URL: https://github.com/apache/spark/pull/32708#issuecomment-851369729 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] AmplabJenkins commented on pull request #32513: [SPARK-35378][SQL] Eagerly execute non-root Command

AmplabJenkins commented on pull request #32513: URL: https://github.com/apache/spark/pull/32513#issuecomment-851369737 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43621/ --

[GitHub] [spark] AmplabJenkins commented on pull request #32709: [WIP][SPARK-35573][R] Support R 4.1.0 in SparkR

AmplabJenkins commented on pull request #32709: URL: https://github.com/apache/spark/pull/32709#issuecomment-851369735 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43620/ --

[GitHub] [spark] SparkQA commented on pull request #32708: [WIP] [SPARK-35572] [K8S] add hostNetwork feature to executor

SparkQA commented on pull request #32708: URL: https://github.com/apache/spark/pull/32708#issuecomment-851369029 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43626/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #32686: [SPARK-35544][SQL] Add tree pattern pruning to Analyzer rules

SparkQA commented on pull request #32686: URL: https://github.com/apache/spark/pull/32686#issuecomment-851367758 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43624/ -- This is an automated message from the Apache

[GitHub] [spark] yaooqinn commented on pull request #32701: [SPARK-35562][DOC] Fix docs about Kubernetes and Yarn

yaooqinn commented on pull request #32701: URL: https://github.com/apache/spark/pull/32701#issuecomment-851367451 late +1, thanks @huskysun and @dongjoon-hyun. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [spark] dongjoon-hyun closed pull request #32701: [SPARK-35562][DOC] Fix docs about Kubernetes and Yarn

dongjoon-hyun closed pull request #32701: URL: https://github.com/apache/spark/pull/32701 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [spark] SparkQA commented on pull request #32708: [WIP] [SPARK-35572] [K8S] add hostNetwork feature to executor

SparkQA commented on pull request #32708: URL: https://github.com/apache/spark/pull/32708#issuecomment-851364322 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43622/ --

[GitHub] [spark] SparkQA commented on pull request #32513: [SPARK-35378][SQL] Eagerly execute non-root Command

SparkQA commented on pull request #32513: URL: https://github.com/apache/spark/pull/32513#issuecomment-851362839 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43621/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #32709: [WIP][SPARK-35573][R] Support R 4.1.0 in SparkR

SparkQA commented on pull request #32709: URL: https://github.com/apache/spark/pull/32709#issuecomment-851361084 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43620/ -- This is an automated message from the

[GitHub] [spark] SparkQA removed a comment on pull request #32708: [WIP] [SPARK-35572] [K8S] add hostNetwork feature to executor

SparkQA removed a comment on pull request #32708: URL: https://github.com/apache/spark/pull/32708#issuecomment-851337888 **[Test build #139106 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139106/testReport)** for PR 32708 at commit

[GitHub] [spark] SparkQA commented on pull request #32708: [WIP] [SPARK-35572] [K8S] add hostNetwork feature to executor

SparkQA commented on pull request #32708: URL: https://github.com/apache/spark/pull/32708#issuecomment-851349822 **[Test build #139106 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139106/testReport)** for PR 32708 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #32708: [WIP] [SPARK-35572] [K8S] add hostNetwork feature to executor

SparkQA removed a comment on pull request #32708: URL: https://github.com/apache/spark/pull/32708#issuecomment-851332186 **[Test build #139102 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139102/testReport)** for PR 32708 at commit

[GitHub] [spark] SparkQA commented on pull request #32708: [WIP] [SPARK-35572] [K8S] add hostNetwork feature to executor

SparkQA commented on pull request #32708: URL: https://github.com/apache/spark/pull/32708#issuecomment-851348708 **[Test build #139102 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139102/testReport)** for PR 32708 at commit

[GitHub] [spark] shahidki31 commented on pull request #32704: [SPARK-35567][SQL] Fix: Explain cost is not showing statistics for all the nodes

shahidki31 commented on pull request #32704: URL: https://github.com/apache/spark/pull/32704#issuecomment-851346445 Retest this please -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32686: [SPARK-35544][SQL] Add tree pattern pruning to Analyzer rules

AmplabJenkins removed a comment on pull request #32686: URL: https://github.com/apache/spark/pull/32686#issuecomment-851339874 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139096/

[GitHub] [spark] SparkQA commented on pull request #32513: [SPARK-35378][SQL] Eagerly execute non-root Command

SparkQA commented on pull request #32513: URL: https://github.com/apache/spark/pull/32513#issuecomment-851339703 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43621/ -- This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins commented on pull request #32686: [SPARK-35544][SQL] Add tree pattern pruning to Analyzer rules

AmplabJenkins commented on pull request #32686: URL: https://github.com/apache/spark/pull/32686#issuecomment-851339874 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139096/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #32686: [SPARK-35544][SQL] Add tree pattern pruning to Analyzer rules

SparkQA removed a comment on pull request #32686: URL: https://github.com/apache/spark/pull/32686#issuecomment-851169203 **[Test build #139096 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139096/testReport)** for PR 32686 at commit

[GitHub] [spark] SparkQA commented on pull request #32708: [WIP] [SPARK-35572] [K8S] add hostNetwork feature to executor

SparkQA commented on pull request #32708: URL: https://github.com/apache/spark/pull/32708#issuecomment-851337888 **[Test build #139106 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139106/testReport)** for PR 32708 at commit

[GitHub] [spark] SparkQA commented on pull request #32686: [SPARK-35544][SQL] Add tree pattern pruning to Analyzer rules

SparkQA commented on pull request #32686: URL: https://github.com/apache/spark/pull/32686#issuecomment-851337793 **[Test build #139096 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139096/testReport)** for PR 32686 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32704: [SPARK-35567][SQL] Fix: Explain cost is not showing statistics for all the nodes

AmplabJenkins removed a comment on pull request #32704: URL: https://github.com/apache/spark/pull/32704#issuecomment-851337299 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139103/

[GitHub] [spark] SparkQA removed a comment on pull request #32704: [SPARK-35567][SQL] Fix: Explain cost is not showing statistics for all the nodes

SparkQA removed a comment on pull request #32704: URL: https://github.com/apache/spark/pull/32704#issuecomment-851332155 **[Test build #139103 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139103/testReport)** for PR 32704 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #32704: [SPARK-35567][SQL] Fix: Explain cost is not showing statistics for all the nodes

AmplabJenkins commented on pull request #32704: URL: https://github.com/apache/spark/pull/32704#issuecomment-851337299 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139103/ -- This

[GitHub] [spark] SparkQA commented on pull request #32704: [SPARK-35567][SQL] Fix: Explain cost is not showing statistics for all the nodes

SparkQA commented on pull request #32704: URL: https://github.com/apache/spark/pull/32704#issuecomment-851337265 **[Test build #139103 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139103/testReport)** for PR 32704 at commit

[GitHub] [spark] SparkQA commented on pull request #32709: [WIP][SPARK-35573][R] Support R 4.1.0 in SparkR

SparkQA commented on pull request #32709: URL: https://github.com/apache/spark/pull/32709#issuecomment-851336385 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43620/ -- This is an automated message from the Apache

[GitHub] [spark] zwangsheng commented on a change in pull request #32708: [WIP] [SPARK-35572] [K8S] add hostNetwork feature to executor

zwangsheng commented on a change in pull request #32708: URL: https://github.com/apache/spark/pull/32708#discussion_r642329894 ## File path: resource-managers/kubernetes/docker/src/main/dockerfiles/spark/Dockerfile ## @@ -31,7 +31,7 @@ RUN set -ex && \ sed -i

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32708: [WIP] [SPARK-35572] [K8S] add hostNetwork feature to executor

AmplabJenkins removed a comment on pull request #32708: URL: https://github.com/apache/spark/pull/32708#issuecomment-851238472 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [spark] yaooqinn commented on a change in pull request #32708: [WIP] [SPARK-35572] [K8S] add hostNetwork feature to executor

yaooqinn commented on a change in pull request #32708: URL: https://github.com/apache/spark/pull/32708#discussion_r642326891 ## File path: resource-managers/kubernetes/docker/src/main/dockerfiles/spark/Dockerfile ## @@ -31,7 +31,7 @@ RUN set -ex && \ sed -i

[GitHub] [spark] SparkQA commented on pull request #32686: [SPARK-35544][SQL] Add tree pattern pruning to Analyzer rules

SparkQA commented on pull request #32686: URL: https://github.com/apache/spark/pull/32686#issuecomment-851332277 **[Test build #139104 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139104/testReport)** for PR 32686 at commit

[GitHub] [spark] SparkQA commented on pull request #32513: [SPARK-35378][SQL] Eagerly execute non-root Command

SparkQA commented on pull request #32513: URL: https://github.com/apache/spark/pull/32513#issuecomment-851332318 **[Test build #139105 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139105/testReport)** for PR 32513 at commit

[GitHub] [spark] SparkQA commented on pull request #32708: [WIP] [SPARK-35572] [K8S] add hostNetwork feature to executor

SparkQA commented on pull request #32708: URL: https://github.com/apache/spark/pull/32708#issuecomment-851332186 **[Test build #139102 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139102/testReport)** for PR 32708 at commit

[GitHub] [spark] SparkQA commented on pull request #32704: [SPARK-35567][SQL] Fix: Explain cost is not showing statistics for all the nodes

SparkQA commented on pull request #32704: URL: https://github.com/apache/spark/pull/32704#issuecomment-851332155 **[Test build #139103 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139103/testReport)** for PR 32704 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32558: [SPARK-34953][CORE][SQL] Add the code change for adding the DateType in the infer schema while reading in CSV and JSON

AmplabJenkins removed a comment on pull request #32558: URL: https://github.com/apache/spark/pull/32558#issuecomment-851330373 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43619/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32658: [SPARK-35433][DOCS] Move CSV data source options from Python and Scala into a single page

AmplabJenkins removed a comment on pull request #32658: URL: https://github.com/apache/spark/pull/32658#issuecomment-851330374 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139093/

[GitHub] [spark] AmplabJenkins commented on pull request #32658: [SPARK-35433][DOCS] Move CSV data source options from Python and Scala into a single page

AmplabJenkins commented on pull request #32658: URL: https://github.com/apache/spark/pull/32658#issuecomment-851330374 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139093/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32558: [SPARK-34953][CORE][SQL] Add the code change for adding the DateType in the infer schema while reading in CSV and JSON

AmplabJenkins commented on pull request #32558: URL: https://github.com/apache/spark/pull/32558#issuecomment-851330373 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43619/ --

[GitHub] [spark] sigmod commented on pull request #32686: [SPARK-35544][SQL] Add tree pattern pruning to Analyzer rules

sigmod commented on pull request #32686: URL: https://github.com/apache/spark/pull/32686#issuecomment-851327780 @dbaliafroozeh @gengliangwang @hvanhovell @maryannxue this PR is ready for review. Thanks! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] zwangsheng commented on pull request #32708: [WIP] [SPARK-35572] [K8S] add hostNetwork feature to executor

zwangsheng commented on pull request #32708: URL: https://github.com/apache/spark/pull/32708#issuecomment-851326095 cc @yaooqinn -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32658: [SPARK-35433][DOCS] Move CSV data source options from Python and Scala into a single page

HyukjinKwon commented on a change in pull request #32658: URL: https://github.com/apache/spark/pull/32658#discussion_r642315323 ## File path: docs/sql-data-sources-csv.md ## @@ -38,3 +36,217 @@ Spark SQL provides `spark.read().csv("file_name")` to read a file or directory o

[GitHub] [spark] viirya commented on a change in pull request #32699: [SPARK-35560][SQL] Remove redundant subexpression evaluation in nested subexpressions

viirya commented on a change in pull request #32699: URL: https://github.com/apache/spark/pull/32699#discussion_r642314197 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/CodeGenerator.scala ## @@ -1068,11 +1072,19 @@ class

[GitHub] [spark] SparkQA commented on pull request #32558: [SPARK-34953][CORE][SQL] Add the code change for adding the DateType in the infer schema while reading in CSV and JSON

SparkQA commented on pull request #32558: URL: https://github.com/apache/spark/pull/32558#issuecomment-851310260 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43619/ -- This is an automated message from the

<    1   2   3   4   5   >