[GitHub] [spark] SparkQA commented on pull request #33583: [WIP][SPARK-36352][SQL] Spark should check result plan's output schema name

SparkQA commented on pull request #33583: URL: https://github.com/apache/spark/pull/33583#issuecomment-893186935 **[Test build #142069 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142069/testReport)** for PR 33583 at commit

[GitHub] [spark] SparkQA commented on pull request #33615: [SPARK-36374][SHUFFLE][DOC] Push-based shuffle high level user documentation

SparkQA commented on pull request #33615: URL: https://github.com/apache/spark/pull/33615#issuecomment-893186864 **[Test build #142068 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142068/testReport)** for PR 33615 at commit

[GitHub] [spark] cloud-fan commented on a change in pull request #33624: [SPARK-35881][SQL][FOLLOWUP] Add a boolean flag in AdaptiveSparkPlanExec to ask for columnar output

cloud-fan commented on a change in pull request #33624: URL: https://github.com/apache/spark/pull/33624#discussion_r683149985 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/AdaptiveSparkPlanExec.scala ## @@ -348,34 +344,24 @@ case class

[GitHub] [spark] AmplabJenkins commented on pull request #33648: [SPARK-36420][Graphx] Use `isEmpty` to improve performance in Pregel‘s superstep

AmplabJenkins commented on pull request #33648: URL: https://github.com/apache/spark/pull/33648#issuecomment-893185191 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33508: [SPARK-36058][K8S] Add support for statefulset APIs in K8s

AmplabJenkins removed a comment on pull request #33508: URL: https://github.com/apache/spark/pull/33508#issuecomment-893184878 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46571/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33646: [SPARK-36388][PYTHON] Fix DataFrame groupby-rolling to follow pandas 1.3

AmplabJenkins removed a comment on pull request #33646: URL: https://github.com/apache/spark/pull/33646#issuecomment-893184880 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142066/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33639: [SPARK-34952][SQL] Aggregate (Min/Max/Count) push down for Parquet

AmplabJenkins removed a comment on pull request #33639: URL: https://github.com/apache/spark/pull/33639#issuecomment-893184876 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142054/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33638: [SPARK-36415][SQL][DOCS] Add docs for try_cast/try_add/try_divide

AmplabJenkins removed a comment on pull request #33638: URL: https://github.com/apache/spark/pull/33638#issuecomment-893184879 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46574/

[GitHub] [spark] AmplabJenkins commented on pull request #33508: [SPARK-36058][K8S] Add support for statefulset APIs in K8s

AmplabJenkins commented on pull request #33508: URL: https://github.com/apache/spark/pull/33508#issuecomment-893184878 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46571/ --

[GitHub] [spark] AmplabJenkins commented on pull request #33646: [SPARK-36388][PYTHON] Fix DataFrame groupby-rolling to follow pandas 1.3

AmplabJenkins commented on pull request #33646: URL: https://github.com/apache/spark/pull/33646#issuecomment-893184880 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142066/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #33639: [SPARK-34952][SQL] Aggregate (Min/Max/Count) push down for Parquet

AmplabJenkins commented on pull request #33639: URL: https://github.com/apache/spark/pull/33639#issuecomment-893184876 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142054/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #33638: [SPARK-36415][SQL][DOCS] Add docs for try_cast/try_add/try_divide

AmplabJenkins commented on pull request #33638: URL: https://github.com/apache/spark/pull/33638#issuecomment-893184879 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46574/ --

[GitHub] [spark] SparkQA commented on pull request #33647: [SPARK-36421][SQL] Validate all SQL configs to prevent from wrong use for ConfigEntry in doc fields

SparkQA commented on pull request #33647: URL: https://github.com/apache/spark/pull/33647#issuecomment-893182271 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46575/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #33646: [SPARK-36388][PYTHON] Fix DataFrame groupby-rolling to follow pandas 1.3

SparkQA commented on pull request #33646: URL: https://github.com/apache/spark/pull/33646#issuecomment-893182196 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46576/ -- This is an automated message from the Apache

[GitHub] [spark] gengliangwang commented on a change in pull request #33640: [SPARK-36409][SQL][TESTS] Splitting test cases from datetime.sql

gengliangwang commented on a change in pull request #33640: URL: https://github.com/apache/spark/pull/33640#discussion_r683144515 ## File path: sql/core/src/test/resources/sql-tests/results/ansi/date.sql.out ## @@ -0,0 +1,525 @@ +-- Automatically generated by SQLQueryTestSuite

[GitHub] [spark] SparkQA removed a comment on pull request #33639: [SPARK-34952][SQL] Aggregate (Min/Max/Count) push down for Parquet

SparkQA removed a comment on pull request #33639: URL: https://github.com/apache/spark/pull/33639#issuecomment-893079916 **[Test build #142054 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142054/testReport)** for PR 33639 at commit

[GitHub] [spark] StefanXiepj opened a new pull request #33648: [SPARK-36420][Graphx] Use `isEmpty` to improve performance in Pregel‘s superstep

StefanXiepj opened a new pull request #33648: URL: https://github.com/apache/spark/pull/33648 ### What changes were proposed in this pull request? When recived active-messages in Pregel, we only need an action operator here and active-messages are not empty, so we don’t

[GitHub] [spark] SparkQA commented on pull request #33639: [SPARK-34952][SQL] Aggregate (Min/Max/Count) push down for Parquet

SparkQA commented on pull request #33639: URL: https://github.com/apache/spark/pull/33639#issuecomment-893178070 **[Test build #142054 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142054/testReport)** for PR 33639 at commit

[GitHub] [spark] SparkQA commented on pull request #33638: [SPARK-36415][SQL][DOCS] Add docs for try_cast/try_add/try_divide

SparkQA commented on pull request #33638: URL: https://github.com/apache/spark/pull/33638#issuecomment-893177701 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46574/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #33508: [SPARK-36058][K8S] Add support for statefulset APIs in K8s

SparkQA commented on pull request #33508: URL: https://github.com/apache/spark/pull/33508#issuecomment-893177724 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46571/ -- This is an automated message from the

[GitHub] [spark] LuciferYang commented on pull request #33635: [SPARK-36410][CORE][SQL][STRUCTURED STREAMING][EXAMPLES] Replace anonymous classes with lambda expressions

LuciferYang commented on pull request #33635: URL: https://github.com/apache/spark/pull/33635#issuecomment-893176859 > The changes look good but can you also run the examples that you're fixing manually to verify the changes? @HyukjinKwon 1. I manually verified

[GitHub] [spark] SparkQA removed a comment on pull request #33646: [SPARK-36388][PYTHON] Fix DataFrame groupby-rolling to follow pandas 1.3

SparkQA removed a comment on pull request #33646: URL: https://github.com/apache/spark/pull/33646#issuecomment-893163413 **[Test build #142066 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142066/testReport)** for PR 33646 at commit

[GitHub] [spark] SparkQA commented on pull request #33646: [SPARK-36388][PYTHON] Fix DataFrame groupby-rolling to follow pandas 1.3

SparkQA commented on pull request #33646: URL: https://github.com/apache/spark/pull/33646#issuecomment-893174169 **[Test build #142066 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142066/testReport)** for PR 33646 at commit

[GitHub] [spark] gengliangwang commented on a change in pull request #33584: [SPARK-36351][SQL] Separate partition filters and data filters in PushDownUtils

gengliangwang commented on a change in pull request #33584: URL: https://github.com/apache/spark/pull/33584#discussion_r683135973 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/PushDownUtils.scala ## @@ -117,7 +145,11 @@ object

[GitHub] [spark] SparkQA commented on pull request #33635: [SPARK-36410][CORE][SQL][STRUCTURED STREAMING][EXAMPLES] Replace anonymous classes with lambda expressions

SparkQA commented on pull request #33635: URL: https://github.com/apache/spark/pull/33635#issuecomment-893171616 **[Test build #142067 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142067/testReport)** for PR 33635 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33638: [SPARK-36415][SQL][DOCS] Add docs for try_cast/try_add/try_divide

AmplabJenkins removed a comment on pull request #33638: URL: https://github.com/apache/spark/pull/33638#issuecomment-893168342 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46572/

[GitHub] [spark] SparkQA commented on pull request #33638: [SPARK-36415][SQL][DOCS] Add docs for try_cast/try_add/try_divide

SparkQA commented on pull request #33638: URL: https://github.com/apache/spark/pull/33638#issuecomment-893168320 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46572/ -- This is an automated message from the

[GitHub] [spark] AmplabJenkins commented on pull request #33638: [SPARK-36415][SQL][DOCS] Add docs for try_cast/try_add/try_divide

AmplabJenkins commented on pull request #33638: URL: https://github.com/apache/spark/pull/33638#issuecomment-893168342 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46572/ --

[GitHub] [spark] SparkQA commented on pull request #33646: [SPARK-36388][PYTHON] Fix DataFrame groupby-rolling to follow pandas 1.3

SparkQA commented on pull request #33646: URL: https://github.com/apache/spark/pull/33646#issuecomment-893163413 **[Test build #142066 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142066/testReport)** for PR 33646 at commit

[GitHub] [spark] SparkQA commented on pull request #33647: [SPARK-36421][SQL] Validate all SQL configs to prevent from wrong use for ConfigEntry in doc fields

SparkQA commented on pull request #33647: URL: https://github.com/apache/spark/pull/33647#issuecomment-893163457 **[Test build #142065 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142065/testReport)** for PR 33647 at commit

[GitHub] [spark] cloud-fan commented on pull request #33636: [SPARK-36414][SQL] Disable timeout for BroadcastQueryStageExec in AQE

cloud-fan commented on pull request #33636: URL: https://github.com/apache/spark/pull/33636#issuecomment-893163127 makes sense to me, cc @maryannxue -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33635: [SPARK-36410][CORE][SQL][STRUCTURED STREAMING][EXAMPLES] Replace anonymous classes with lambda expressions

AmplabJenkins removed a comment on pull request #33635: URL: https://github.com/apache/spark/pull/33635#issuecomment-893162904 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142060/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33645: [SPARK-36173][CORE][PYTHON][FOLLOWUP] Add type hint for TaskContext.cpus

AmplabJenkins removed a comment on pull request #33645: URL: https://github.com/apache/spark/pull/33645#issuecomment-893162910 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46573/

[GitHub] [spark] AmplabJenkins commented on pull request #33645: [SPARK-36173][CORE][PYTHON][FOLLOWUP] Add type hint for TaskContext.cpus

AmplabJenkins commented on pull request #33645: URL: https://github.com/apache/spark/pull/33645#issuecomment-893162910 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46573/ --

[GitHub] [spark] AmplabJenkins commented on pull request #33635: [SPARK-36410][CORE][SQL][STRUCTURED STREAMING][EXAMPLES] Replace anonymous classes with lambda expressions

AmplabJenkins commented on pull request #33635: URL: https://github.com/apache/spark/pull/33635#issuecomment-893162904 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142060/ -- This

[GitHub] [spark] yaooqinn opened a new pull request #33647: [SPARK-36421][SQL] Validate all SQL configs to prevent from wrong use for ConfigEntry in doc field

yaooqinn opened a new pull request #33647: URL: https://github.com/apache/spark/pull/33647 ### What changes were proposed in this pull request? This PR fixes the issue that `ConfigEntry` to be introduced to the doc field directly without calling `.key`, which causes

[GitHub] [spark] itholic opened a new pull request #33646: [SPARK-36388][PYTHON] Fix DataFrame groupby-rolling to follow pandas 1.3

itholic opened a new pull request #33646: URL: https://github.com/apache/spark/pull/33646 ### What changes were proposed in this pull request? This PR proposes to fix `GroupByRolling` to follow latest pandas behavior. `GroupByRolling` no longer returns grouped-by column in

[GitHub] [spark] SparkQA commented on pull request #33638: [SPARK-36415][SQL][DOCS] Add docs for try_cast/try_add/try_divide

SparkQA commented on pull request #33638: URL: https://github.com/apache/spark/pull/33638#issuecomment-893159596 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46574/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA removed a comment on pull request #33635: [SPARK-36410][CORE][SQL][STRUCTURED STREAMING][EXAMPLES] Replace anonymous classes with lambda expressions

SparkQA removed a comment on pull request #33635: URL: https://github.com/apache/spark/pull/33635#issuecomment-893124147 **[Test build #142060 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142060/testReport)** for PR 33635 at commit

[GitHub] [spark] SparkQA commented on pull request #33635: [SPARK-36410][CORE][SQL][STRUCTURED STREAMING][EXAMPLES] Replace anonymous classes with lambda expressions

SparkQA commented on pull request #33635: URL: https://github.com/apache/spark/pull/33635#issuecomment-893156894 **[Test build #142060 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142060/testReport)** for PR 33635 at commit

[GitHub] [spark] SparkQA commented on pull request #33645: [SPARK-36173][CORE][PYTHON][FOLLOWUP] Add type hint for TaskContext.cpus

SparkQA commented on pull request #33645: URL: https://github.com/apache/spark/pull/33645#issuecomment-893155198 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46573/ --

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33635: [SPARK-36410][CORE][SQL][STRUCTURED STREAMING][EXAMPLES] Replace anonymous classes with lambda expressions

AmplabJenkins removed a comment on pull request #33635: URL: https://github.com/apache/spark/pull/33635#issuecomment-893151855 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46570/

[GitHub] [spark] AmplabJenkins commented on pull request #33635: [SPARK-36410][CORE][SQL][STRUCTURED STREAMING][EXAMPLES] Replace anonymous classes with lambda expressions

AmplabJenkins commented on pull request #33635: URL: https://github.com/apache/spark/pull/33635#issuecomment-893151855 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46570/ --

[GitHub] [spark] SparkQA commented on pull request #33635: [SPARK-36410][CORE][SQL][STRUCTURED STREAMING][EXAMPLES] Replace anonymous classes with lambda expressions

SparkQA commented on pull request #33635: URL: https://github.com/apache/spark/pull/33635#issuecomment-893151803 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46570/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #33638: [SPARK-36415][SQL][DOCS] Add docs for try_cast/try_add/try_divide

SparkQA commented on pull request #33638: URL: https://github.com/apache/spark/pull/33638#issuecomment-893148537 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46572/ -- This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33638: [SPARK-36415][SQL][DOCS] Add docs for try_cast/try_add/try_divide

AmplabJenkins removed a comment on pull request #33638: URL: https://github.com/apache/spark/pull/33638#issuecomment-893147784 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142064/

[GitHub] [spark] AmplabJenkins commented on pull request #33638: [SPARK-36415][SQL][DOCS] Add docs for try_cast/try_add/try_divide

AmplabJenkins commented on pull request #33638: URL: https://github.com/apache/spark/pull/33638#issuecomment-893147784 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142064/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #33638: [SPARK-36415][SQL][DOCS] Add docs for try_cast/try_add/try_divide

SparkQA removed a comment on pull request #33638: URL: https://github.com/apache/spark/pull/33638#issuecomment-893142529 **[Test build #142064 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142064/testReport)** for PR 33638 at commit

[GitHub] [spark] SparkQA commented on pull request #33638: [SPARK-36415][SQL][DOCS] Add docs for try_cast/try_add/try_divide

SparkQA commented on pull request #33638: URL: https://github.com/apache/spark/pull/33638#issuecomment-893147606 **[Test build #142064 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142064/testReport)** for PR 33638 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33645: [SPARK-36173][CORE][PYTHON][FOLLOWUP] Add type hint for TaskContext.cpus

AmplabJenkins removed a comment on pull request #33645: URL: https://github.com/apache/spark/pull/33645#issuecomment-893143589 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142063/

[GitHub] [spark] AmplabJenkins commented on pull request #33645: [SPARK-36173][CORE][PYTHON][FOLLOWUP] Add type hint for TaskContext.cpus

AmplabJenkins commented on pull request #33645: URL: https://github.com/apache/spark/pull/33645#issuecomment-893143589 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142063/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #33645: [SPARK-36173][CORE][PYTHON][FOLLOWUP] Add type hint for TaskContext.cpus

SparkQA removed a comment on pull request #33645: URL: https://github.com/apache/spark/pull/33645#issuecomment-893132595 **[Test build #142063 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142063/testReport)** for PR 33645 at commit

[GitHub] [spark] SparkQA commented on pull request #33645: [SPARK-36173][CORE][PYTHON][FOLLOWUP] Add type hint for TaskContext.cpus

SparkQA commented on pull request #33645: URL: https://github.com/apache/spark/pull/33645#issuecomment-893143320 **[Test build #142063 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142063/testReport)** for PR 33645 at commit

[GitHub] [spark] SparkQA commented on pull request #33638: [SPARK-36415][SQL][DOCS] Add docs for try_cast/try_add/try_divide

SparkQA commented on pull request #33638: URL: https://github.com/apache/spark/pull/33638#issuecomment-893142529 **[Test build #142064 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142064/testReport)** for PR 33638 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33622: [SPARK-36391][SHUFFLE] When state is remove will throw NPE, and we should improve the error message

AmplabJenkins removed a comment on pull request #33622: URL: https://github.com/apache/spark/pull/33622#issuecomment-893141965 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142055/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33636: [SPARK-36414][SQL] Disable timeout for BroadcastQueryStageExec in AQE

AmplabJenkins removed a comment on pull request #33636: URL: https://github.com/apache/spark/pull/33636#issuecomment-893141966 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46568/

[GitHub] [spark] AmplabJenkins commented on pull request #33638: [SPARK-36415][SQL][DOCS] Add docs for try_cast/try_add/try_divide

AmplabJenkins commented on pull request #33638: URL: https://github.com/apache/spark/pull/33638#issuecomment-893141964 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142062/ -- This

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33638: [SPARK-36415][SQL][DOCS] Add docs for try_cast/try_add/try_divide

AmplabJenkins removed a comment on pull request #33638: URL: https://github.com/apache/spark/pull/33638#issuecomment-893141964 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142062/

[GitHub] [spark] AmplabJenkins commented on pull request #33622: [SPARK-36391][SHUFFLE] When state is remove will throw NPE, and we should improve the error message

AmplabJenkins commented on pull request #33622: URL: https://github.com/apache/spark/pull/33622#issuecomment-893141965 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142055/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #33636: [SPARK-36414][SQL] Disable timeout for BroadcastQueryStageExec in AQE

AmplabJenkins commented on pull request #33636: URL: https://github.com/apache/spark/pull/33636#issuecomment-893141966 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46568/ --

[GitHub] [spark] SparkQA commented on pull request #33508: [SPARK-36058][K8S] Add support for statefulset APIs in K8s

SparkQA commented on pull request #33508: URL: https://github.com/apache/spark/pull/33508#issuecomment-893141555 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46571/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #33622: [SPARK-36391][SHUFFLE] When state is remove will throw NPE, and we should improve the error message

SparkQA commented on pull request #33622: URL: https://github.com/apache/spark/pull/33622#issuecomment-893137388 **[Test build #142055 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142055/testReport)** for PR 33622 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #33622: [SPARK-36391][SHUFFLE] When state is remove will throw NPE, and we should improve the error message

SparkQA removed a comment on pull request #33622: URL: https://github.com/apache/spark/pull/33622#issuecomment-893080038 **[Test build #142055 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142055/testReport)** for PR 33622 at commit

[GitHub] [spark] SparkQA commented on pull request #33635: [SPARK-36410][CORE][SQL][STRUCTURED STREAMING][EXAMPLES] Replace anonymous classes with lambda expressions

SparkQA commented on pull request #33635: URL: https://github.com/apache/spark/pull/33635#issuecomment-893138503 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46570/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #33636: [SPARK-36414][SQL] Disable timeout for BroadcastQueryStageExec in AQE

SparkQA commented on pull request #33636: URL: https://github.com/apache/spark/pull/33636#issuecomment-893135410 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46568/ -- This is an automated message from the

[GitHub] [spark] mridulm commented on a change in pull request #33613: [SPARK-36378][SHUFFLE] Switch to using RPCResponse to communicate common block push failures to the client.

mridulm commented on a change in pull request #33613: URL: https://github.com/apache/spark/pull/33613#discussion_r683089989 ## File path: common/network-common/src/main/java/org/apache/spark/network/server/BlockPushNonFatalFailure.java ## @@ -0,0 +1,114 @@ +/* + * Licensed to

[GitHub] [spark] SparkQA removed a comment on pull request #33638: [SPARK-36415][SQL][DOCS] Add docs for try_cast/try_add/try_divide

SparkQA removed a comment on pull request #33638: URL: https://github.com/apache/spark/pull/33638#issuecomment-893130921 **[Test build #142062 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142062/testReport)** for PR 33638 at commit

[GitHub] [spark] SparkQA commented on pull request #33638: [SPARK-36415][SQL][DOCS] Add docs for try_cast/try_add/try_divide

SparkQA commented on pull request #33638: URL: https://github.com/apache/spark/pull/33638#issuecomment-893134909 **[Test build #142062 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142062/testReport)** for PR 33638 at commit

[GitHub] [spark] gengliangwang commented on a change in pull request #33638: [SPARK-36415][SQL][DOCS] Add docs for try_cast/try_add/try_divide

gengliangwang commented on a change in pull request #33638: URL: https://github.com/apache/spark/pull/33638#discussion_r683100724 ## File path: docs/sql-ref-ansi-compliance.md ## @@ -257,6 +257,15 @@ The behavior of some SQL operators can be different under ANSI mode

[GitHub] [spark] SparkQA commented on pull request #33645: [SPARK-36173][CORE][PYTHON][FOLLOWUP] Add type hint for TaskContext.cpus

SparkQA commented on pull request #33645: URL: https://github.com/apache/spark/pull/33645#issuecomment-893132595 **[Test build #142063 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142063/testReport)** for PR 33645 at commit

[GitHub] [spark] SparkQA commented on pull request #33508: [SPARK-36058][K8S] Add support for statefulset APIs in K8s

SparkQA commented on pull request #33508: URL: https://github.com/apache/spark/pull/33508#issuecomment-893129065 **[Test build #142061 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142061/testReport)** for PR 33508 at commit

[GitHub] [spark] sarutak commented on pull request #33645: [SPARK-36173][CORE][PYTHON][FOLLOWUP] Add type hint for TaskContext.cpus

sarutak commented on pull request #33645: URL: https://github.com/apache/spark/pull/33645#issuecomment-893132041 cc: @HyukjinKwon @xwu99 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33588: [SPARK-36346][SQL] Support TimestampNTZ type in Orc file source

AmplabJenkins removed a comment on pull request #33588: URL: https://github.com/apache/spark/pull/33588#issuecomment-893131719 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46569/

[GitHub] [spark] sarutak opened a new pull request #33645: [SPARK-36173][CORE][PYTHON][FOLLOWUP] Add type hint for TaskContext.cpus

sarutak opened a new pull request #33645: URL: https://github.com/apache/spark/pull/33645 ### What changes were proposed in this pull request? This PR adds type hint for `TaskContext.cpus` added in SPARK-36173 (#33385) ### Why are the changes needed? To comply with

[GitHub] [spark] AmplabJenkins commented on pull request #33588: [SPARK-36346][SQL] Support TimestampNTZ type in Orc file source

AmplabJenkins commented on pull request #33588: URL: https://github.com/apache/spark/pull/33588#issuecomment-893131719 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46569/ --

[GitHub] [spark] SparkQA commented on pull request #33588: [SPARK-36346][SQL] Support TimestampNTZ type in Orc file source

SparkQA commented on pull request #33588: URL: https://github.com/apache/spark/pull/33588#issuecomment-893131696 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46569/ --

[GitHub] [spark] SparkQA commented on pull request #33638: [SPARK-36415][SQL][DOCS] Add docs for try_cast/try_add/try_divide

SparkQA commented on pull request #33638: URL: https://github.com/apache/spark/pull/33638#issuecomment-893130921 **[Test build #142062 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142062/testReport)** for PR 33638 at commit

[GitHub] [spark] zhuqi-lucas commented on a change in pull request #33613: [SPARK-36378][SHUFFLE] Switch to using RPCResponse to communicate common block push failures to the client.

zhuqi-lucas commented on a change in pull request #33613: URL: https://github.com/apache/spark/pull/33613#discussion_r682301682 ## File path: common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/RemoteBlockPushResolver.java ## @@ -471,9 +488,10 @@ public void

[GitHub] [spark] AmplabJenkins commented on pull request #33583: [WIP][SPARK-36352][SQL] Spark should check result plan's output schema name

AmplabJenkins commented on pull request #33583: URL: https://github.com/apache/spark/pull/33583#issuecomment-893127038 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142058/ -- This

[GitHub] [spark] gengliangwang commented on a change in pull request #33638: [SPARK-36415][SQL][DOCS] Add docs for try_cast/try_add/try_divide

gengliangwang commented on a change in pull request #33638: URL: https://github.com/apache/spark/pull/33638#discussion_r683096447 ## File path: docs/sql-ref-ansi-compliance.md ## @@ -257,6 +257,15 @@ The behavior of some SQL operators can be different under ANSI mode

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33583: [WIP][SPARK-36352][SQL] Spark should check result plan's output schema name

AmplabJenkins removed a comment on pull request #33583: URL: https://github.com/apache/spark/pull/33583#issuecomment-893127038 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142058/

[GitHub] [spark] SparkQA removed a comment on pull request #33583: [WIP][SPARK-36352][SQL] Spark should check result plan's output schema name

SparkQA removed a comment on pull request #33583: URL: https://github.com/apache/spark/pull/33583#issuecomment-893101971 **[Test build #142058 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142058/testReport)** for PR 33583 at commit

[GitHub] [spark] SparkQA commented on pull request #33583: [WIP][SPARK-36352][SQL] Spark should check result plan's output schema name

SparkQA commented on pull request #33583: URL: https://github.com/apache/spark/pull/33583#issuecomment-893126791 **[Test build #142058 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142058/testReport)** for PR 33583 at commit

[GitHub] [spark] SparkQA commented on pull request #33635: [SPARK-36410][CORE][SQL][STRUCTURED STREAMING][EXAMPLES] Replace anonymous classes with lambda expressions

SparkQA commented on pull request #33635: URL: https://github.com/apache/spark/pull/33635#issuecomment-893124147 **[Test build #142060 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142060/testReport)** for PR 33635 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33508: [SPARK-36058][K8S] Add support for statefulset APIs in K8s

AmplabJenkins removed a comment on pull request #33508: URL: https://github.com/apache/spark/pull/33508#issuecomment-893122845 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins commented on pull request #33622: [SPARK-36391][SHUFFLE] When state is remove will throw NPE, and we should improve the error message

AmplabJenkins commented on pull request #33622: URL: https://github.com/apache/spark/pull/33622#issuecomment-893122850 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46566/ --

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33634: [SPARK-36369][PYTHON] Fix Index.union to follow pandas 1.3

AmplabJenkins removed a comment on pull request #33634: URL: https://github.com/apache/spark/pull/33634#issuecomment-893122847 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46567/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33622: [SPARK-36391][SHUFFLE] When state is remove will throw NPE, and we should improve the error message

AmplabJenkins removed a comment on pull request #33622: URL: https://github.com/apache/spark/pull/33622#issuecomment-893122850 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46566/

[GitHub] [spark] AmplabJenkins commented on pull request #33634: [SPARK-36369][PYTHON] Fix Index.union to follow pandas 1.3

AmplabJenkins commented on pull request #33634: URL: https://github.com/apache/spark/pull/33634#issuecomment-893122847 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46567/ --

[GitHub] [spark] AmplabJenkins commented on pull request #33508: [SPARK-36058][K8S] Add support for statefulset APIs in K8s

AmplabJenkins commented on pull request #33508: URL: https://github.com/apache/spark/pull/33508#issuecomment-893122846 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [spark] SparkQA commented on pull request #33636: [SPARK-36414][SQL] Disable timeout for BroadcastQueryStageExec in AQE

SparkQA commented on pull request #33636: URL: https://github.com/apache/spark/pull/33636#issuecomment-893121632 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46568/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA removed a comment on pull request #33508: [SPARK-36058][K8S] Add support for statefulset APIs in K8s

SparkQA removed a comment on pull request #33508: URL: https://github.com/apache/spark/pull/33508#issuecomment-893052644 **[Test build #142053 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142053/testReport)** for PR 33508 at commit

[GitHub] [spark] SparkQA commented on pull request #33508: [SPARK-36058][K8S] Add support for statefulset APIs in K8s

SparkQA commented on pull request #33508: URL: https://github.com/apache/spark/pull/33508#issuecomment-893116890 **[Test build #142053 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142053/testReport)** for PR 33508 at commit

[GitHub] [spark] SparkQA commented on pull request #33622: [SPARK-36391][SHUFFLE] When state is remove will throw NPE, and we should improve the error message

SparkQA commented on pull request #33622: URL: https://github.com/apache/spark/pull/33622#issuecomment-893116713 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46566/ -- This is an automated message from the

[GitHub] [spark] LuciferYang commented on pull request #33635: [SPARK-36410][CORE][SQL][STRUCTURED STREAMING][EXAMPLES] Replace anonymous classes with lambda expressions

LuciferYang commented on pull request #33635: URL: https://github.com/apache/spark/pull/33635#issuecomment-893114105 > The changes look good but can you also run the examples that you're fixing manually to verify the changes? OK ~ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #33634: [SPARK-36369][PYTHON] Fix Index.union to follow pandas 1.3

SparkQA commented on pull request #33634: URL: https://github.com/apache/spark/pull/33634#issuecomment-893114036 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46567/ -- This is an automated message from the

[GitHub] [spark] dongjoon-hyun commented on pull request #31517: [SPARK-34309][BUILD][CORE][SQL][K8S]Use Caffeine instead of Guava Cache

dongjoon-hyun commented on pull request #31517: URL: https://github.com/apache/spark/pull/31517#issuecomment-893113824 Thank you, @LuciferYang and @holdenk and all! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [spark] SparkQA commented on pull request #33508: [SPARK-36058][K8S] Add support for statefulset APIs in K8s

SparkQA commented on pull request #33508: URL: https://github.com/apache/spark/pull/33508#issuecomment-893113318 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46564/ -- This is an automated message from the

[GitHub] [spark] LuciferYang edited a comment on pull request #31517: [SPARK-34309][BUILD][CORE][SQL][K8S]Use Caffeine instead of Guava Cache

LuciferYang edited a comment on pull request #31517: URL: https://github.com/apache/spark/pull/31517#issuecomment-893113204 thanks all ~ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] LuciferYang commented on pull request #31517: [SPARK-34309][BUILD][CORE][SQL][K8S]Use Caffeine instead of Guava Cache

LuciferYang commented on pull request #31517: URL: https://github.com/apache/spark/pull/31517#issuecomment-893113204 @holdenk thanks all ~ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

  1   2   3   4   5   6   >