[GitHub] [spark] SparkQA removed a comment on pull request #31871: [SPARK-34779][CORE] ExecutoMetricsPoller should keep stage entry in stageTCMP until a heartbeat occurs

SparkQA removed a comment on pull request #31871: URL: https://github.com/apache/spark/pull/31871#issuecomment-809839967 **[Test build #136679 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136679/testReport)** for PR 31871 at commit

[GitHub] [spark] SparkQA commented on pull request #31871: [SPARK-34779][CORE] ExecutoMetricsPoller should keep stage entry in stageTCMP until a heartbeat occurs

SparkQA commented on pull request #31871: URL: https://github.com/apache/spark/pull/31871#issuecomment-809894576 **[Test build #136679 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136679/testReport)** for PR 31871 at commit

[GitHub] [spark] SparkQA commented on pull request #31680: [SPARK-34568][SQL] We should respect enableHiveSupport when initialize SparkSession

SparkQA commented on pull request #31680: URL: https://github.com/apache/spark/pull/31680#issuecomment-809888197 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41263/ -- This is an automated message from the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31666: [SPARK-34527][SQL] Resolve duplicated common columns from USING/NATURAL JOIN

AmplabJenkins removed a comment on pull request #31666: URL: https://github.com/apache/spark/pull/31666#issuecomment-809885979 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136673/

[GitHub] [spark] AmplabJenkins commented on pull request #31666: [SPARK-34527][SQL] Resolve duplicated common columns from USING/NATURAL JOIN

AmplabJenkins commented on pull request #31666: URL: https://github.com/apache/spark/pull/31666#issuecomment-809885979 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136673/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #31666: [SPARK-34527][SQL] Resolve duplicated common columns from USING/NATURAL JOIN

SparkQA removed a comment on pull request #31666: URL: https://github.com/apache/spark/pull/31666#issuecomment-809795765 **[Test build #136673 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136673/testReport)** for PR 31666 at commit

[GitHub] [spark] SparkQA commented on pull request #31666: [SPARK-34527][SQL] Resolve duplicated common columns from USING/NATURAL JOIN

SparkQA commented on pull request #31666: URL: https://github.com/apache/spark/pull/31666#issuecomment-809885231 **[Test build #136673 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136673/testReport)** for PR 31666 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29642: [SPARK-32792][SQL] Improve InSet filter pushdown

AmplabJenkins removed a comment on pull request #29642: URL: https://github.com/apache/spark/pull/29642#issuecomment-809882190 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41264/

[GitHub] [spark] AmplabJenkins commented on pull request #29642: [SPARK-32792][SQL] Improve InSet filter pushdown

AmplabJenkins commented on pull request #29642: URL: https://github.com/apache/spark/pull/29642#issuecomment-809882190 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41264/ --

[GitHub] [spark] SparkQA commented on pull request #29642: [SPARK-32792][SQL] Improve InSet filter pushdown

SparkQA commented on pull request #29642: URL: https://github.com/apache/spark/pull/29642#issuecomment-809882171 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41264/ -- This is an automated message from the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31992: [SPARK-34898][CORE] We should send SparkListenerExecutorMetricsUpdateEventLog of `driver` appropriately

AmplabJenkins removed a comment on pull request #31992: URL: https://github.com/apache/spark/pull/31992#issuecomment-809881727 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41262/

[GitHub] [spark] gengliangwang commented on a change in pull request #31982: [SPARK-34881][SQL] New SQL Function: TRY_CAST

gengliangwang commented on a change in pull request #31982: URL: https://github.com/apache/spark/pull/31982#discussion_r603757653 ## File path: sql/core/src/test/scala/org/apache/spark/sql/SQLQuerySuite.scala ## @@ -4118,6 +4118,26 @@ class SQLQuerySuite extends QueryTest with

[GitHub] [spark] AmplabJenkins commented on pull request #31992: [SPARK-34898][CORE] We should send SparkListenerExecutorMetricsUpdateEventLog of `driver` appropriately

AmplabJenkins commented on pull request #31992: URL: https://github.com/apache/spark/pull/31992#issuecomment-809881727 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41262/ --

[GitHub] [spark] SparkQA commented on pull request #31992: [SPARK-34898][CORE] We should send SparkListenerExecutorMetricsUpdateEventLog of `driver` appropriately

SparkQA commented on pull request #31992: URL: https://github.com/apache/spark/pull/31992#issuecomment-809881705 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41262/ -- This is an automated message from the

[GitHub] [spark] gengliangwang commented on a change in pull request #31982: [SPARK-34881][SQL] New SQL Function: TRY_CAST

gengliangwang commented on a change in pull request #31982: URL: https://github.com/apache/spark/pull/31982#discussion_r603757476 ## File path: sql/core/src/test/scala/org/apache/spark/sql/SQLQuerySuite.scala ## @@ -4118,6 +4118,26 @@ class SQLQuerySuite extends QueryTest with

[GitHub] [spark] cloud-fan commented on a change in pull request #31984: [SPARK-34884][SQL] Improve dynamic partition pruning evaluation

cloud-fan commented on a change in pull request #31984: URL: https://github.com/apache/spark/pull/31984#discussion_r603757330 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/dynamicpruning/PartitionPruning.scala ## @@ -247,13 +246,15 @@ object

[GitHub] [spark] gengliangwang commented on a change in pull request #31982: [SPARK-34881][SQL] New SQL Function: TRY_CAST

gengliangwang commented on a change in pull request #31982: URL: https://github.com/apache/spark/pull/31982#discussion_r603757223 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/TryCast.scala ## @@ -0,0 +1,88 @@ +/* + * Licensed to the

[GitHub] [spark] cloud-fan commented on a change in pull request #31984: [SPARK-34884][SQL] Improve dynamic partition pruning evaluation

cloud-fan commented on a change in pull request #31984: URL: https://github.com/apache/spark/pull/31984#discussion_r603757191 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/dynamicpruning/PartitionPruning.scala ## @@ -247,13 +246,15 @@ object

[GitHub] [spark] SparkQA commented on pull request #30212: [SPARK-33308][SQL] Refactor current grouping analytics

SparkQA commented on pull request #30212: URL: https://github.com/apache/spark/pull/30212#issuecomment-809881217 **[Test build #136684 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136684/testReport)** for PR 30212 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29642: [SPARK-32792][SQL] Improve InSet filter pushdown

AmplabJenkins removed a comment on pull request #29642: URL: https://github.com/apache/spark/pull/29642#issuecomment-809880752 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136676/

[GitHub] [spark] SparkQA commented on pull request #31984: [SPARK-34884][SQL] Improve dynamic partition pruning evaluation

SparkQA commented on pull request #31984: URL: https://github.com/apache/spark/pull/31984#issuecomment-809880894 **[Test build #136683 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136683/testReport)** for PR 31984 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29642: [SPARK-32792][SQL] Improve InSet filter pushdown

AmplabJenkins commented on pull request #29642: URL: https://github.com/apache/spark/pull/29642#issuecomment-809880752 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136676/ -- This

[GitHub] [spark] SparkQA commented on pull request #29642: [SPARK-32792][SQL] Improve InSet filter pushdown

SparkQA commented on pull request #29642: URL: https://github.com/apache/spark/pull/29642#issuecomment-809879605 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41264/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #31992: [SPARK-34898][CORE] We should send SparkListenerExecutorMetricsUpdateEventLog of `driver` appropriately

SparkQA commented on pull request #31992: URL: https://github.com/apache/spark/pull/31992#issuecomment-809878948 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41262/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #31680: [SPARK-34568][SQL] We should respect enableHiveSupport when initialize SparkSession

SparkQA commented on pull request #31680: URL: https://github.com/apache/spark/pull/31680#issuecomment-809878016 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41263/ -- This is an automated message from the Apache

[GitHub] [spark] LuciferYang commented on a change in pull request #31517: [WIP][SPARK-34309][BUILD][CORE][SQL][K8S]Use Caffeine instead of Guava Cache

LuciferYang commented on a change in pull request #31517: URL: https://github.com/apache/spark/pull/31517#discussion_r603754412 ## File path: core/src/main/scala/org/apache/spark/deploy/history/ApplicationCache.scala ## @@ -62,21 +64,27 @@ private[history] class

[GitHub] [spark] cloud-fan commented on a change in pull request #31994: [SPARK-34899][SQL] Use origin plan if we can not coalesce shuffle partition

cloud-fan commented on a change in pull request #31994: URL: https://github.com/apache/spark/pull/31994#discussion_r603753304 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/adaptive/AdaptiveQueryExecSuite.scala ## @@ -1543,4 +1543,27 @@ class

[GitHub] [spark] wangyum commented on a change in pull request #31984: [SPARK-34884][SQL] Improve dynamic partition pruning evaluation

wangyum commented on a change in pull request #31984: URL: https://github.com/apache/spark/pull/31984#discussion_r603750044 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/dynamicpruning/PartitionPruning.scala ## @@ -48,6 +49,10 @@ import

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #30212: [SPARK-33308][SQL] Refactor current grouping analytics

AngersZh commented on a change in pull request #30212: URL: https://github.com/apache/spark/pull/30212#discussion_r603747251 ## File path: sql/core/src/test/resources/sql-tests/results/group-analytics.sql.out ## @@ -275,6 +245,24 @@ NULL 201235000 NULL 2013

[GitHub] [spark] SparkQA removed a comment on pull request #29642: [SPARK-32792][SQL] Improve InSet filter pushdown

SparkQA removed a comment on pull request #29642: URL: https://github.com/apache/spark/pull/29642#issuecomment-809818374 **[Test build #136676 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136676/testReport)** for PR 29642 at commit

[GitHub] [spark] SparkQA commented on pull request #29642: [SPARK-32792][SQL] Improve InSet filter pushdown

SparkQA commented on pull request #29642: URL: https://github.com/apache/spark/pull/29642#issuecomment-809869327 **[Test build #136676 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136676/testReport)** for PR 29642 at commit

[GitHub] [spark] yaooqinn commented on a change in pull request #24559: [SPARK-27658][SQL] Add FunctionCatalog API

yaooqinn commented on a change in pull request #24559: URL: https://github.com/apache/spark/pull/24559#discussion_r603745517 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/connector/catalog/functions/Function.java ## @@ -0,0 +1,33 @@ +/* + * Licensed to the

[GitHub] [spark] HyukjinKwon commented on pull request #31995: [SPARK-34900][TEST] Make sure benchmarks can run using spark-submit cmd described in the guide

HyukjinKwon commented on pull request #31995: URL: https://github.com/apache/spark/pull/31995#issuecomment-809867659 Merged to master. @LuciferYang can we create backporting PRs? -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] HyukjinKwon closed pull request #31995: [SPARK-34900][TEST] Make sure benchmarks can run using spark-submit cmd described in the guide

HyukjinKwon closed pull request #31995: URL: https://github.com/apache/spark/pull/31995 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [spark] maropu commented on a change in pull request #31994: [SPARK-34899][SQL] Use origin plan if we can not coalesce shuffle partition

maropu commented on a change in pull request #31994: URL: https://github.com/apache/spark/pull/31994#discussion_r603743803 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/CoalesceShufflePartitions.scala ## @@ -72,14 +72,20 @@ case class

[GitHub] [spark] maropu commented on a change in pull request #31994: [SPARK-34899][SQL] Use origin plan if we can not coalesce shuffle partition

maropu commented on a change in pull request #31994: URL: https://github.com/apache/spark/pull/31994#discussion_r603743739 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/adaptive/AdaptiveQueryExecSuite.scala ## @@ -1543,4 +1543,27 @@ class

[GitHub] [spark] maropu commented on a change in pull request #31994: [SPARK-34899][SQL] Use origin plan if we can not coalesce shuffle partition

maropu commented on a change in pull request #31994: URL: https://github.com/apache/spark/pull/31994#discussion_r603743658 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/adaptive/AdaptiveQueryExecSuite.scala ## @@ -1543,4 +1543,27 @@ class

[GitHub] [spark] maropu commented on a change in pull request #31994: [SPARK-34899][SQL] Use origin plan if we can not coalesce shuffle partition

maropu commented on a change in pull request #31994: URL: https://github.com/apache/spark/pull/31994#discussion_r603743258 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/CoalesceShufflePartitions.scala ## @@ -72,14 +72,20 @@ case class

[GitHub] [spark] maropu commented on pull request #31994: [SPARK-34899][SQL] Use origin plan if we can not coalesce shuffle partition

maropu commented on pull request #31994: URL: https://github.com/apache/spark/pull/31994#issuecomment-809865219 also cc: @maryannxue -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins removed a comment on pull request #24559: [SPARK-27658][SQL] Add FunctionCatalog API

AmplabJenkins removed a comment on pull request #24559: URL: https://github.com/apache/spark/pull/24559#issuecomment-809864355 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136672/

[GitHub] [spark] AmplabJenkins commented on pull request #24559: [SPARK-27658][SQL] Add FunctionCatalog API

AmplabJenkins commented on pull request #24559: URL: https://github.com/apache/spark/pull/24559#issuecomment-809864355 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136672/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #24559: [SPARK-27658][SQL] Add FunctionCatalog API

SparkQA removed a comment on pull request #24559: URL: https://github.com/apache/spark/pull/24559#issuecomment-809759390 **[Test build #136672 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136672/testReport)** for PR 24559 at commit

[GitHub] [spark] LuciferYang commented on a change in pull request #31517: [WIP][SPARK-34309][BUILD][CORE][SQL][K8S]Use Caffeine instead of Guava Cache

LuciferYang commented on a change in pull request #31517: URL: https://github.com/apache/spark/pull/31517#discussion_r603741576 ## File path: pom.xml ## @@ -484,6 +484,16 @@ ${guava.version} provided + +com.github.ben-manes.caffeine +

[GitHub] [spark] SparkQA commented on pull request #24559: [SPARK-27658][SQL] Add FunctionCatalog API

SparkQA commented on pull request #24559: URL: https://github.com/apache/spark/pull/24559#issuecomment-809863561 **[Test build #136672 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136672/testReport)** for PR 24559 at commit

[GitHub] [spark] SparkQA commented on pull request #29642: [SPARK-32792][SQL] Improve InSet filter pushdown

SparkQA commented on pull request #29642: URL: https://github.com/apache/spark/pull/29642#issuecomment-809862832 **[Test build #136682 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136682/testReport)** for PR 29642 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31871: [SPARK-34779][CORE] ExecutoMetricsPoller should keep stage entry in stageTCMP until a heartbeat occurs

AmplabJenkins removed a comment on pull request #31871: URL: https://github.com/apache/spark/pull/31871#issuecomment-809860564 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41261/

[GitHub] [spark] SparkQA commented on pull request #31871: [SPARK-34779][CORE] ExecutoMetricsPoller should keep stage entry in stageTCMP until a heartbeat occurs

SparkQA commented on pull request #31871: URL: https://github.com/apache/spark/pull/31871#issuecomment-809860547 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41261/ -- This is an automated message from the

[GitHub] [spark] AmplabJenkins commented on pull request #31871: [SPARK-34779][CORE] ExecutoMetricsPoller should keep stage entry in stageTCMP until a heartbeat occurs

AmplabJenkins commented on pull request #31871: URL: https://github.com/apache/spark/pull/31871#issuecomment-809860564 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41261/ --

[GitHub] [spark] SparkQA commented on pull request #31680: [SPARK-34568][SQL] We should respect enableHiveSupport when initialize SparkSession

SparkQA commented on pull request #31680: URL: https://github.com/apache/spark/pull/31680#issuecomment-809860396 **[Test build #136681 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136681/testReport)** for PR 31680 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31886: [SPARK-34795][SQL][TESTS] Adds a new job in GitHub Actions to check the output of TPC-DS queries

AmplabJenkins removed a comment on pull request #31886: URL: https://github.com/apache/spark/pull/31886#issuecomment-809859983 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] SparkQA commented on pull request #31992: [SPARK-34898][CORE] We should send SparkListenerExecutorMetricsUpdateEventLog of `driver` appropriately

SparkQA commented on pull request #31992: URL: https://github.com/apache/spark/pull/31992#issuecomment-809860209 **[Test build #136680 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136680/testReport)** for PR 31992 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31986: [SPARK-34888][SS] Introduce UpdatingSessionIterator adjusting session window on elements

AmplabJenkins removed a comment on pull request #31986: URL: https://github.com/apache/spark/pull/31986#issuecomment-809859985 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41259/

[GitHub] [spark] AmplabJenkins commented on pull request #31886: [SPARK-34795][SQL][TESTS] Adds a new job in GitHub Actions to check the output of TPC-DS queries

AmplabJenkins commented on pull request #31886: URL: https://github.com/apache/spark/pull/31886#issuecomment-809859983 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] AmplabJenkins commented on pull request #31986: [SPARK-34888][SS] Introduce UpdatingSessionIterator adjusting session window on elements

AmplabJenkins commented on pull request #31986: URL: https://github.com/apache/spark/pull/31986#issuecomment-809859985 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41259/ --

[GitHub] [spark] LuciferYang commented on a change in pull request #31995: [SPARK-34900][TEST] Make sure benchmarks can run using spark-submit cmd described in the guide

LuciferYang commented on a change in pull request #31995: URL: https://github.com/apache/spark/pull/31995#discussion_r603736602 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/benchmark/InsertTableWithDynamicPartitionsBenchmark.scala ## @@ -23,7 +23,9 @@

[GitHub] [spark] SparkQA commented on pull request #31886: [SPARK-34795][SQL][TESTS] Adds a new job in GitHub Actions to check the output of TPC-DS queries

SparkQA commented on pull request #31886: URL: https://github.com/apache/spark/pull/31886#issuecomment-809857896 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41260/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #31986: [SPARK-34888][SS] Introduce UpdatingSessionIterator adjusting session window on elements

SparkQA commented on pull request #31986: URL: https://github.com/apache/spark/pull/31986#issuecomment-809857792 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41259/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #31871: [SPARK-34779][CORE] ExecutoMetricsPoller should keep stage entry in stageTCMP until a heartbeat occurs

SparkQA commented on pull request #31871: URL: https://github.com/apache/spark/pull/31871#issuecomment-809857723 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41261/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #31886: [SPARK-34795][SQL][TESTS] Adds a new job in GitHub Actions to check the output of TPC-DS queries

SparkQA commented on pull request #31886: URL: https://github.com/apache/spark/pull/31886#issuecomment-809855934 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41260/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #31986: [SPARK-34888][SS] Introduce UpdatingSessionIterator adjusting session window on elements

SparkQA commented on pull request #31986: URL: https://github.com/apache/spark/pull/31986#issuecomment-809855283 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41259/ -- This is an automated message from the Apache

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #31992: [SPARK-34898][CORE] We should send SparkListenerExecutorMetricsUpdateEventLog of `driver` appropriately

AngersZh commented on a change in pull request #31992: URL: https://github.com/apache/spark/pull/31992#discussion_r603734069 ## File path: core/src/test/scala/org/apache/spark/scheduler/EventLoggingListenerSuite.scala ## @@ -618,6 +619,10 @@ class

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #31992: [SPARK-34898][CORE] We should send SparkListenerExecutorMetricsUpdateEventLog of `driver` appropriately

AngersZh commented on a change in pull request #31992: URL: https://github.com/apache/spark/pull/31992#discussion_r603734003 ## File path: core/src/main/scala/org/apache/spark/scheduler/EventLoggingListener.scala ## @@ -249,6 +249,9 @@ private[spark] class

[GitHub] [spark] AngersZhuuuu commented on pull request #31992: [SPARK-34898][CORE] We should send SparkListenerExecutorMetricsUpdateEventLog of `driver` appropriately

AngersZh commented on pull request #31992: URL: https://github.com/apache/spark/pull/31992#issuecomment-809854277 > Who is consuming this event in spark ? > Btw, if all you want is monitor jvm stats (outside of spark ui), use codahale integration instead ? `AppStatusListener`

[GitHub] [spark] yaooqinn commented on pull request #31990: [SPARK-34894][CORE] Use 'io.connectionTimeout' as a hint instead of 'spark.network.timeout' for lost connections

yaooqinn commented on pull request #31990: URL: https://github.com/apache/spark/pull/31990#issuecomment-809848976 thank you all, merging to master -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [spark] wypoon edited a comment on pull request #31871: [SPARK-34779][CORE] ExecutoMetricsPoller should keep stage entry in stageTCMP until a heartbeat occurs

wypoon edited a comment on pull request #31871: URL: https://github.com/apache/spark/pull/31871#issuecomment-809805138 LGTM. I commented in the Jira [SPARK-34779](https://issues.apache.org/jira/browse/SPARK-34779) - I don't think that there is a bug as claimed, i.e., I don't think any

[GitHub] [spark] yaooqinn closed pull request #31990: [SPARK-34894][CORE] Use 'io.connectionTimeout' as a hint instead of 'spark.network.timeout' for lost connections

yaooqinn closed pull request #31990: URL: https://github.com/apache/spark/pull/31990 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [spark] SparkQA commented on pull request #31886: [SPARK-34795][SQL][TESTS] Adds a new job in GitHub Actions to check the output of TPC-DS queries

SparkQA commented on pull request #31886: URL: https://github.com/apache/spark/pull/31886#issuecomment-809846595 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41257/ -- This is an automated message from the

[GitHub] [spark] ulysses-you commented on pull request #31994: [SPARK-34899][SQL] Use origin plan if we can not coalesce shuffle partition

ulysses-you commented on pull request #31994: URL: https://github.com/apache/spark/pull/31994#issuecomment-809845264 We encounter this case during using aqe, but seems it is an expect behavior in previous test. Do you have any thought about this ? @maropu @cloud-fan @JkSelf -- This is

[GitHub] [spark] maropu commented on pull request #31739: [SPARK-34622][SQL] Push down limit through Project with Join

maropu commented on pull request #31739: URL: https://github.com/apache/spark/pull/31739#issuecomment-809842685 Thanks, all! Merged to master. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [spark] maropu closed pull request #31739: [SPARK-34622][SQL] Push down limit through Project with Join

maropu closed pull request #31739: URL: https://github.com/apache/spark/pull/31739 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [spark] SparkQA commented on pull request #31886: [SPARK-34795][SQL][TESTS] Adds a new job in GitHub Actions to check the output of TPC-DS queries

SparkQA commented on pull request #31886: URL: https://github.com/apache/spark/pull/31886#issuecomment-809839949 **[Test build #136678 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136678/testReport)** for PR 31886 at commit

[GitHub] [spark] SparkQA commented on pull request #31871: [SPARK-34779][CORE] ExecutoMetricsPoller should keep stage entry in stageTCMP until a heartbeat occurs

SparkQA commented on pull request #31871: URL: https://github.com/apache/spark/pull/31871#issuecomment-809839967 **[Test build #136679 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136679/testReport)** for PR 31871 at commit

[GitHub] [spark] SparkQA commented on pull request #31986: [SPARK-34888][SS] Introduce UpdatingSessionIterator adjusting session window on elements

SparkQA commented on pull request #31986: URL: https://github.com/apache/spark/pull/31986#issuecomment-809839890 **[Test build #136677 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136677/testReport)** for PR 31986 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29642: [SPARK-32792][SQL] Improve InSet filter pushdown

AmplabJenkins removed a comment on pull request #29642: URL: https://github.com/apache/spark/pull/29642#issuecomment-809839180 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41258/

[GitHub] [spark] AmplabJenkins commented on pull request #29642: [SPARK-32792][SQL] Improve InSet filter pushdown

AmplabJenkins commented on pull request #29642: URL: https://github.com/apache/spark/pull/29642#issuecomment-809839180 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41258/ --

[GitHub] [spark] SparkQA commented on pull request #29642: [SPARK-32792][SQL] Improve InSet filter pushdown

SparkQA commented on pull request #29642: URL: https://github.com/apache/spark/pull/29642#issuecomment-809836947 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41258/ -- This is an automated message from the

[GitHub] [spark] Ngone51 commented on pull request #31871: [SPARK-34779][CORE] ExecutoMetricsPoller should keep stage entry in stageTCMP until a heartbeat occurs

Ngone51 commented on pull request #31871: URL: https://github.com/apache/spark/pull/31871#issuecomment-809835258 retest this please -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] SparkQA commented on pull request #31886: [SPARK-34795][SQL][TESTS] Adds a new job in GitHub Actions to check the output of TPC-DS queries

SparkQA commented on pull request #31886: URL: https://github.com/apache/spark/pull/31886#issuecomment-809835202 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41257/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #29642: [SPARK-32792][SQL] Improve InSet filter pushdown

SparkQA commented on pull request #29642: URL: https://github.com/apache/spark/pull/29642#issuecomment-809833487 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41258/ -- This is an automated message from the Apache

[GitHub] [spark] HeartSaVioR commented on pull request #31986: [SPARK-34888][SS] Introduce UpdatingSessionIterator adjusting session window on elements

HeartSaVioR commented on pull request #31986: URL: https://github.com/apache/spark/pull/31986#issuecomment-809833095 retest this, please -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] maropu commented on a change in pull request #31886: [SPARK-34795][SQL][TESTS] Adds a new job in GitHub Actions to check the output of TPC-DS queries

maropu commented on a change in pull request #31886: URL: https://github.com/apache/spark/pull/31886#discussion_r603710170 ## File path: .github/workflows/build_and_test.yml ## @@ -428,3 +428,41 @@ jobs: - name: Build with SBT run: | ./build/sbt -Pyarn

[GitHub] [spark] github-actions[bot] closed pull request #29642: [SPARK-32792][SQL] Improve InSet filter pushdown

github-actions[bot] closed pull request #29642: URL: https://github.com/apache/spark/pull/29642 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this

[GitHub] [spark] github-actions[bot] closed pull request #30470: [SPARK-33495][BUILD] Remove commons-logging.jar's dependency

github-actions[bot] closed pull request #30470: URL: https://github.com/apache/spark/pull/30470 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this

[GitHub] [spark] github-actions[bot] closed pull request #30836: [SPARK-33791] Support hive legacy grouping id algorithm

github-actions[bot] closed pull request #30836: URL: https://github.com/apache/spark/pull/30836 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this

[GitHub] [spark] HeartSaVioR commented on pull request #31355: [SPARK-34255][SQL] Support partitioning with static number on required distribution and ordering on V2 write

HeartSaVioR commented on pull request #31355: URL: https://github.com/apache/spark/pull/31355#issuecomment-809823145 Thanks all for reviewing and merging! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [spark] AmplabJenkins commented on pull request #31932: [WIP] Introduce specialized traits for TreeNode children handling

AmplabJenkins commented on pull request #31932: URL: https://github.com/apache/spark/pull/31932#issuecomment-809820630 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41256/ --

[GitHub] [spark] SparkQA commented on pull request #31932: [WIP] Introduce specialized traits for TreeNode children handling

SparkQA commented on pull request #31932: URL: https://github.com/apache/spark/pull/31932#issuecomment-809820620 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41256/ -- This is an automated message from the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31932: [WIP] Introduce specialized traits for TreeNode children handling

AmplabJenkins removed a comment on pull request #31932: URL: https://github.com/apache/spark/pull/31932#issuecomment-809820630 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41256/

[GitHub] [spark] SparkQA commented on pull request #31932: [WIP] Introduce specialized traits for TreeNode children handling

SparkQA commented on pull request #31932: URL: https://github.com/apache/spark/pull/31932#issuecomment-809819206 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41256/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #29642: [SPARK-32792][SQL] Improve InSet filter pushdown

SparkQA commented on pull request #29642: URL: https://github.com/apache/spark/pull/29642#issuecomment-809818374 **[Test build #136676 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136676/testReport)** for PR 29642 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31666: [SPARK-34527][SQL] Resolve duplicated common columns from USING/NATURAL JOIN

AmplabJenkins removed a comment on pull request #31666: URL: https://github.com/apache/spark/pull/31666#issuecomment-809817643 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41255/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31936: [SPARK-34828][YARN] Make shuffle service name configurable on client side and allow for classpath-based config override on serv

AmplabJenkins removed a comment on pull request #31936: URL: https://github.com/apache/spark/pull/31936#issuecomment-809817642 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136670/

[GitHub] [spark] SparkQA commented on pull request #31886: [SPARK-34795][SQL][TESTS] Adds a new job in GitHub Actions to check the output of TPC-DS queries

SparkQA commented on pull request #31886: URL: https://github.com/apache/spark/pull/31886#issuecomment-809818101 **[Test build #136675 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136675/testReport)** for PR 31886 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #31936: [SPARK-34828][YARN] Make shuffle service name configurable on client side and allow for classpath-based config override on server side

AmplabJenkins commented on pull request #31936: URL: https://github.com/apache/spark/pull/31936#issuecomment-809817642 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136670/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #31666: [SPARK-34527][SQL] Resolve duplicated common columns from USING/NATURAL JOIN

AmplabJenkins commented on pull request #31666: URL: https://github.com/apache/spark/pull/31666#issuecomment-809817643 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41255/ --

[GitHub] [spark] SparkQA commented on pull request #31666: [SPARK-34527][SQL] Resolve duplicated common columns from USING/NATURAL JOIN

SparkQA commented on pull request #31666: URL: https://github.com/apache/spark/pull/31666#issuecomment-809812284 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41255/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #31666: [SPARK-34527][SQL] Resolve duplicated common columns from USING/NATURAL JOIN

SparkQA commented on pull request #31666: URL: https://github.com/apache/spark/pull/31666#issuecomment-809811391 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41255/ -- This is an automated message from the Apache

[GitHub] [spark] maropu commented on a change in pull request #31886: [SPARK-34795][SQL][TESTS] Adds a new job in GitHub Actions to check the output of TPC-DS queries

maropu commented on a change in pull request #31886: URL: https://github.com/apache/spark/pull/31886#discussion_r603695607 ## File path: .github/workflows/build_and_test.yml ## @@ -428,3 +428,41 @@ jobs: - name: Build with SBT run: | ./build/sbt -Pyarn

[GitHub] [spark] maropu commented on a change in pull request #31886: [SPARK-34795][SQL][TESTS] Adds a new job in GitHub Actions to check the output of TPC-DS queries

maropu commented on a change in pull request #31886: URL: https://github.com/apache/spark/pull/31886#discussion_r603695472 ## File path: .github/workflows/build_and_test.yml ## @@ -428,3 +428,41 @@ jobs: - name: Build with SBT run: | ./build/sbt -Pyarn

[GitHub] [spark] SparkQA removed a comment on pull request #31936: [SPARK-34828][YARN] Make shuffle service name configurable on client side and allow for classpath-based config override on server sid

SparkQA removed a comment on pull request #31936: URL: https://github.com/apache/spark/pull/31936#issuecomment-809740666 **[Test build #136670 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136670/testReport)** for PR 31936 at commit

<    1   2   3   4   5   6   7   >