[GitHub] [spark] cloud-fan commented on a change in pull request #30222: [SPARK-33315][SQL] Simplify CaseWhen with EqualTo

cloud-fan commented on a change in pull request #30222: URL: https://github.com/apache/spark/pull/30222#discussion_r517094786 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/expressions.scala ## @@ -510,6 +510,10 @@ object SimplifyConditionals

[GitHub] [spark] cloud-fan commented on a change in pull request #30222: [SPARK-33315][SQL] Simplify CaseWhen with EqualTo

cloud-fan commented on a change in pull request #30222: URL: https://github.com/apache/spark/pull/30222#discussion_r517093766 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/expressions.scala ## @@ -510,6 +510,10 @@ object SimplifyConditionals

[GitHub] [spark] cloud-fan commented on pull request #30156: [SPARK-33248][SQL] Add a configuration to control the legacy behavior of whether need to pad null value when value size less then schema si

cloud-fan commented on pull request #30156: URL: https://github.com/apache/spark/pull/30156#issuecomment-721505923 reverted This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30242: [SPARK-33277][PYSPARK][SQL][FOLLOW-UP] Block TaskCompletion event until the thread ends.

SparkQA commented on pull request #30242: URL: https://github.com/apache/spark/pull/30242#issuecomment-721504806 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35189/ -

[GitHub] [spark] SparkQA commented on pull request #30166: [SPARK-33265][TEST] Rename classOf[Seq] to classOf[scala.collection.Seq] in PostgresIntegrationSuite for Scala 2.13

SparkQA commented on pull request #30166: URL: https://github.com/apache/spark/pull/30166#issuecomment-721503915 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35187/ ---

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30166: [SPARK-33265][TEST] Rename classOf[Seq] to classOf[scala.collection.Seq] in PostgresIntegrationSuite for Scala 2.13

AmplabJenkins removed a comment on pull request #30166: URL: https://github.com/apache/spark/pull/30166#issuecomment-721503925 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30166: [SPARK-33265][TEST] Rename classOf[Seq] to classOf[scala.collection.Seq] in PostgresIntegrationSuite for Scala 2.13

AmplabJenkins commented on pull request #30166: URL: https://github.com/apache/spark/pull/30166#issuecomment-721503925 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #30122: [SPARK-33214][TEST][HIVE] Stop HiveExternalCatalogVersionsSuite from using a hard-coded location to store localized Spark binaries.

SparkQA commented on pull request #30122: URL: https://github.com/apache/spark/pull/30122#issuecomment-721503154 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35188/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30242: [SPARK-33277][PYSPARK][SQL][FOLLOW-UP] Block TaskCompletion event until the thread ends.

AmplabJenkins removed a comment on pull request #30242: URL: https://github.com/apache/spark/pull/30242#issuecomment-721501611 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30242: [SPARK-33277][PYSPARK][SQL][FOLLOW-UP] Block TaskCompletion event until the thread ends.

AmplabJenkins commented on pull request #30242: URL: https://github.com/apache/spark/pull/30242#issuecomment-721501611 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #30242: [SPARK-33277][PYSPARK][SQL][FOLLOW-UP] Block TaskCompletion event until the thread ends.

SparkQA commented on pull request #30242: URL: https://github.com/apache/spark/pull/30242#issuecomment-721501598 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35186/ ---

[GitHub] [spark] SparkQA commented on pull request #30243: [SPARK-33335][SQL] Support `array_contains_array` func

SparkQA commented on pull request #30243: URL: https://github.com/apache/spark/pull/30243#issuecomment-721500664 **[Test build #130590 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130590/testReport)** for PR 30243 at commit [`789d2ec`](https://github.com

[GitHub] [spark] AngersZhuuuu opened a new pull request #30243: [SPARK-33335][SQL] Support `array_contains_array` func

AngersZh opened a new pull request #30243: URL: https://github.com/apache/spark/pull/30243 ### What changes were proposed in this pull request? Support `array_contains_array` function ### Why are the changes needed? Provide more flexible Array functions ### Do

[GitHub] [spark] SparkQA commented on pull request #30166: [SPARK-33265][TEST] Rename classOf[Seq] to classOf[scala.collection.Seq] in PostgresIntegrationSuite for Scala 2.13

SparkQA commented on pull request #30166: URL: https://github.com/apache/spark/pull/30166#issuecomment-721498905 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35187/ -

[GitHub] [spark] gatorsmile commented on a change in pull request #30187: [SPARK-33290][SQL] REFRESH TABLE should invalidate cache even though the table itself may not be cached

gatorsmile commented on a change in pull request #30187: URL: https://github.com/apache/spark/pull/30187#discussion_r517084478 ## File path: sql/core/src/main/scala/org/apache/spark/sql/internal/CatalogImpl.scala ## @@ -524,14 +527,17 @@ class CatalogImpl(sparkSession: SparkSe

[GitHub] [spark] gatorsmile commented on a change in pull request #30187: [SPARK-33290][SQL] REFRESH TABLE should invalidate cache even though the table itself may not be cached

gatorsmile commented on a change in pull request #30187: URL: https://github.com/apache/spark/pull/30187#discussion_r517084348 ## File path: sql/core/src/main/scala/org/apache/spark/sql/internal/CatalogImpl.scala ## @@ -504,6 +504,9 @@ class CatalogImpl(sparkSession: SparkSess

[GitHub] [spark] dongjoon-hyun commented on pull request #30182: [SPARK-33284][WEB-UI] In the Storage UI page, clicking any field to sort the table will cause the header content to be lost

dongjoon-hyun commented on pull request #30182: URL: https://github.com/apache/spark/pull/30182#issuecomment-721497436 Thank you, @akiyamaneko and @srowen ! This is an automated message from the Apache Git Service. To respond

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30166: [SPARK-33265][TEST] Rename classOf[Seq] to classOf[scala.collection.Seq] in PostgresIntegrationSuite for Scala 2.13

AmplabJenkins removed a comment on pull request #30166: URL: https://github.com/apache/spark/pull/30166#issuecomment-721496875 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #30242: [SPARK-33277][PYSPARK][SQL][FOLLOW-UP] Block TaskCompletion event until the thread ends.

SparkQA commented on pull request #30242: URL: https://github.com/apache/spark/pull/30242#issuecomment-721496878 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35186/ -

[GitHub] [spark] AmplabJenkins commented on pull request #30166: [SPARK-33265][TEST] Rename classOf[Seq] to classOf[scala.collection.Seq] in PostgresIntegrationSuite for Scala 2.13

AmplabJenkins commented on pull request #30166: URL: https://github.com/apache/spark/pull/30166#issuecomment-721496875 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #30166: [SPARK-33265][TEST] Rename classOf[Seq] to classOf[scala.collection.Seq] in PostgresIntegrationSuite for Scala 2.13

SparkQA removed a comment on pull request #30166: URL: https://github.com/apache/spark/pull/30166#issuecomment-721458944 **[Test build #130583 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130583/testReport)** for PR 30166 at commit [`d0decd8`](https://gi

[GitHub] [spark] SparkQA commented on pull request #30166: [SPARK-33265][TEST] Rename classOf[Seq] to classOf[scala.collection.Seq] in PostgresIntegrationSuite for Scala 2.13

SparkQA commented on pull request #30166: URL: https://github.com/apache/spark/pull/30166#issuecomment-721496354 **[Test build #130583 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130583/testReport)** for PR 30166 at commit [`d0decd8`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #30242: [SPARK-33277][PYSPARK][SQL][FOLLOW-UP] Block TaskCompletion event until the thread ends.

SparkQA commented on pull request #30242: URL: https://github.com/apache/spark/pull/30242#issuecomment-721495624 **[Test build #130589 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130589/testReport)** for PR 30242 at commit [`895d91d`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28027: [SPARK-31255][SQL] Add SupportsMetadataColumns to DSv2

AmplabJenkins removed a comment on pull request #28027: URL: https://github.com/apache/spark/pull/28027#issuecomment-721495040 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28027: [SPARK-31255][SQL] Add SupportsMetadataColumns to DSv2

AmplabJenkins commented on pull request #28027: URL: https://github.com/apache/spark/pull/28027#issuecomment-721495040 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #28027: [SPARK-31255][SQL] Add SupportsMetadataColumns to DSv2

SparkQA removed a comment on pull request #28027: URL: https://github.com/apache/spark/pull/28027#issuecomment-721424926 **[Test build #130577 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130577/testReport)** for PR 28027 at commit [`d661246`](https://gi

[GitHub] [spark] LuciferYang edited a comment on pull request #30234: [SPARK-33285][CORE][SQL] Fix deprecated compilation warnings of "Auto-application to () is deprecated" in Scala 2.13

LuciferYang edited a comment on pull request #30234: URL: https://github.com/apache/spark/pull/30234#issuecomment-721478599 @dongjoon-hyun > After this PR, do we have a way to prevent this compilation warnings? It seems that there is no such way now. > However, shall we pos

[GitHub] [spark] SparkQA commented on pull request #28027: [SPARK-31255][SQL] Add SupportsMetadataColumns to DSv2

SparkQA commented on pull request #28027: URL: https://github.com/apache/spark/pull/28027#issuecomment-721494538 **[Test build #130577 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130577/testReport)** for PR 28027 at commit [`d661246`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30122: [SPARK-33214][TEST][HIVE] Stop HiveExternalCatalogVersionsSuite from using a hard-coded location to store localized Spark binar

AmplabJenkins removed a comment on pull request #30122: URL: https://github.com/apache/spark/pull/30122#issuecomment-713901791 Can one of the admins verify this patch? This is an automated message from the Apache Git Service.

[GitHub] [spark] SparkQA commented on pull request #30122: [SPARK-33214][TEST][HIVE] Stop HiveExternalCatalogVersionsSuite from using a hard-coded location to store localized Spark binaries.

SparkQA commented on pull request #30122: URL: https://github.com/apache/spark/pull/30122#issuecomment-721493878 **[Test build #130588 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130588/testReport)** for PR 30122 at commit [`c56cf1f`](https://github.com

[GitHub] [spark] cloud-fan commented on pull request #30122: [SPARK-33214][TEST][HIVE] Stop HiveExternalCatalogVersionsSuite from using a hard-coded location to store localized Spark binaries.

cloud-fan commented on pull request #30122: URL: https://github.com/apache/spark/pull/30122#issuecomment-721493578 ok to test This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] HyukjinKwon commented on pull request #30156: [SPARK-33248][SQL] Add a configuration to control the legacy behavior of whether need to pad null value when value size less then schema

HyukjinKwon commented on pull request #30156: URL: https://github.com/apache/spark/pull/30156#issuecomment-721493201 Okay, I am fine with it. This is an automated message from the Apache Git Service. To respond to the message

[GitHub] [spark] cloud-fan commented on pull request #30156: [SPARK-33248][SQL] Add a configuration to control the legacy behavior of whether need to pad null value when value size less then schema si

cloud-fan commented on pull request #30156: URL: https://github.com/apache/spark/pull/30156#issuecomment-721492321 According to https://github.com/apache/spark/pull/30202#discussion_r515721010 , I'm going to revert it. This

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30242: [SPARK-33277][PYSPARK][SQL][FOLLOW-UP] Block TaskCompletion event until the thread ends.

AmplabJenkins removed a comment on pull request #30242: URL: https://github.com/apache/spark/pull/30242#issuecomment-721489667 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30221: [SPARK-33314][SQL] Avoid dropping rows in Avro reader

AmplabJenkins removed a comment on pull request #30221: URL: https://github.com/apache/spark/pull/30221#issuecomment-721489505 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30242: [SPARK-33277][PYSPARK][SQL][FOLLOW-UP] Block TaskCompletion event until the thread ends.

AmplabJenkins commented on pull request #30242: URL: https://github.com/apache/spark/pull/30242#issuecomment-721489667 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #30221: [SPARK-33314][SQL] Avoid dropping rows in Avro reader

AmplabJenkins commented on pull request #30221: URL: https://github.com/apache/spark/pull/30221#issuecomment-721489505 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #30242: [SPARK-33277][PYSPARK][SQL][FOLLOW-UP] Block TaskCompletion event until the thread ends.

SparkQA commented on pull request #30242: URL: https://github.com/apache/spark/pull/30242#issuecomment-721489661 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35185/ ---

[GitHub] [spark] SparkQA removed a comment on pull request #30221: [SPARK-33314][SQL] Avoid dropping rows in Avro reader

SparkQA removed a comment on pull request #30221: URL: https://github.com/apache/spark/pull/30221#issuecomment-721483003 **[Test build #130585 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130585/testReport)** for PR 30221 at commit [`134c12c`](https://gi

[GitHub] [spark] SparkQA commented on pull request #30221: [SPARK-33314][SQL] Avoid dropping rows in Avro reader

SparkQA commented on pull request #30221: URL: https://github.com/apache/spark/pull/30221#issuecomment-721489287 **[Test build #130585 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130585/testReport)** for PR 30221 at commit [`134c12c`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #30166: [SPARK-33265][TEST] Rename classOf[Seq] to classOf[scala.collection.Seq] in PostgresIntegrationSuite for Scala 2.13

SparkQA commented on pull request #30166: URL: https://github.com/apache/spark/pull/30166#issuecomment-721488609 **[Test build #130587 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130587/testReport)** for PR 30166 at commit [`d0decd8`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29247: [SPARK-32446][SHS] Add new executor metrics summary REST APIs

AmplabJenkins removed a comment on pull request #29247: URL: https://github.com/apache/spark/pull/29247#issuecomment-721487435 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29247: [SPARK-32446][SHS] Add new executor metrics summary REST APIs

AmplabJenkins commented on pull request #29247: URL: https://github.com/apache/spark/pull/29247#issuecomment-721487435 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30186: [SPARK-23432][UI] Add executor peak jvm memory metrics in executors page

AmplabJenkins removed a comment on pull request #30186: URL: https://github.com/apache/spark/pull/30186#issuecomment-721486851 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] sarutak commented on pull request #30166: [SPARK-33265][TEST] Rename classOf[Seq] to classOf[scala.collection.Seq] in PostgresIntegrationSuite for Scala 2.13

sarutak commented on pull request #30166: URL: https://github.com/apache/spark/pull/30166#issuecomment-721487034 retest this please. This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] SparkQA removed a comment on pull request #29247: [SPARK-32446][SHS] Add new executor metrics summary REST APIs

SparkQA removed a comment on pull request #29247: URL: https://github.com/apache/spark/pull/29247#issuecomment-721445300 **[Test build #130581 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130581/testReport)** for PR 29247 at commit [`5a55030`](https://gi

[GitHub] [spark] SparkQA commented on pull request #30242: [SPARK-33277][PYSPARK][SQL][FOLLOW-UP] Block TaskCompletion event until the thread ends.

SparkQA commented on pull request #30242: URL: https://github.com/apache/spark/pull/30242#issuecomment-721486742 **[Test build #130586 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130586/testReport)** for PR 30242 at commit [`6e5be90`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #30186: [SPARK-23432][UI] Add executor peak jvm memory metrics in executors page

AmplabJenkins commented on pull request #30186: URL: https://github.com/apache/spark/pull/30186#issuecomment-721486851 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29247: [SPARK-32446][SHS] Add new executor metrics summary REST APIs

SparkQA commented on pull request #29247: URL: https://github.com/apache/spark/pull/29247#issuecomment-721486921 **[Test build #130581 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130581/testReport)** for PR 29247 at commit [`5a55030`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #30186: [SPARK-23432][UI] Add executor peak jvm memory metrics in executors page

SparkQA removed a comment on pull request #30186: URL: https://github.com/apache/spark/pull/30186#issuecomment-721445258 **[Test build #130580 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130580/testReport)** for PR 30186 at commit [`30da8f1`](https://gi

[GitHub] [spark] SparkQA commented on pull request #30186: [SPARK-23432][UI] Add executor peak jvm memory metrics in executors page

SparkQA commented on pull request #30186: URL: https://github.com/apache/spark/pull/30186#issuecomment-721486339 **[Test build #130580 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130580/testReport)** for PR 30186 at commit [`30da8f1`](https://github.co

[GitHub] [spark] cloud-fan commented on a change in pull request #30079: [SPARK-33174][SQL] Migrate DROP TABLE to use UnresolvedTableOrView to resolve the identifier

cloud-fan commented on a change in pull request #30079: URL: https://github.com/apache/spark/pull/30079#discussion_r517072152 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/DataSourceV2Strategy.scala ## @@ -228,8 +228,11 @@ class DataSource

[GitHub] [spark] SparkQA commented on pull request #30221: [SPARK-33314][SQL] Avoid dropping rows in Avro reader

SparkQA commented on pull request #30221: URL: https://github.com/apache/spark/pull/30221#issuecomment-721483003 **[Test build #130585 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130585/testReport)** for PR 30221 at commit [`134c12c`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30240: [SPARK-33333][BUILD][3.0] Upgrade Jetty to 9.4.28.v20200408

AmplabJenkins removed a comment on pull request #30240: URL: https://github.com/apache/spark/pull/30240#issuecomment-721482818 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30240: [SPARK-33333][BUILD][3.0] Upgrade Jetty to 9.4.28.v20200408

AmplabJenkins commented on pull request #30240: URL: https://github.com/apache/spark/pull/30240#issuecomment-721482818 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #30242: [SPARK-33277][PYSPARK][SQL][FOLLOW-UP] Block TaskCompletion event until the thread ends.

SparkQA commented on pull request #30242: URL: https://github.com/apache/spark/pull/30242#issuecomment-721482247 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35185/ -

[GitHub] [spark] SparkQA removed a comment on pull request #30240: [SPARK-33333][BUILD][3.0] Upgrade Jetty to 9.4.28.v20200408

SparkQA removed a comment on pull request #30240: URL: https://github.com/apache/spark/pull/30240#issuecomment-721436241 **[Test build #130579 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130579/testReport)** for PR 30240 at commit [`e3c6722`](https://gi

[GitHub] [spark] SparkQA commented on pull request #30240: [SPARK-33333][BUILD][3.0] Upgrade Jetty to 9.4.28.v20200408

SparkQA commented on pull request #30240: URL: https://github.com/apache/spark/pull/30240#issuecomment-721482137 **[Test build #130579 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130579/testReport)** for PR 30240 at commit [`e3c6722`](https://github.co

[GitHub] [spark] LuciferYang edited a comment on pull request #30234: [SPARK-33285][CORE][SQL] Fix deprecated compilation warnings of "Auto-application to () is deprecated" in Scala 2.13

LuciferYang edited a comment on pull request #30234: URL: https://github.com/apache/spark/pull/30234#issuecomment-721478599 > After this PR, do we have a way to prevent this compilation warnings? It seems that there is no such way now. > However, shall we postpone this until Sc

[GitHub] [spark] LuciferYang commented on pull request #30234: [SPARK-33285][CORE][SQL] Fix deprecated compilation warnings of "Auto-application to () is deprecated" in Scala 2.13

LuciferYang commented on pull request #30234: URL: https://github.com/apache/spark/pull/30234#issuecomment-721478599 > After this PR, do we have a way to prevent this compilation warnings? It seems that there is no such way now. > However, shall we postpone this until Scala 2.1

[GitHub] [spark] LuciferYang edited a comment on pull request #30234: [SPARK-33285][CORE][SQL] Fix deprecated compilation warnings of "Auto-application to () is deprecated" in Scala 2.13

LuciferYang edited a comment on pull request #30234: URL: https://github.com/apache/spark/pull/30234#issuecomment-721478599 @dongjoon-hyun > After this PR, do we have a way to prevent this compilation warnings? It seems that there is no such way now. > However, shall we pos

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30166: [SPARK-33265][TEST] Rename classOf[Seq] to classOf[scala.collection.Seq] in PostgresIntegrationSuite for Scala 2.13

AmplabJenkins removed a comment on pull request #30166: URL: https://github.com/apache/spark/pull/30166#issuecomment-721475127 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30166: [SPARK-33265][TEST] Rename classOf[Seq] to classOf[scala.collection.Seq] in PostgresIntegrationSuite for Scala 2.13

AmplabJenkins removed a comment on pull request #30166: URL: https://github.com/apache/spark/pull/30166#issuecomment-721475125 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins commented on pull request #30166: [SPARK-33265][TEST] Rename classOf[Seq] to classOf[scala.collection.Seq] in PostgresIntegrationSuite for Scala 2.13

AmplabJenkins commented on pull request #30166: URL: https://github.com/apache/spark/pull/30166#issuecomment-721475125 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #30166: [SPARK-33265][TEST] Rename classOf[Seq] to classOf[scala.collection.Seq] in PostgresIntegrationSuite for Scala 2.13

SparkQA commented on pull request #30166: URL: https://github.com/apache/spark/pull/30166#issuecomment-721475118 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35184/ ---

[GitHub] [spark] wangyum commented on pull request #30222: [SPARK-33315][SQL] Simplify CaseWhen with EqualTo

wangyum commented on pull request #30222: URL: https://github.com/apache/spark/pull/30222#issuecomment-721474620 Hive optimized it to `predicate: CASE WHEN ((a = 100)) THEN (false) WHEN ((b > 1000)) THEN (true) WHEN (c is not null) THEN (false) ELSE (null) END (type: boolean)`. But this co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30242: [SPARK-33277][PYSPARK][SQL][FOLLOW-UP] Block TaskCompletion event until the thread ends.

AmplabJenkins removed a comment on pull request #30242: URL: https://github.com/apache/spark/pull/30242#issuecomment-721471188 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #30242: [SPARK-33277][PYSPARK][SQL][FOLLOW-UP] Block TaskCompletion event until the thread ends.

SparkQA commented on pull request #30242: URL: https://github.com/apache/spark/pull/30242#issuecomment-721472000 **[Test build #130584 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130584/testReport)** for PR 30242 at commit [`2a0d2af`](https://github.com

[GitHub] [spark] HyukjinKwon commented on pull request #30071: [SPARK-33172][SQL] Adding support for UserDefinedType for Spark SQL Code generator

HyukjinKwon commented on pull request #30071: URL: https://github.com/apache/spark/pull/30071#issuecomment-721471134 @davidrabinowitz, yes the PR should target the master, and it will be assessed further if it should be ported back or not. cc @gengliangwang FYI since he knows big query con

[GitHub] [spark] AmplabJenkins commented on pull request #30242: [SPARK-33277][PYSPARK][SQL][FOLLOW-UP] Block TaskCompletion event until the thread ends.

AmplabJenkins commented on pull request #30242: URL: https://github.com/apache/spark/pull/30242#issuecomment-721471188 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #30242: [SPARK-33277][PYSPARK][SQL][FOLLOW-UP] Block TaskCompletion event until the thread ends.

SparkQA commented on pull request #30242: URL: https://github.com/apache/spark/pull/30242#issuecomment-721471177 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35183/ ---

[GitHub] [spark] SparkQA commented on pull request #30166: [SPARK-33265][TEST] Rename classOf[Seq] to classOf[scala.collection.Seq] in PostgresIntegrationSuite for Scala 2.13

SparkQA commented on pull request #30166: URL: https://github.com/apache/spark/pull/30166#issuecomment-721469312 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35184/ -

[GitHub] [spark] SparkQA commented on pull request #30242: [SPARK-33277][PYSPARK][SQL][FOLLOW-UP] Block TaskCompletion event until the thread ends.

SparkQA commented on pull request #30242: URL: https://github.com/apache/spark/pull/30242#issuecomment-721465641 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35183/ -

[GitHub] [spark] HyukjinKwon commented on pull request #30236: [SPARK-33330][SQL] Add support for Enums on CatalystTypeConverters

HyukjinKwon commented on pull request #30236: URL: https://github.com/apache/spark/pull/30236#issuecomment-721465551 `CatalystTypeConverters` is internal. Does it affect any user-facing behaviour? This is an automated messag

[GitHub] [spark] HyukjinKwon commented on a change in pull request #30206: [SPARK-33261][K8S] Add a developer API for custom feature steps

HyukjinKwon commented on a change in pull request #30206: URL: https://github.com/apache/spark/pull/30206#discussion_r517051642 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features/KubernetesFeatureConfigStep.scala ## @@ -18,13 +1

[GitHub] [spark] HyukjinKwon commented on a change in pull request #30206: [SPARK-33261][K8S] Add a developer API for custom feature steps

HyukjinKwon commented on a change in pull request #30206: URL: https://github.com/apache/spark/pull/30206#discussion_r517051642 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features/KubernetesFeatureConfigStep.scala ## @@ -18,13 +1

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29247: [SPARK-32446][SHS] Add new executor metrics summary REST APIs

AmplabJenkins removed a comment on pull request #29247: URL: https://github.com/apache/spark/pull/29247#issuecomment-721464145 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8

[GitHub] [spark] SparkQA commented on pull request #29247: [SPARK-32446][SHS] Add new executor metrics summary REST APIs

SparkQA commented on pull request #29247: URL: https://github.com/apache/spark/pull/29247#issuecomment-721464131 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35182/ ---

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29247: [SPARK-32446][SHS] Add new executor metrics summary REST APIs

AmplabJenkins removed a comment on pull request #29247: URL: https://github.com/apache/spark/pull/29247#issuecomment-721464141 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins commented on pull request #29247: [SPARK-32446][SHS] Add new executor metrics summary REST APIs

AmplabJenkins commented on pull request #29247: URL: https://github.com/apache/spark/pull/29247#issuecomment-721464141 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30186: [SPARK-23432][UI] Add executor peak jvm memory metrics in executors page

AmplabJenkins removed a comment on pull request #30186: URL: https://github.com/apache/spark/pull/30186#issuecomment-721463836 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #30186: [SPARK-23432][UI] Add executor peak jvm memory metrics in executors page

SparkQA commented on pull request #30186: URL: https://github.com/apache/spark/pull/30186#issuecomment-721463826 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35181/ ---

[GitHub] [spark] AmplabJenkins commented on pull request #30186: [SPARK-23432][UI] Add executor peak jvm memory metrics in executors page

AmplabJenkins commented on pull request #30186: URL: https://github.com/apache/spark/pull/30186#issuecomment-721463836 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] ulysses-you commented on pull request #30230: [SPARK-33323][SQL] Add query resolved check before convert hive relation

ulysses-you commented on pull request #30230: URL: https://github.com/apache/spark/pull/30230#issuecomment-721460283 Similar with [30197](https://github.com/apache/spark/pull/30197), cc @maropu @cloud-fan @dongjoon-hyun Th

[GitHub] [spark] SparkQA commented on pull request #30166: [SPARK-33265][TEST] Rename classOf[Seq] to classOf[scala.collection.Seq] in PostgresIntegrationSuite for Scala 2.13

SparkQA commented on pull request #30166: URL: https://github.com/apache/spark/pull/30166#issuecomment-721458944 **[Test build #130583 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130583/testReport)** for PR 30166 at commit [`d0decd8`](https://github.com

[GitHub] [spark] dongjoon-hyun closed pull request #30241: [SPARK-33333][BUILD][2.4] Upgrade Jetty to 9.4.28.v20200408

dongjoon-hyun closed pull request #30241: URL: https://github.com/apache/spark/pull/30241 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] sarutak commented on pull request #30166: [SPARK-33265][TEST] Rename classOf[Seq] to classOf[scala.collection.Seq] in PostgresIntegrationSuite for Scala 2.13

sarutak commented on pull request #30166: URL: https://github.com/apache/spark/pull/30166#issuecomment-721458254 retest this please. This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] SparkQA commented on pull request #29247: [SPARK-32446][SHS] Add new executor metrics summary REST APIs

SparkQA commented on pull request #29247: URL: https://github.com/apache/spark/pull/29247#issuecomment-721457819 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35182/ -

[GitHub] [spark] rdblue commented on pull request #28026: [SPARK-31257][SQL] Unify create table syntax

rdblue commented on pull request #28026: URL: https://github.com/apache/spark/pull/28026#issuecomment-721457323 Thanks for taking a look, @cloud-fan. I should have time to look through your comments and apply them this week.

[GitHub] [spark] rdblue commented on a change in pull request #28026: [SPARK-31257][SQL] Unify create table syntax

rdblue commented on a change in pull request #28026: URL: https://github.com/apache/spark/pull/28026#discussion_r517043635 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/connector/catalog/CatalogV2Util.scala ## @@ -295,18 +295,61 @@ private[sql] object CatalogV

[GitHub] [spark] SparkQA commented on pull request #30186: [SPARK-23432][UI] Add executor peak jvm memory metrics in executors page

SparkQA commented on pull request #30186: URL: https://github.com/apache/spark/pull/30186#issuecomment-721455869 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35181/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30240: [SPARK-33333][BUILD][3.0] Upgrade Jetty to 9.4.28.v20200408

AmplabJenkins removed a comment on pull request #30240: URL: https://github.com/apache/spark/pull/30240#issuecomment-721455023 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30240: [SPARK-33333][BUILD][3.0] Upgrade Jetty to 9.4.28.v20200408

AmplabJenkins removed a comment on pull request #30240: URL: https://github.com/apache/spark/pull/30240#issuecomment-721455017 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins commented on pull request #30240: [SPARK-33333][BUILD][3.0] Upgrade Jetty to 9.4.28.v20200408

AmplabJenkins commented on pull request #30240: URL: https://github.com/apache/spark/pull/30240#issuecomment-721455017 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #30240: [SPARK-33333][BUILD][3.0] Upgrade Jetty to 9.4.28.v20200408

SparkQA commented on pull request #30240: URL: https://github.com/apache/spark/pull/30240#issuecomment-721455004 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35180/ ---

[GitHub] [spark] SparkQA commented on pull request #30242: [SPARK-33277][PYSPARK][SQL][FOLLOW-UP] Block TaskCompletion event until the thread ends.

SparkQA commented on pull request #30242: URL: https://github.com/apache/spark/pull/30242#issuecomment-721452935 **[Test build #130582 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130582/testReport)** for PR 30242 at commit [`3f96145`](https://github.com

[GitHub] [spark] ueshin opened a new pull request #30242: [SPARK-33277][PYSPARK][SQL][FOLLOW-UP] Block TaskCompletion event until the thread ends.

ueshin opened a new pull request #30242: URL: https://github.com/apache/spark/pull/30242 ### What changes were proposed in this pull request? This is a follow-up of #30177. Makes `TaskCompletion` event thread wait until the thread ends to avoid the race condition. ### W

[GitHub] [spark] HyukjinKwon commented on pull request #30232: [SPARK-33156][INFRA][2.4] Upgrade GithubAction image from 18.04 to 20.04

HyukjinKwon commented on pull request #30232: URL: https://github.com/apache/spark/pull/30232#issuecomment-721450482 Nice, thanks. This is an automated message from the Apache Git Service. To respond to the message, please lo

[GitHub] [spark] SparkQA commented on pull request #30240: [SPARK-33333][BUILD][3.0] Upgrade Jetty to 9.4.28.v20200408

SparkQA commented on pull request #30240: URL: https://github.com/apache/spark/pull/30240#issuecomment-721448188 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35180/ -

[GitHub] [spark] github-actions[bot] commented on pull request #26783: [SPARK-30153][PYTHON][WIP] Extend data exchange options for vectorized UDF functions with vanilla Arrow serialization

github-actions[bot] commented on pull request #26783: URL: https://github.com/apache/spark/pull/26783#issuecomment-721447682 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue ma

<    1   2   3   4   5   6   7   >