[GitHub] [spark] AmplabJenkins commented on pull request #30959: [SPARK-33931][INFRA] Recover GitHub Action `build_and_test` job

AmplabJenkins commented on pull request #30959: URL: https://github.com/apache/spark/pull/30959#issuecomment-751986676 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/38057/

[GitHub] [spark] AmplabJenkins commented on pull request #30212: [SPARK-33308][SQL] Refactor current grouping analytics

AmplabJenkins commented on pull request #30212: URL: https://github.com/apache/spark/pull/30212#issuecomment-751986674 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/38061/

[GitHub] [spark] AmplabJenkins commented on pull request #30958: [SPARK-33930][SQL] Spark SQL no serde row format field delimit default value is '\u0001'

AmplabJenkins commented on pull request #30958: URL: https://github.com/apache/spark/pull/30958#issuecomment-751986675 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/38058/

[GitHub] [spark] SparkQA commented on pull request #30955: [SPARK-33848][SQL][FOLLOWUP] Introduce allowList for push into (if / case) branches

SparkQA commented on pull request #30955: URL: https://github.com/apache/spark/pull/30955#issuecomment-751985919 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/38064/

[GitHub] [spark] SparkQA commented on pull request #30959: [SPARK-33931][INFRA] Recover GitHub Action `build_and_test` job

SparkQA commented on pull request #30959: URL: https://github.com/apache/spark/pull/30959#issuecomment-751985845 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/38063/

[GitHub] [spark] cloud-fan commented on a change in pull request #30905: [SPARK-33890][SQL] Improve the implement of trim/trimleft/trimright

cloud-fan commented on a change in pull request #30905: URL: https://github.com/apache/spark/pull/30905#discussion_r549605431 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala ## @@ -756,6 +756,54 @@ trait

[GitHub] [spark] SparkQA commented on pull request #30315: [SPARK-33388][SQL] Merge In and InSet predicate

SparkQA commented on pull request #30315: URL: https://github.com/apache/spark/pull/30315#issuecomment-751985404 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/38065/

[GitHub] [spark] cloud-fan commented on a change in pull request #30905: [SPARK-33890][SQL] Improve the implement of trim/trimleft/trimright

cloud-fan commented on a change in pull request #30905: URL: https://github.com/apache/spark/pull/30905#discussion_r549604882 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala ## @@ -756,6 +756,54 @@ trait

[GitHub] [spark] wangyum commented on pull request #30960: [SPARK-33847][SQL][FOLLOWUP] Remove the CaseWhen should consider deterministic

wangyum commented on pull request #30960: URL: https://github.com/apache/spark/pull/30960#issuecomment-751984460 cc @cloud-fan This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [spark] wangyum opened a new pull request #30960: [SPARK-33847][SQL][FOLLOWUP] Remove the CaseWhen should consider deterministic

wangyum opened a new pull request #30960: URL: https://github.com/apache/spark/pull/30960 ### What changes were proposed in this pull request? This pr fix remove the CaseWhen if elseValue is empty and other outputs are null because of we should consider deterministic. ### Why

[GitHub] [spark] cloud-fan commented on a change in pull request #30947: [SPARK-33926][SQL] Improve the error message in resolving of DSv1 multi-part identifiers

cloud-fan commented on a change in pull request #30947: URL: https://github.com/apache/spark/pull/30947#discussion_r549603691 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/connector/catalog/CatalogV2Implicits.scala ## @@ -118,7 +118,7 @@ private[sql] object

[GitHub] [spark] cloud-fan commented on pull request #30935: [SPARK-33859][SQL] Support V2 ALTER TABLE .. RENAME PARTITION

cloud-fan commented on pull request #30935: URL: https://github.com/apache/spark/pull/30935#issuecomment-751983972 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] cloud-fan closed pull request #30935: [SPARK-33859][SQL] Support V2 ALTER TABLE .. RENAME PARTITION

cloud-fan closed pull request #30935: URL: https://github.com/apache/spark/pull/30935 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [spark] cloud-fan commented on a change in pull request #30881: [SPARK-33875][SQL] Implement DESCRIBE COLUMN for v2 tables

cloud-fan commented on a change in pull request #30881: URL: https://github.com/apache/spark/pull/30881#discussion_r549602461 ## File path: sql/core/src/main/scala/org/apache/spark/sql/catalyst/analysis/ResolveSessionCatalog.scala ## @@ -235,8 +236,17 @@ class

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #30958: [SPARK-33930][SQL] Spark SQL no serde row format field delimit default value is '\u0001'

AngersZh commented on a change in pull request #30958: URL: https://github.com/apache/spark/pull/30958#discussion_r549601552 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/BaseScriptTransformationSuite.scala ## @@ -440,6 +441,31 @@ abstract class

[GitHub] [spark] AngersZhuuuu commented on pull request #30869: [SPARK-33865][SQL] When HiveDDL, we need check avro schema too

AngersZh commented on pull request #30869: URL: https://github.com/apache/spark/pull/30869#issuecomment-751982256 gentle ping @cloud-fan This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] mridulm edited a comment on pull request #30876: [SPARK-33870][CORE] Enable spark.storage.replication.proactive by default

mridulm edited a comment on pull request #30876: URL: https://github.com/apache/spark/pull/30876#issuecomment-751979314 Before answering specific queries below, I want to set the context. a) Enabling proactive replication could result in reduced recomputation cost when executors fail.

[GitHub] [spark] cloud-fan commented on a change in pull request #30958: [SPARK-33930][SQL] Spark SQL no serde row format field delimit default value is '\u0001'

cloud-fan commented on a change in pull request #30958: URL: https://github.com/apache/spark/pull/30958#discussion_r549600913 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/BaseScriptTransformationSuite.scala ## @@ -440,6 +441,31 @@ abstract class

[GitHub] [spark] imback82 commented on a change in pull request #30881: [SPARK-33875][SQL] Implement DESCRIBE COLUMN for v2 tables

imback82 commented on a change in pull request #30881: URL: https://github.com/apache/spark/pull/30881#discussion_r549600597 ## File path: sql/core/src/main/scala/org/apache/spark/sql/catalyst/analysis/ResolveSessionCatalog.scala ## @@ -235,8 +236,17 @@ class

[GitHub] [spark] cloud-fan closed pull request #30956: [SPARK-33928][TEST][CORE] Fix flaky o.a.s.ExecutorAllocationManagerSuite - "SPARK-23365 Don't update target num executors when killing idle execu

cloud-fan closed pull request #30956: URL: https://github.com/apache/spark/pull/30956 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [spark] mridulm edited a comment on pull request #30876: [SPARK-33870][CORE] Enable spark.storage.replication.proactive by default

mridulm edited a comment on pull request #30876: URL: https://github.com/apache/spark/pull/30876#issuecomment-751979314 Before answering specific queries below, I want to set the context. a) Enabling proactive replication could result in reduced recomputation cost when executors fail.

[GitHub] [spark] cloud-fan commented on pull request #30956: [SPARK-33928][TEST][CORE] Fix flaky o.a.s.ExecutorAllocationManagerSuite - "SPARK-23365 Don't update target num executors when killing idle

cloud-fan commented on pull request #30956: URL: https://github.com/apache/spark/pull/30956#issuecomment-751981627 thanks, merging to master/3.1! This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] SparkQA commented on pull request #30959: [SPARK-33931][INFRA] Recover GitHub Action `build_and_test` job

SparkQA commented on pull request #30959: URL: https://github.com/apache/spark/pull/30959#issuecomment-751980630 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/38057/

[GitHub] [spark] SparkQA commented on pull request #30212: [SPARK-33308][SQL] Refactor current grouping analytics

SparkQA commented on pull request #30212: URL: https://github.com/apache/spark/pull/30212#issuecomment-751980374 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/38061/

[GitHub] [spark] mridulm commented on pull request #30876: [SPARK-33870][CORE] Enable spark.storage.replication.proactive by default

mridulm commented on pull request #30876: URL: https://github.com/apache/spark/pull/30876#issuecomment-751979314 Before answering specific queries below, I want to set the context. a) Enabling proactive replication could result in reduced recomputation cost when executors fail.

[GitHub] [spark] SparkQA commented on pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

SparkQA commented on pull request #30957: URL: https://github.com/apache/spark/pull/30957#issuecomment-751979073 **[Test build #133477 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133477/testReport)** for PR 30957 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30841: [SPARK-28191][SS] New data source - state - reader part

AmplabJenkins removed a comment on pull request #30841: URL: https://github.com/apache/spark/pull/30841#issuecomment-751978657 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/133466/

[GitHub] [spark] AmplabJenkins commented on pull request #30841: [SPARK-28191][SS] New data source - state - reader part

AmplabJenkins commented on pull request #30841: URL: https://github.com/apache/spark/pull/30841#issuecomment-751978657 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/133466/

[GitHub] [spark] SparkQA removed a comment on pull request #30841: [SPARK-28191][SS] New data source - state - reader part

SparkQA removed a comment on pull request #30841: URL: https://github.com/apache/spark/pull/30841#issuecomment-751938979 **[Test build #133466 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133466/testReport)** for PR 30841 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

AmplabJenkins removed a comment on pull request #30957: URL: https://github.com/apache/spark/pull/30957#issuecomment-751978457 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/38059/

[GitHub] [spark] AmplabJenkins commented on pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

AmplabJenkins commented on pull request #30957: URL: https://github.com/apache/spark/pull/30957#issuecomment-751978457 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/38059/

[GitHub] [spark] SparkQA commented on pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

SparkQA commented on pull request #30957: URL: https://github.com/apache/spark/pull/30957#issuecomment-751978449 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/38059/

[GitHub] [spark] SparkQA commented on pull request #30841: [SPARK-28191][SS] New data source - state - reader part

SparkQA commented on pull request #30841: URL: https://github.com/apache/spark/pull/30841#issuecomment-751978390 **[Test build #133466 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133466/testReport)** for PR 30841 at commit

[GitHub] [spark] AngersZhuuuu commented on pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

AngersZh commented on pull request #30957: URL: https://github.com/apache/spark/pull/30957#issuecomment-751977979 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

AmplabJenkins removed a comment on pull request #30957: URL: https://github.com/apache/spark/pull/30957#issuecomment-751977685 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/133467/

[GitHub] [spark] AmplabJenkins commented on pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

AmplabJenkins commented on pull request #30957: URL: https://github.com/apache/spark/pull/30957#issuecomment-751977685 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/133467/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30959: [SPARK-33931][INFRA] Recover GitHub Action `build_and_test` job

AmplabJenkins removed a comment on pull request #30959: URL: https://github.com/apache/spark/pull/30959#issuecomment-751977414 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/38062/

[GitHub] [spark] AmplabJenkins commented on pull request #30959: [SPARK-33931][INFRA] Recover GitHub Action `build_and_test` job

AmplabJenkins commented on pull request #30959: URL: https://github.com/apache/spark/pull/30959#issuecomment-751977414 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/38062/

[GitHub] [spark] SparkQA removed a comment on pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

SparkQA removed a comment on pull request #30957: URL: https://github.com/apache/spark/pull/30957#issuecomment-751951003 **[Test build #133467 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133467/testReport)** for PR 30957 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30959: [SPARK-33931][INFRA] Recover GitHub Action `build_and_test` job

AmplabJenkins removed a comment on pull request #30959: URL: https://github.com/apache/spark/pull/30959#issuecomment-751977032 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/133474/

[GitHub] [spark] SparkQA commented on pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

SparkQA commented on pull request #30957: URL: https://github.com/apache/spark/pull/30957#issuecomment-751977118 **[Test build #133467 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133467/testReport)** for PR 30957 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #30959: [SPARK-33931][INFRA] Recover GitHub Action `build_and_test` job

AmplabJenkins commented on pull request #30959: URL: https://github.com/apache/spark/pull/30959#issuecomment-751977032 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/133474/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30956: [SPARK-33928][TEST][CORE] Fix flaky o.a.s.ExecutorAllocationManagerSuite - "SPARK-23365 Don't update target num executors when

AmplabJenkins removed a comment on pull request #30956: URL: https://github.com/apache/spark/pull/30956#issuecomment-751971918 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/133464/

[GitHub] [spark] SparkQA removed a comment on pull request #30951: [SPARK-33775][FOLLOWUP][test-maven][BUILD] Suppress maven compilation warnings in Scala 2.13

SparkQA removed a comment on pull request #30951: URL: https://github.com/apache/spark/pull/30951#issuecomment-751890200 **[Test build #133460 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133460/testReport)** for PR 30951 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

AmplabJenkins removed a comment on pull request #30957: URL: https://github.com/apache/spark/pull/30957#issuecomment-751971916 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/38056/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30898: [SPARK-33884][SQL] Simplify CaseWhenclauses with (true and false) and (false and true)

AmplabJenkins removed a comment on pull request #30898: URL: https://github.com/apache/spark/pull/30898#issuecomment-751972078 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/133462/

[GitHub] [spark] SparkQA removed a comment on pull request #30898: [SPARK-33884][SQL] Simplify CaseWhenclauses with (true and false) and (false and true)

SparkQA removed a comment on pull request #30898: URL: https://github.com/apache/spark/pull/30898#issuecomment-751920157 **[Test build #133462 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133462/testReport)** for PR 30898 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30928: [SPARK-33912][SQL] Refactor DependencyUtils ivy property parameter

AmplabJenkins removed a comment on pull request #30928: URL: https://github.com/apache/spark/pull/30928#issuecomment-751971917 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/38060/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30951: [SPARK-33775][FOLLOWUP][test-maven][BUILD] Suppress maven compilation warnings in Scala 2.13

AmplabJenkins removed a comment on pull request #30951: URL: https://github.com/apache/spark/pull/30951#issuecomment-751975143 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/133460/

[GitHub] [spark] AngersZhuuuu edited a comment on pull request #30958: [SPARK-33930][SQL] Spark SQL no serde row format field delimit default value is '\u0001'

AngersZh edited a comment on pull request #30958: URL: https://github.com/apache/spark/pull/30958#issuecomment-751974605 > Not related to the change. But I notice that some contributors usually use screenshots in the description. I personally don't recommend this approach. The images

[GitHub] [spark] AmplabJenkins commented on pull request #30951: [SPARK-33775][FOLLOWUP][test-maven][BUILD] Suppress maven compilation warnings in Scala 2.13

AmplabJenkins commented on pull request #30951: URL: https://github.com/apache/spark/pull/30951#issuecomment-751975143 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/133460/

[GitHub] [spark] cloud-fan closed pull request #30898: [SPARK-33884][SQL] Simplify CaseWhenclauses with (true and false) and (false and true)

cloud-fan closed pull request #30898: URL: https://github.com/apache/spark/pull/30898 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [spark] cloud-fan commented on pull request #30898: [SPARK-33884][SQL] Simplify CaseWhenclauses with (true and false) and (false and true)

cloud-fan commented on pull request #30898: URL: https://github.com/apache/spark/pull/30898#issuecomment-751974714 thanks, merging to master! This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] MaxGekk commented on a change in pull request #30947: [SPARK-33926][SQL] Improve the error message in resolving of DSv1 multi-part identifiers

MaxGekk commented on a change in pull request #30947: URL: https://github.com/apache/spark/pull/30947#discussion_r549594135 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/connector/catalog/CatalogV2Implicits.scala ## @@ -118,7 +118,7 @@ private[sql] object

[GitHub] [spark] AngersZhuuuu commented on pull request #30958: [SPARK-33930][SQL] Spark SQL no serde row format field delimit default value is '\u0001'

AngersZh commented on pull request #30958: URL: https://github.com/apache/spark/pull/30958#issuecomment-751974605 > Not related to the change. But I notice that some contributors usually use screenshots in the description. I personally don't recommend this approach. The images cannot

[GitHub] [spark] SparkQA commented on pull request #30951: [SPARK-33775][FOLLOWUP][test-maven][BUILD] Suppress maven compilation warnings in Scala 2.13

SparkQA commented on pull request #30951: URL: https://github.com/apache/spark/pull/30951#issuecomment-751974120 **[Test build #133460 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133460/testReport)** for PR 30951 at commit

[GitHub] [spark] SparkQA commented on pull request #30959: [SPARK-33931][INFRA] Recover GitHub Action `build_and_test` job

SparkQA commented on pull request #30959: URL: https://github.com/apache/spark/pull/30959#issuecomment-751973873 **[Test build #133474 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133474/testReport)** for PR 30959 at commit

[GitHub] [spark] SparkQA commented on pull request #30315: [SPARK-33388][SQL] Merge In and InSet predicate

SparkQA commented on pull request #30315: URL: https://github.com/apache/spark/pull/30315#issuecomment-751973304 **[Test build #133476 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133476/testReport)** for PR 30315 at commit

[GitHub] [spark] cloud-fan commented on a change in pull request #30881: [SPARK-33875][SQL] Implement DESCRIBE COLUMN for v2 tables

cloud-fan commented on a change in pull request #30881: URL: https://github.com/apache/spark/pull/30881#discussion_r549592550 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/DataSourceV2Strategy.scala ## @@ -272,8 +273,13 @@ class

[GitHub] [spark] SparkQA commented on pull request #30955: [SPARK-33848][SQL][FOLLOWUP] Introduce allowList for push into (if / case) branches

SparkQA commented on pull request #30955: URL: https://github.com/apache/spark/pull/30955#issuecomment-751972899 **[Test build #133475 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133475/testReport)** for PR 30955 at commit

[GitHub] [spark] cloud-fan commented on a change in pull request #30881: [SPARK-33875][SQL] Implement DESCRIBE COLUMN for v2 tables

cloud-fan commented on a change in pull request #30881: URL: https://github.com/apache/spark/pull/30881#discussion_r549592416 ## File path: sql/core/src/main/scala/org/apache/spark/sql/catalyst/analysis/ResolveSessionCatalog.scala ## @@ -235,8 +236,17 @@ class

[GitHub] [spark] SparkQA commented on pull request #30212: [SPARK-33308][SQL] Refactor current grouping analytics

SparkQA commented on pull request #30212: URL: https://github.com/apache/spark/pull/30212#issuecomment-751972303 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/38061/

[GitHub] [spark] cloud-fan commented on a change in pull request #30881: [SPARK-33875][SQL] Implement DESCRIBE COLUMN for v2 tables

cloud-fan commented on a change in pull request #30881: URL: https://github.com/apache/spark/pull/30881#discussion_r549591975 ## File path: sql/core/src/main/scala/org/apache/spark/sql/catalyst/analysis/ResolveSessionCatalog.scala ## @@ -235,8 +236,17 @@ class

[GitHub] [spark] AmplabJenkins commented on pull request #30898: [SPARK-33884][SQL] Simplify CaseWhenclauses with (true and false) and (false and true)

AmplabJenkins commented on pull request #30898: URL: https://github.com/apache/spark/pull/30898#issuecomment-751972078 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/133462/

[GitHub] [spark] SparkQA commented on pull request #30959: [SPARK-33931][INFRA] Recover GitHub Action `build_and_test` job

SparkQA commented on pull request #30959: URL: https://github.com/apache/spark/pull/30959#issuecomment-751972015 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/38057/

[GitHub] [spark] AmplabJenkins commented on pull request #30928: [SPARK-33912][SQL] Refactor DependencyUtils ivy property parameter

AmplabJenkins commented on pull request #30928: URL: https://github.com/apache/spark/pull/30928#issuecomment-751971917 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/38060/

[GitHub] [spark] AmplabJenkins commented on pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

AmplabJenkins commented on pull request #30957: URL: https://github.com/apache/spark/pull/30957#issuecomment-751971916 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/38056/

[GitHub] [spark] AmplabJenkins commented on pull request #30956: [SPARK-33928][TEST][CORE] Fix flaky o.a.s.ExecutorAllocationManagerSuite - "SPARK-23365 Don't update target num executors when killing

AmplabJenkins commented on pull request #30956: URL: https://github.com/apache/spark/pull/30956#issuecomment-751971918 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/133464/

[GitHub] [spark] SparkQA commented on pull request #30898: [SPARK-33884][SQL] Simplify CaseWhenclauses with (true and false) and (false and true)

SparkQA commented on pull request #30898: URL: https://github.com/apache/spark/pull/30898#issuecomment-751971552 **[Test build #133462 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133462/testReport)** for PR 30898 at commit

[GitHub] [spark] cloud-fan commented on a change in pull request #30955: [SPARK-33848][SQL][FOLLOWUP] Introduce allowList for push into (if / case) branches

cloud-fan commented on a change in pull request #30955: URL: https://github.com/apache/spark/pull/30955#discussion_r549590506 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/expressions.scala ## @@ -548,41 +548,66 @@ object

[GitHub] [spark] AngersZhuuuu commented on pull request #30948: [SPARK-33637][SQL] alter table drop partition equals alter table drop if ex…

AngersZh commented on pull request #30948: URL: https://github.com/apache/spark/pull/30948#issuecomment-751970421 Seem PR title not completed? This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] cloud-fan commented on a change in pull request #30955: [SPARK-33848][SQL][FOLLOWUP] Introduce allowList for push into (if / case) branches

cloud-fan commented on a change in pull request #30955: URL: https://github.com/apache/spark/pull/30955#discussion_r549590192 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/expressions.scala ## @@ -548,41 +548,66 @@ object

[GitHub] [spark] cloud-fan commented on a change in pull request #30955: [SPARK-33848][SQL][FOLLOWUP] Introduce allowList for push into (if / case) branches

cloud-fan commented on a change in pull request #30955: URL: https://github.com/apache/spark/pull/30955#discussion_r549590121 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/expressions.scala ## @@ -548,41 +548,66 @@ object

[GitHub] [spark] cloud-fan closed pull request #30952: [SPARK-33924][SQL][TESTS] Preserve partition metadata by INSERT INTO in v2 table catalog

cloud-fan closed pull request #30952: URL: https://github.com/apache/spark/pull/30952 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [spark] cloud-fan commented on pull request #30952: [SPARK-33924][SQL][TESTS] Preserve partition metadata by INSERT INTO in v2 table catalog

cloud-fan commented on pull request #30952: URL: https://github.com/apache/spark/pull/30952#issuecomment-751969553 thanks, merging to master! This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] SparkQA removed a comment on pull request #30956: [SPARK-33928][TEST][CORE] Fix flaky o.a.s.ExecutorAllocationManagerSuite - "SPARK-23365 Don't update target num executors when killin

SparkQA removed a comment on pull request #30956: URL: https://github.com/apache/spark/pull/30956#issuecomment-751938899 **[Test build #133464 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133464/testReport)** for PR 30956 at commit

[GitHub] [spark] SparkQA commented on pull request #30956: [SPARK-33928][TEST][CORE] Fix flaky o.a.s.ExecutorAllocationManagerSuite - "SPARK-23365 Don't update target num executors when killing idle e

SparkQA commented on pull request #30956: URL: https://github.com/apache/spark/pull/30956#issuecomment-751969260 **[Test build #133464 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133464/testReport)** for PR 30956 at commit

[GitHub] [spark] SparkQA commented on pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

SparkQA commented on pull request #30957: URL: https://github.com/apache/spark/pull/30957#issuecomment-751969171 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/38059/

[GitHub] [spark] cloud-fan commented on a change in pull request #30947: [SPARK-33926][SQL] Improve the error message in resolving of DSv1 multi-part identifiers

cloud-fan commented on a change in pull request #30947: URL: https://github.com/apache/spark/pull/30947#discussion_r549589001 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/connector/catalog/CatalogV2Implicits.scala ## @@ -118,7 +118,7 @@ private[sql] object

[GitHub] [spark] SparkQA commented on pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

SparkQA commented on pull request #30957: URL: https://github.com/apache/spark/pull/30957#issuecomment-751964598 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/38056/

[GitHub] [spark] MaxGekk commented on pull request #30947: [SPARK-33926][SQL] Improve the error message in resolving of DSv1 multi-part identifiers

MaxGekk commented on pull request #30947: URL: https://github.com/apache/spark/pull/30947#issuecomment-751963956 @cloud-fan Please, take a look at this. This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] MaxGekk commented on pull request #30952: [SPARK-33924][SQL][TESTS] Preserve partition metadata by INSERT INTO in v2 table catalog

MaxGekk commented on pull request #30952: URL: https://github.com/apache/spark/pull/30952#issuecomment-751963841 @cloud-fan @HyukjinKwon Please, review this fix. This is an automated message from the Apache Git Service. To

[GitHub] [spark] wangyum commented on a change in pull request #30853: [SPARK-33848][SQL] Push the UnaryExpression into (if / case) branches

wangyum commented on a change in pull request #30853: URL: https://github.com/apache/spark/pull/30853#discussion_r549583380 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/expressions.scala ## @@ -542,29 +542,42 @@ object

[GitHub] [spark] SparkQA commented on pull request #30959: [SPARK-33931][INFRA] Recover GitHub Action `build_and_test` job

SparkQA commented on pull request #30959: URL: https://github.com/apache/spark/pull/30959#issuecomment-751963050 **[Test build #133473 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133473/testReport)** for PR 30959 at commit

[GitHub] [spark] viirya commented on a change in pull request #30881: [SPARK-33875][SQL] Implement DESCRIBE COLUMN for v2 tables

viirya commented on a change in pull request #30881: URL: https://github.com/apache/spark/pull/30881#discussion_r549582590 ## File path: sql/core/src/main/scala/org/apache/spark/sql/catalyst/analysis/ResolveSessionCatalog.scala ## @@ -235,8 +236,17 @@ class

[GitHub] [spark] SparkQA commented on pull request #30212: [SPARK-33308][SQL] Refactor current grouping analytics

SparkQA commented on pull request #30212: URL: https://github.com/apache/spark/pull/30212#issuecomment-751961455 **[Test build #133472 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133472/testReport)** for PR 30212 at commit

[GitHub] [spark] SparkQA commented on pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

SparkQA commented on pull request #30957: URL: https://github.com/apache/spark/pull/30957#issuecomment-751959287 **[Test build #133471 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133471/testReport)** for PR 30957 at commit

[GitHub] [spark] SparkQA commented on pull request #30959: [SPARK-33931][INFRA] Recover GitHub Action `build_and_test` job

SparkQA commented on pull request #30959: URL: https://github.com/apache/spark/pull/30959#issuecomment-751958605 **[Test build #133469 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133469/testReport)** for PR 30959 at commit

[GitHub] [spark] SparkQA commented on pull request #30958: [SPARK-33930][SQL] Spark SQL no serde row format field delimit default value is '\u0001'

SparkQA commented on pull request #30958: URL: https://github.com/apache/spark/pull/30958#issuecomment-751958635 **[Test build #133470 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133470/testReport)** for PR 30958 at commit

[GitHub] [spark] SparkQA commented on pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

SparkQA commented on pull request #30957: URL: https://github.com/apache/spark/pull/30957#issuecomment-751958171 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/38056/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30841: [SPARK-28191][SS] New data source - state - reader part

AmplabJenkins removed a comment on pull request #30841: URL: https://github.com/apache/spark/pull/30841#issuecomment-751957782 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/38054/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30955: [SPARK-33848][SQL][FOLLOWUP] Introduce allowList for push into (if / case) branches

AmplabJenkins removed a comment on pull request #30955: URL: https://github.com/apache/spark/pull/30955#issuecomment-751957781 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/38053/

[GitHub] [spark] AmplabJenkins commented on pull request #30841: [SPARK-28191][SS] New data source - state - reader part

AmplabJenkins commented on pull request #30841: URL: https://github.com/apache/spark/pull/30841#issuecomment-751957782 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/38054/

[GitHub] [spark] AmplabJenkins commented on pull request #30955: [SPARK-33848][SQL][FOLLOWUP] Introduce allowList for push into (if / case) branches

AmplabJenkins commented on pull request #30955: URL: https://github.com/apache/spark/pull/30955#issuecomment-751957781 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/38053/

[GitHub] [spark] dongjoon-hyun opened a new pull request #30959: [SPARK-33931][INFRA] Recover GitHub Action

dongjoon-hyun opened a new pull request #30959: URL: https://github.com/apache/spark/pull/30959 ### What changes were proposed in this pull request? ### Why are the changes needed? ### Does this PR introduce _any_ user-facing change? ###

[GitHub] [spark] imback82 commented on a change in pull request #30881: [SPARK-33875][SQL] Implement DESCRIBE COLUMN for v2 tables

imback82 commented on a change in pull request #30881: URL: https://github.com/apache/spark/pull/30881#discussion_r549576786 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/v2ResolutionPlans.scala ## @@ -97,9 +98,26 @@ case class

[GitHub] [spark] AngersZhuuuu commented on pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

AngersZh commented on pull request #30957: URL: https://github.com/apache/spark/pull/30957#issuecomment-751953363 FYI @cloud-fan @maropu @alfozan This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] AngersZhuuuu commented on pull request #30958: [SPARK-33930][SQL] Spark SQL no serde row format field delimit default value is '\u0001'

AngersZh commented on pull request #30958: URL: https://github.com/apache/spark/pull/30958#issuecomment-751953177 FYI @maropu @cloud-fan This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] AngersZhuuuu opened a new pull request #30958: [SPARK-33930][SQL] Spark SQL no serde row format field delimit default value is '\u0001'

AngersZh opened a new pull request #30958: URL: https://github.com/apache/spark/pull/30958 ### What changes were proposed in this pull request? For same SQL ``` SELECT TRANSFORM(a, b, c, null) ROW FORMAT DELIMITED USING 'cat' ROW FORMAT DELIMITED FIELDS TERMINATED

[GitHub] [spark] SparkQA commented on pull request #30841: [SPARK-28191][SS] New data source - state - reader part

SparkQA commented on pull request #30841: URL: https://github.com/apache/spark/pull/30841#issuecomment-751952088 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/38054/

  1   2   3   4   5   >