[GitHub] [spark] SparkQA removed a comment on pull request #32959: [SPARK-35780][SQL] Support DATE/TIMESTAMP literals across the full range

SparkQA removed a comment on pull request #32959: URL: https://github.com/apache/spark/pull/32959#issuecomment-872052443 **[Test build #140505 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140505/testReport)** for PR 32959 at commit [`6966058`](https://gi

[GitHub] [spark] rahulsmahadev commented on a change in pull request #33093: [SPARK-35897][SS] Support user defined initial state with flatMapGroupsWithState in Structured Streaming

rahulsmahadev commented on a change in pull request #33093: URL: https://github.com/apache/spark/pull/33093#discussion_r662188765 ## File path: sql/core/src/test/scala/org/apache/spark/sql/streaming/FlatMapGroupsWithStateSuite.scala ## @@ -1243,6 +1244,214 @@ class FlatMapGrou

[GitHub] [spark] rahulsmahadev commented on a change in pull request #33093: [SPARK-35897][SS] Support user defined initial state with flatMapGroupsWithState in Structured Streaming

rahulsmahadev commented on a change in pull request #33093: URL: https://github.com/apache/spark/pull/33093#discussion_r662188185 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/FlatMapGroupsWithStateExec.scala ## @@ -178,6 +257,47 @@ case class

[GitHub] [spark] SparkQA commented on pull request #33169: [SPARK-35966][SQL] Port HIVE-17952: Fix license headers to avoid dangling javadoc warnings

SparkQA commented on pull request #33169: URL: https://github.com/apache/spark/pull/33169#issuecomment-872137876 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45012/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #33093: [SPARK-35897][SS] Support user defined initial state with flatMapGroupsWithState in Structured Streaming

SparkQA commented on pull request #33093: URL: https://github.com/apache/spark/pull/33093#issuecomment-872137434 **[Test build #140514 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140514/testReport)** for PR 33093 at commit [`57c9c2f`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #32787: [SPARK-35618][SQL] Resolve star expressions in subqueries using outer query plans

AmplabJenkins commented on pull request #32787: URL: https://github.com/apache/spark/pull/32787#issuecomment-872134433 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140491/ -- This

[GitHub] [spark] SparkQA commented on pull request #32787: [SPARK-35618][SQL] Resolve star expressions in subqueries using outer query plans

SparkQA commented on pull request #32787: URL: https://github.com/apache/spark/pull/32787#issuecomment-87217 **[Test build #140491 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140491/testReport)** for PR 32787 at commit [`0346d3b`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #33058: [SPARK-35874][SQL] AQE Shuffle should wait for its subqueries to finish before materializing

AmplabJenkins commented on pull request #33058: URL: https://github.com/apache/spark/pull/33058#issuecomment-872132141 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45015/ -- T

[GitHub] [spark] rahulsmahadev commented on a change in pull request #33093: [SPARK-35897][SS] Support user defined initial state with flatMapGroupsWithState in Structured Streaming

rahulsmahadev commented on a change in pull request #33093: URL: https://github.com/apache/spark/pull/33093#discussion_r662187034 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/FlatMapGroupsWithStateExec.scala ## @@ -39,45 +42,63 @@ import org.a

[GitHub] [spark] SparkQA commented on pull request #33170: [SPARK-35967][SQL] Update nullability based on column statistics

SparkQA commented on pull request #33170: URL: https://github.com/apache/spark/pull/33170#issuecomment-872153208 **[Test build #140502 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140502/testReport)** for PR 33170 at commit [`0a72486`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #32832: [SPARK-35686][SQL] Not allow using auto-generated alias when creating view

SparkQA commented on pull request #32832: URL: https://github.com/apache/spark/pull/32832#issuecomment-872127964 **[Test build #140513 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140513/testReport)** for PR 32832 at commit [`751a55e`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #32832: [SPARK-35686][SQL] Not allow using auto-generated alias when creating view

SparkQA commented on pull request #32832: URL: https://github.com/apache/spark/pull/32832#issuecomment-872151980 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45013/ -- This is an automated message from the A

[GitHub] [spark] AmplabJenkins commented on pull request #32933: [SPARK-35785][SS] Cleanup support for RocksDB instance

AmplabJenkins commented on pull request #32933: URL: https://github.com/apache/spark/pull/32933#issuecomment-872126762 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45009/ -- T

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33171: [SPARK-35969][K8S] Make the pod prefix more readable and tallied with K8S DNS Label Names

AmplabJenkins removed a comment on pull request #33171: URL: https://github.com/apache/spark/pull/33171#issuecomment-872126759 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140509/ -

[GitHub] [spark] MaxGekk commented on a change in pull request #33173: [SPARK-35971][SQL] Rename the type name of TimestampNTZType as "timestamp_ntz"

MaxGekk commented on a change in pull request #33173: URL: https://github.com/apache/spark/pull/33173#discussion_r662180933 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/types/TimestampNTZType.scala ## @@ -48,7 +48,7 @@ class TimestampNTZType private() extends

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32831: [SPARK-35685][SQL] Prompt recreating the view when there is an incompatible schema issue

AmplabJenkins removed a comment on pull request #32831: URL: https://github.com/apache/spark/pull/32831#issuecomment-872126758 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45010/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31517: [SPARK-34309][BUILD][CORE][SQL][K8S]Use Caffeine instead of Guava Cache

AmplabJenkins removed a comment on pull request #31517: URL: https://github.com/apache/spark/pull/31517#issuecomment-872126766 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140493/ -

[GitHub] [spark] AmplabJenkins commented on pull request #32959: [SPARK-35780][SQL] Support DATE/TIMESTAMP literals across the full range

AmplabJenkins commented on pull request #32959: URL: https://github.com/apache/spark/pull/32959#issuecomment-872126870 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45018/ -- T

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32933: [SPARK-35785][SS] Cleanup support for RocksDB instance

AmplabJenkins removed a comment on pull request #32933: URL: https://github.com/apache/spark/pull/32933#issuecomment-872126762 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45009/

[GitHub] [spark] AmplabJenkins commented on pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

AmplabJenkins commented on pull request #33172: URL: https://github.com/apache/spark/pull/33172#issuecomment-872126760 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140506/ -- This

[GitHub] [spark] SparkQA commented on pull request #32832: [SPARK-35686][SQL] Not allow using auto-generated alias when creating view

SparkQA commented on pull request #32832: URL: https://github.com/apache/spark/pull/32832#issuecomment-872126414 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45013/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

SparkQA commented on pull request #33172: URL: https://github.com/apache/spark/pull/33172#issuecomment-872123821 **[Test build #140506 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140506/testReport)** for PR 33172 at commit [`00952f2`](https://github.co

[GitHub] [spark] rahulsmahadev commented on a change in pull request #33093: [SPARK-35897][SS] Support user defined initial state with flatMapGroupsWithState in Structured Streaming

rahulsmahadev commented on a change in pull request #33093: URL: https://github.com/apache/spark/pull/33093#discussion_r662188079 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/FlatMapGroupsWithStateExec.scala ## @@ -178,6 +257,47 @@ case class

[GitHub] [spark] SparkQA commented on pull request #33170: [SPARK-35967][SQL] Update nullability based on column statistics

SparkQA commented on pull request #33170: URL: https://github.com/apache/spark/pull/33170#issuecomment-872142921 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45014/ -- This is an automated message from the A

[GitHub] [spark] SparkQA commented on pull request #33170: [SPARK-35967][SQL] Update nullability based on column statistics

SparkQA commented on pull request #33170: URL: https://github.com/apache/spark/pull/33170#issuecomment-872122488 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45014/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA removed a comment on pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

SparkQA removed a comment on pull request #33172: URL: https://github.com/apache/spark/pull/33172#issuecomment-872054929 **[Test build #140506 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140506/testReport)** for PR 33172 at commit [`00952f2`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32959: [SPARK-35780][SQL] Support DATE/TIMESTAMP literals across the full range

AmplabJenkins removed a comment on pull request #32959: URL: https://github.com/apache/spark/pull/32959#issuecomment-872126870 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45018/

[GitHub] [spark] SparkQA commented on pull request #33171: [SPARK-35969][K8S] Make the pod prefix more readable and tallied with K8S DNS Label Names

SparkQA commented on pull request #33171: URL: https://github.com/apache/spark/pull/33171#issuecomment-872134238 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45016/ -- This is an automated message from the Apache

[GitHub] [spark] rahulsmahadev commented on a change in pull request #33093: [SPARK-35897][SS] Support user defined initial state with flatMapGroupsWithState in Structured Streaming

rahulsmahadev commented on a change in pull request #33093: URL: https://github.com/apache/spark/pull/33093#discussion_r662188462 ## File path: sql/core/src/test/scala/org/apache/spark/sql/streaming/FlatMapGroupsWithStateSuite.scala ## @@ -1243,6 +1244,214 @@ class FlatMapGrou

[GitHub] [spark] SparkQA commented on pull request #33058: [SPARK-35874][SQL] AQE Shuffle should wait for its subqueries to finish before materializing

SparkQA commented on pull request #33058: URL: https://github.com/apache/spark/pull/33058#issuecomment-872132107 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45015/ -- This

[GitHub] [spark] yaooqinn commented on pull request #33171: [SPARK-35969][K8S] Make the pod prefix more readable and tallied with K8S DNS Label Names

yaooqinn commented on pull request #33171: URL: https://github.com/apache/spark/pull/33171#issuecomment-872137865 cc @dongjoon-hyun @holdenk thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[GitHub] [spark] HyukjinKwon commented on a change in pull request #33173: [SPARK-35971][SQL] Rename the type name of TimestampNTZType as "timestamp_ntz"

HyukjinKwon commented on a change in pull request #33173: URL: https://github.com/apache/spark/pull/33173#discussion_r662170842 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/types/TimestampNTZType.scala ## @@ -48,7 +48,7 @@ class TimestampNTZType private() ext

[GitHub] [spark] yaooqinn commented on pull request #33169: [SPARK-35966][SQL] Port HIVE-17952: Fix license headers to avoid dangling javadoc warnings

yaooqinn commented on pull request #33169: URL: https://github.com/apache/spark/pull/33169#issuecomment-872118669 thank you all for the review, merged to master -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [spark] yaooqinn closed pull request #33169: [SPARK-35966][SQL] Port HIVE-17952: Fix license headers to avoid dangling javadoc warnings

yaooqinn closed pull request #33169: URL: https://github.com/apache/spark/pull/33169 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsub

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33093: [SPARK-35897][SS] Support user defined initial state with flatMapGroupsWithState in Structured Streaming

AmplabJenkins removed a comment on pull request #33093: URL: https://github.com/apache/spark/pull/33093#issuecomment-872126761 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45008/

[GitHub] [spark] SparkQA removed a comment on pull request #31517: [SPARK-34309][BUILD][CORE][SQL][K8S]Use Caffeine instead of Guava Cache

SparkQA removed a comment on pull request #31517: URL: https://github.com/apache/spark/pull/31517#issuecomment-871972433 **[Test build #140493 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140493/testReport)** for PR 31517 at commit [`34d31fd`](https://gi

[GitHub] [spark] SparkQA commented on pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

SparkQA commented on pull request #33172: URL: https://github.com/apache/spark/pull/33172#issuecomment-872127688 **[Test build #140512 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140512/testReport)** for PR 33172 at commit [`8b5f321`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #31517: [SPARK-34309][BUILD][CORE][SQL][K8S]Use Caffeine instead of Guava Cache

AmplabJenkins commented on pull request #31517: URL: https://github.com/apache/spark/pull/31517#issuecomment-872126766 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140493/ -- This

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

AmplabJenkins removed a comment on pull request #33172: URL: https://github.com/apache/spark/pull/33172#issuecomment-872126760 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140506/ -

[GitHub] [spark] SparkQA commented on pull request #31517: [SPARK-34309][BUILD][CORE][SQL][K8S]Use Caffeine instead of Guava Cache

SparkQA commented on pull request #31517: URL: https://github.com/apache/spark/pull/31517#issuecomment-872114576 **[Test build #140493 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140493/testReport)** for PR 31517 at commit [`34d31fd`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #32831: [SPARK-35685][SQL] Prompt recreating the view when there is an incompatible schema issue

AmplabJenkins commented on pull request #32831: URL: https://github.com/apache/spark/pull/32831#issuecomment-872126758 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45010/ -- T

[GitHub] [spark] AmplabJenkins commented on pull request #33093: [SPARK-35897][SS] Support user defined initial state with flatMapGroupsWithState in Structured Streaming

AmplabJenkins commented on pull request #33093: URL: https://github.com/apache/spark/pull/33093#issuecomment-872126761 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45008/ -- T

[GitHub] [spark] AmplabJenkins commented on pull request #33171: [SPARK-35969][K8S] Make the pod prefix more readable and tallied with K8S DNS Label Names

AmplabJenkins commented on pull request #33171: URL: https://github.com/apache/spark/pull/33171#issuecomment-872126759 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140509/ -- This

[GitHub] [spark] SparkQA commented on pull request #32933: [SPARK-35785][SS] Cleanup support for RocksDB instance

SparkQA commented on pull request #32933: URL: https://github.com/apache/spark/pull/32933#issuecomment-872116510 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45009/ -- This is an automated message from the A

[GitHub] [spark] cloud-fan commented on a change in pull request #33173: [SPARK-35971][SQL] Rename the type name of TimestampNTZType as "timestamp_ntz"

cloud-fan commented on a change in pull request #33173: URL: https://github.com/apache/spark/pull/33173#discussion_r662176820 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/types/TimestampNTZType.scala ## @@ -48,7 +48,7 @@ class TimestampNTZType private() exten

[GitHub] [spark] SparkQA commented on pull request #32831: [SPARK-35685][SQL] Prompt recreating the view when there is an incompatible schema issue

SparkQA commented on pull request #32831: URL: https://github.com/apache/spark/pull/32831#issuecomment-872108330 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45010/ -- This is an automated message from the A

[GitHub] [spark] SparkQA commented on pull request #33093: [SPARK-35897][SS] Support user defined initial state with flatMapGroupsWithState in Structured Streaming

SparkQA commented on pull request #33093: URL: https://github.com/apache/spark/pull/33093#issuecomment-872112571 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45008/ -- This is an automated message from the A

[GitHub] [spark] yaooqinn commented on pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

yaooqinn commented on pull request #33172: URL: https://github.com/apache/spark/pull/33172#issuecomment-872107117 I think `minPartitionSize` is much more useful than `minPartitionNum`, which seem to make the `minPartitionNum` a bit useless and redundant -- This is an automated message f

[GitHub] [spark] HyukjinKwon closed pull request #33168: [SPARK-35965][DOCS] Add doc for ORC nested column vectorized reader

HyukjinKwon closed pull request #33168: URL: https://github.com/apache/spark/pull/33168 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-un

[GitHub] [spark] HyukjinKwon commented on pull request #33168: [SPARK-35965][DOCS] Add doc for ORC nested column vectorized reader

HyukjinKwon commented on pull request #33168: URL: https://github.com/apache/spark/pull/33168#issuecomment-872104939 Merged to master. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

[GitHub] [spark] SparkQA removed a comment on pull request #29326: [WIP][SPARK-32502][BUILD] Upgrade Guava to 27.0-jre

SparkQA removed a comment on pull request #29326: URL: https://github.com/apache/spark/pull/29326#issuecomment-872006587 **[Test build #140501 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140501/testReport)** for PR 29326 at commit [`d5e8ff8`](https://gi

[GitHub] [spark] SparkQA commented on pull request #33171: [SPARK-35969][K8S] Make the pod prefix more readable and tallied with K8S DNS Label Names

SparkQA commented on pull request #33171: URL: https://github.com/apache/spark/pull/33171#issuecomment-872103906 **[Test build #140509 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140509/testReport)** for PR 33171 at commit [`ac79194`](https://github.co

[GitHub] [spark] linhongliu-db commented on a change in pull request #32959: [SPARK-35780][SQL] Support DATE/TIMESTAMP literals across the full range

linhongliu-db commented on a change in pull request #32959: URL: https://github.com/apache/spark/pull/32959#discussion_r662162169 ## File path: sql/core/src/test/resources/sql-tests/results/ansi/datetime.sql.out ## @@ -662,10 +661,9 @@ struct -- !query select date '2001-10-01

[GitHub] [spark] wangyum commented on a change in pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

wangyum commented on a change in pull request #33172: URL: https://github.com/apache/spark/pull/33172#discussion_r662161772 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -525,18 +525,34 @@ object SQLConf { .booleanConf

[GitHub] [spark] cloud-fan commented on a change in pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

cloud-fan commented on a change in pull request #33172: URL: https://github.com/apache/spark/pull/33172#discussion_r662152464 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/ShufflePartitionsUtil.scala ## @@ -61,7 +63,9 @@ object ShufflePartitions

[GitHub] [spark] SparkQA removed a comment on pull request #33171: [SPARK-35969][K8S] Make the pod prefix more readable and tallied with K8S DNS Label Names

SparkQA removed a comment on pull request #33171: URL: https://github.com/apache/spark/pull/33171#issuecomment-872092626 **[Test build #140509 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140509/testReport)** for PR 33171 at commit [`ac79194`](https://gi

[GitHub] [spark] cloud-fan commented on a change in pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

cloud-fan commented on a change in pull request #33172: URL: https://github.com/apache/spark/pull/33172#discussion_r662151008 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -525,18 +525,34 @@ object SQLConf { .booleanConf

[GitHub] [spark] SparkQA removed a comment on pull request #33160: [SPARK-35959][BUILD] Add a new Maven profile "no-shaded-hadoop-client" for older Hadoop 3.x versions

SparkQA removed a comment on pull request #33160: URL: https://github.com/apache/spark/pull/33160#issuecomment-871967458 **[Test build #140487 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140487/testReport)** for PR 33160 at commit [`37130a9`](https://gi

[GitHub] [spark] ulysses-you commented on a change in pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

ulysses-you commented on a change in pull request #33172: URL: https://github.com/apache/spark/pull/33172#discussion_r662133241 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -525,18 +525,34 @@ object SQLConf { .booleanConf

[GitHub] [spark] cloud-fan commented on a change in pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

cloud-fan commented on a change in pull request #33172: URL: https://github.com/apache/spark/pull/33172#discussion_r662151008 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -525,18 +525,34 @@ object SQLConf { .booleanConf

[GitHub] [spark] AmplabJenkins commented on pull request #33160: [SPARK-35959][BUILD] Add a new Maven profile "no-shaded-hadoop-client" for older Hadoop 3.x versions

AmplabJenkins commented on pull request #33160: URL: https://github.com/apache/spark/pull/33160#issuecomment-872100431 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140487/ -- This

[GitHub] [spark] cloud-fan commented on a change in pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

cloud-fan commented on a change in pull request #33172: URL: https://github.com/apache/spark/pull/33172#discussion_r662152677 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/ShufflePartitionsUtil.scala ## @@ -61,7 +63,9 @@ object ShufflePartitions

[GitHub] [spark] AmplabJenkins commented on pull request #29326: [WIP][SPARK-32502][BUILD] Upgrade Guava to 27.0-jre

AmplabJenkins commented on pull request #29326: URL: https://github.com/apache/spark/pull/29326#issuecomment-872097258 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45011/ -- T

[GitHub] [spark] AmplabJenkins commented on pull request #29326: [WIP][SPARK-32502][BUILD] Upgrade Guava to 27.0-jre

AmplabJenkins commented on pull request #29326: URL: https://github.com/apache/spark/pull/29326#issuecomment-872097517 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140501/ -- This

[GitHub] [spark] SparkQA commented on pull request #29326: [WIP][SPARK-32502][BUILD] Upgrade Guava to 27.0-jre

SparkQA commented on pull request #29326: URL: https://github.com/apache/spark/pull/29326#issuecomment-872097233 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45011/ -- This

[GitHub] [spark] SparkQA commented on pull request #33160: [SPARK-35959][BUILD] Add a new Maven profile "no-shaded-hadoop-client" for older Hadoop 3.x versions

SparkQA commented on pull request #33160: URL: https://github.com/apache/spark/pull/33160#issuecomment-872098850 **[Test build #140487 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140487/testReport)** for PR 33160 at commit [`37130a9`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #29326: [WIP][SPARK-32502][BUILD] Upgrade Guava to 27.0-jre

SparkQA commented on pull request #29326: URL: https://github.com/apache/spark/pull/29326#issuecomment-872096470 **[Test build #140501 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140501/testReport)** for PR 29326 at commit [`d5e8ff8`](https://github.co

[GitHub] [spark] cloud-fan closed pull request #32831: [SPARK-35685][SQL] Prompt recreating the view when there is an incompatible schema issue

cloud-fan closed pull request #32831: URL: https://github.com/apache/spark/pull/32831 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsu

[GitHub] [spark] cloud-fan commented on a change in pull request #32831: [SPARK-35685][SQL] Prompt recreating the view when there is an incompatible schema issue

cloud-fan commented on a change in pull request #32831: URL: https://github.com/apache/spark/pull/32831#discussion_r662147091 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/SQLViewSuite.scala ## @@ -910,4 +911,27 @@ abstract class SQLViewSuite extends Que

[GitHub] [spark] cloud-fan commented on pull request #32831: [SPARK-35685][SQL] Prompt recreating the view when there is an incompatible schema issue

cloud-fan commented on pull request #32831: URL: https://github.com/apache/spark/pull/32831#issuecomment-872095667 thanks, merging to master! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] SparkQA commented on pull request #32933: [SPARK-35785][SS] Cleanup support for RocksDB instance

SparkQA commented on pull request #32933: URL: https://github.com/apache/spark/pull/32933#issuecomment-872094255 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45009/ -- This is an automated message from the Apache

[GitHub] [spark] yaooqinn commented on a change in pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

yaooqinn commented on a change in pull request #33172: URL: https://github.com/apache/spark/pull/33172#discussion_r662140639 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/ShufflePartitionsUtil.scala ## @@ -61,7 +63,9 @@ object ShufflePartitionsU

[GitHub] [spark] yaooqinn commented on a change in pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

yaooqinn commented on a change in pull request #33172: URL: https://github.com/apache/spark/pull/33172#discussion_r662142804 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -525,18 +525,34 @@ object SQLConf { .booleanConf

[GitHub] [spark] SparkQA commented on pull request #32933: [SPARK-35785][SS] Cleanup support for RocksDB instance

SparkQA commented on pull request #32933: URL: https://github.com/apache/spark/pull/32933#issuecomment-872092880 **[Test build #140511 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140511/testReport)** for PR 32933 at commit [`ea94983`](https://github.com

[GitHub] [spark] yaooqinn commented on a change in pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

yaooqinn commented on a change in pull request #33172: URL: https://github.com/apache/spark/pull/33172#discussion_r662140767 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/ShufflePartitionsUtil.scala ## @@ -61,7 +63,9 @@ object ShufflePartitionsU

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33171: [SPARK-35969][K8S] Make the pod prefix more readable and tallied with K8S DNS Label Names

AmplabJenkins removed a comment on pull request #33171: URL: https://github.com/apache/spark/pull/33171#issuecomment-872057201 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140504/ -

[GitHub] [spark] SparkQA commented on pull request #32959: [WIP][SPARK-35780][SQL] Support DATE/TIMESTAMP literals across the full range

SparkQA commented on pull request #32959: URL: https://github.com/apache/spark/pull/32959#issuecomment-872092804 **[Test build #140510 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140510/testReport)** for PR 32959 at commit [`633781f`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #33174: [SPARK-35721][PYTHON] Path level discover for python unittests

SparkQA commented on pull request #33174: URL: https://github.com/apache/spark/pull/33174#issuecomment-872092588 **[Test build #140507 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140507/testReport)** for PR 33174 at commit [`aae183c`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #33173: [SPARK-35971][SQL] Rename the type name of TimestampNTZType as "timestamp_ntz"

SparkQA commented on pull request #33173: URL: https://github.com/apache/spark/pull/33173#issuecomment-872092686 **[Test build #140508 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140508/testReport)** for PR 33173 at commit [`5fd930d`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #33171: [SPARK-35969][K8S] Make the pod prefix more readable and tallied with K8S DNS Label Names

SparkQA commented on pull request #33171: URL: https://github.com/apache/spark/pull/33171#issuecomment-872092626 **[Test build #140509 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140509/testReport)** for PR 33171 at commit [`ac79194`](https://github.com

[GitHub] [spark] yaooqinn commented on a change in pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

yaooqinn commented on a change in pull request #33172: URL: https://github.com/apache/spark/pull/33172#discussion_r662141208 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/ShufflePartitionsUtil.scala ## @@ -61,7 +63,9 @@ object ShufflePartitionsU

[GitHub] [spark] yaooqinn commented on a change in pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

yaooqinn commented on a change in pull request #33172: URL: https://github.com/apache/spark/pull/33172#discussion_r662140767 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/ShufflePartitionsUtil.scala ## @@ -61,7 +63,9 @@ object ShufflePartitionsU

[GitHub] [spark] yaooqinn commented on a change in pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

yaooqinn commented on a change in pull request #33172: URL: https://github.com/apache/spark/pull/33172#discussion_r662140639 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/ShufflePartitionsUtil.scala ## @@ -61,7 +63,9 @@ object ShufflePartitionsU

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31517: [SPARK-34309][BUILD][CORE][SQL][K8S]Use Caffeine instead of Guava Cache

AmplabJenkins removed a comment on pull request #31517: URL: https://github.com/apache/spark/pull/31517#issuecomment-872091219 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45004/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33167: [SPARK-35963][SQL] Rename TimestampWithoutTZType to TimestampNTZType

AmplabJenkins removed a comment on pull request #33167: URL: https://github.com/apache/spark/pull/33167#issuecomment-872091207 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45005/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32831: [SPARK-35685][SQL] Prompt recreating the view when there is an incompatible schema issue

AmplabJenkins removed a comment on pull request #32831: URL: https://github.com/apache/spark/pull/32831#issuecomment-872091209 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140500/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32787: [SPARK-35618][SQL] Resolve star expressions in subqueries using outer query plans

AmplabJenkins removed a comment on pull request #32787: URL: https://github.com/apache/spark/pull/32787#issuecomment-872091206 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45003/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33070: [SPARK-35551][SQL] Handle the COUNT bug for lateral subqueries

AmplabJenkins removed a comment on pull request #33070: URL: https://github.com/apache/spark/pull/33070#issuecomment-872091208 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45006/

[GitHub] [spark] AmplabJenkins commented on pull request #33070: [SPARK-35551][SQL] Handle the COUNT bug for lateral subqueries

AmplabJenkins commented on pull request #33070: URL: https://github.com/apache/spark/pull/33070#issuecomment-872091208 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45006/ -- T

[GitHub] [spark] AmplabJenkins commented on pull request #32831: [SPARK-35685][SQL] Prompt recreating the view when there is an incompatible schema issue

AmplabJenkins commented on pull request #32831: URL: https://github.com/apache/spark/pull/32831#issuecomment-872091209 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140500/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32787: [SPARK-35618][SQL] Resolve star expressions in subqueries using outer query plans

AmplabJenkins commented on pull request #32787: URL: https://github.com/apache/spark/pull/32787#issuecomment-872091206 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45003/ -- T

[GitHub] [spark] AmplabJenkins commented on pull request #31517: [SPARK-34309][BUILD][CORE][SQL][K8S]Use Caffeine instead of Guava Cache

AmplabJenkins commented on pull request #31517: URL: https://github.com/apache/spark/pull/31517#issuecomment-872091219 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45004/ -- T

[GitHub] [spark] AmplabJenkins commented on pull request #33167: [SPARK-35963][SQL] Rename TimestampWithoutTZType to TimestampNTZType

AmplabJenkins commented on pull request #33167: URL: https://github.com/apache/spark/pull/33167#issuecomment-872091207 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45005/ -- T

[GitHub] [spark] yaooqinn commented on a change in pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

yaooqinn commented on a change in pull request #33172: URL: https://github.com/apache/spark/pull/33172#discussion_r662138631 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -525,18 +525,34 @@ object SQLConf { .booleanConf

[GitHub] [spark] SparkQA commented on pull request #33093: [SPARK-35897][SS] Support user defined initial state with flatMapGroupsWithState in Structured Streaming

SparkQA commented on pull request #33093: URL: https://github.com/apache/spark/pull/33093#issuecomment-872088374 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45008/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #32831: [SPARK-35685][SQL] Prompt recreating the view when there is an incompatible schema issue

SparkQA commented on pull request #32831: URL: https://github.com/apache/spark/pull/32831#issuecomment-872087929 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45010/ -- This is an automated message from the Apache

[GitHub] [spark] cloud-fan commented on a change in pull request #33173: [SPARK-35971][SQL] Rename the type name of TimestampNTZType as "timestamp_ntz"

cloud-fan commented on a change in pull request #33173: URL: https://github.com/apache/spark/pull/33173#discussion_r662135636 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/types/TimestampNTZType.scala ## @@ -48,7 +48,7 @@ class TimestampNTZType private() exten

[GitHub] [spark] SparkQA commented on pull request #32787: [SPARK-35618][SQL] Resolve star expressions in subqueries using outer query plans

SparkQA commented on pull request #32787: URL: https://github.com/apache/spark/pull/32787#issuecomment-872086013 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45003/ -- This is an automated message from the A

[GitHub] [spark] SparkQA commented on pull request #33167: [SPARK-35963][SQL] Rename TimestampWithoutTZType to TimestampNTZType

SparkQA commented on pull request #33167: URL: https://github.com/apache/spark/pull/33167#issuecomment-872084304 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45005/ -- This is an automated message from the A

[GitHub] [spark] cloud-fan commented on pull request #33070: [SPARK-35551][SQL] Handle the COUNT bug for lateral subqueries

cloud-fan commented on pull request #33070: URL: https://github.com/apache/spark/pull/33070#issuecomment-872083858 @allisonwang-db can you fix the code conflicts? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

<    3   4   5   6   7   8   9   10   >