[GitHub] [spark] HeartSaVioR edited a comment on pull request #30151: [WIP][SPARK-33223][SS][UI]Structured Streaming Web UI state information

HeartSaVioR edited a comment on pull request #30151: URL: https://github.com/apache/spark/pull/30151#issuecomment-719215554 The UI change looks OK to me. I'll probably apply the PR to my end and play with. Btw, do you have some TODOs for getting rid of WIP? Just to determine the

[GitHub] [spark] AmplabJenkins commented on pull request #30145: [SPARK-33233][SQL]CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

AmplabJenkins commented on pull request #30145: URL: https://github.com/apache/spark/pull/30145#issuecomment-719235362 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] viirya commented on a change in pull request #30187: [SPARK-33290][SQL] REFRESH TABLE should invalidate cache even though the table itself may not be cached

viirya commented on a change in pull request #30187: URL: https://github.com/apache/spark/pull/30187#discussion_r514886343 ## File path: sql/core/src/main/scala/org/apache/spark/sql/internal/CatalogImpl.scala ## @@ -524,14 +524,17 @@ class CatalogImpl(sparkSession:

[GitHub] [spark] SparkQA commented on pull request #29247: [SPARK-32446][SHS] Add new executor metrics summary REST APIs

SparkQA commented on pull request #29247: URL: https://github.com/apache/spark/pull/29247#issuecomment-719233602 **[Test build #130441 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130441/testReport)** for PR 29247 at commit

[GitHub] [spark] SparkQA commented on pull request #30145: [SPARK-33233][SQL]CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

SparkQA commented on pull request #30145: URL: https://github.com/apache/spark/pull/30145#issuecomment-719230280 **[Test build #130435 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130435/testReport)** for PR 30145 at commit

[GitHub] [spark] SparkQA commented on pull request #30156: [SPARK-33248][SQL] Add a configuration to control the legacy behavior of whether need to pad null value when value size less then schema size

SparkQA commented on pull request #30156: URL: https://github.com/apache/spark/pull/30156#issuecomment-719227506 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35044/

[GitHub] [spark] warrenzhu25 commented on pull request #30175: [SPARK-33274][SS] Fix job hang in cp mode when total cores less than total kafka partition

warrenzhu25 commented on pull request #30175: URL: https://github.com/apache/spark/pull/30175#issuecomment-719227638 @HeartSaVioR @dongjoon-hyun Could you help take a look? This is an automated message from the Apache Git

[GitHub] [spark] dongjoon-hyun closed pull request #30196: [SPARK-33292][SQL][2.4] Make Literal ArrayBasedMapData string representation disambiguous

dongjoon-hyun closed pull request #30196: URL: https://github.com/apache/spark/pull/30196 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] dongjoon-hyun commented on pull request #30196: [SPARK-33292][SQL][2.4] Make Literal ArrayBasedMapData string representation disambiguous

dongjoon-hyun commented on pull request #30196: URL: https://github.com/apache/spark/pull/30196#issuecomment-719225012 Thank you, @maropu . Merged to branch-2.4. This is an automated message from the Apache Git Service.

[GitHub] [spark] viirya commented on a change in pull request #30187: [SPARK-33290][SQL] REFRESH TABLE should invalidate cache even though the table itself may not be cached

viirya commented on a change in pull request #30187: URL: https://github.com/apache/spark/pull/30187#discussion_r514884174 ## File path: sql/core/src/main/scala/org/apache/spark/sql/internal/CatalogImpl.scala ## @@ -524,14 +524,17 @@ class CatalogImpl(sparkSession:

[GitHub] [spark] warrenzhu25 commented on pull request #29247: [SPARK-32446][SHS] Add new executor metrics summary REST APIs

warrenzhu25 commented on pull request #29247: URL: https://github.com/apache/spark/pull/29247#issuecomment-719219284 @gengliangwang Any ideas about sparkr build failure? This is an automated message from the Apache Git

[GitHub] [spark] gengliangwang commented on pull request #29820: [SPARK-20044][UI] Support Spark UI behind front-end reverse proxy using a path prefix Revert proxy url

gengliangwang commented on pull request #29820: URL: https://github.com/apache/spark/pull/29820#issuecomment-719220094 cc @srowen @HeartSaVioR @cloud-fan as well This is an automated message from the Apache Git Service. To

[GitHub] [spark] HeartSaVioR commented on pull request #30151: [WIP][SPARK-33223][SS][UI]Structured Streaming Web UI state information

HeartSaVioR commented on pull request #30151: URL: https://github.com/apache/spark/pull/30151#issuecomment-719215554 The UI change looks OK to me. I'll probably apply the PR to my end and play with. Btw, do you have some TODOs for getting rid of WIP? Just to see the time to start

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

AmplabJenkins removed a comment on pull request #30062: URL: https://github.com/apache/spark/pull/30062#issuecomment-719212377 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

AmplabJenkins removed a comment on pull request #30062: URL: https://github.com/apache/spark/pull/30062#issuecomment-719212371 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

AmplabJenkins commented on pull request #30062: URL: https://github.com/apache/spark/pull/30062#issuecomment-719212371 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

SparkQA removed a comment on pull request #30062: URL: https://github.com/apache/spark/pull/30062#issuecomment-719135318 **[Test build #130430 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130430/testReport)** for PR 30062 at commit

[GitHub] [spark] SparkQA commented on pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

SparkQA commented on pull request #30062: URL: https://github.com/apache/spark/pull/30062#issuecomment-719210347 **[Test build #130430 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130430/testReport)** for PR 30062 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #30199: [SPARK-33296][SQL] Format exception of unsupported nested grouping analytics

AmplabJenkins commented on pull request #30199: URL: https://github.com/apache/spark/pull/30199#issuecomment-719201610 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30199: [SPARK-33296][SQL] Format exception of unsupported nested grouping analytics

AmplabJenkins removed a comment on pull request #30199: URL: https://github.com/apache/spark/pull/30199#issuecomment-719201610 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #30199: [SPARK-33296][SQL] Format exception of unsupported nested grouping analytics

SparkQA commented on pull request #30199: URL: https://github.com/apache/spark/pull/30199#issuecomment-719201537 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35043/

[GitHub] [spark] SparkQA commented on pull request #30200: [SPARK-33027][SQL] Add DisableUnnecessaryBucketedScan rule to AQE

SparkQA commented on pull request #30200: URL: https://github.com/apache/spark/pull/30200#issuecomment-719200765 **[Test build #130440 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130440/testReport)** for PR 30200 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

AmplabJenkins removed a comment on pull request #30062: URL: https://github.com/apache/spark/pull/30062#issuecomment-719199209 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

AmplabJenkins commented on pull request #30062: URL: https://github.com/apache/spark/pull/30062#issuecomment-719199209 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] c21 commented on pull request #30200: [SPARK-33027][SQL] Add DisableUnnecessaryBucketedScan rule to AQE

c21 commented on pull request #30200: URL: https://github.com/apache/spark/pull/30200#issuecomment-719196882 cc @cloud-fan if you have time to take a look, thanks. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

SparkQA removed a comment on pull request #30062: URL: https://github.com/apache/spark/pull/30062#issuecomment-719122307 **[Test build #130427 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130427/testReport)** for PR 30062 at commit

[GitHub] [spark] SparkQA commented on pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

SparkQA commented on pull request #30062: URL: https://github.com/apache/spark/pull/30062#issuecomment-719196800 **[Test build #130427 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130427/testReport)** for PR 30062 at commit

[GitHub] [spark] c21 opened a new pull request #30200: [SPARK-33027][SQL] Add DisableUnnecessaryBucketedScan rule to AQE

c21 opened a new pull request #30200: URL: https://github.com/apache/spark/pull/30200 ### What changes were proposed in this pull request? As a followup comment from https://github.com/apache/spark/pull/29804#issuecomment-700650620 , here we add add the physical plan rule

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

AmplabJenkins removed a comment on pull request #30062: URL: https://github.com/apache/spark/pull/30062#issuecomment-719195868 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

AmplabJenkins commented on pull request #30062: URL: https://github.com/apache/spark/pull/30062#issuecomment-719195868 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

SparkQA removed a comment on pull request #30062: URL: https://github.com/apache/spark/pull/30062#issuecomment-719120136 **[Test build #130426 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130426/testReport)** for PR 30062 at commit

[GitHub] [spark] SparkQA commented on pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

SparkQA commented on pull request #30062: URL: https://github.com/apache/spark/pull/30062#issuecomment-719195002 **[Test build #130426 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130426/testReport)** for PR 30062 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30198: [SPARK-33297][BUILD] Switch to use flat class loader strategy in SBT

AmplabJenkins removed a comment on pull request #30198: URL: https://github.com/apache/spark/pull/30198#issuecomment-719193825 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30198: [SPARK-33297][BUILD] Switch to use flat class loader strategy in SBT

AmplabJenkins commented on pull request #30198: URL: https://github.com/apache/spark/pull/30198#issuecomment-719193825 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30198: [SPARK-33297][BUILD] Switch to use flat class loader strategy in SBT

SparkQA commented on pull request #30198: URL: https://github.com/apache/spark/pull/30198#issuecomment-719193767 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35042/

[GitHub] [spark] HyukjinKwon closed pull request #30156: [SPARK-33248][SQL] Add a configuration to control the legacy behavior of whether need to pad null value when value size less then schema size

HyukjinKwon closed pull request #30156: URL: https://github.com/apache/spark/pull/30156 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] SparkQA commented on pull request #30199: [SPARK-33296][SQL] Format exception of unsupported nested grouping analytics

SparkQA commented on pull request #30199: URL: https://github.com/apache/spark/pull/30199#issuecomment-719185785 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35043/

[GitHub] [spark] HyukjinKwon commented on pull request #30156: [SPARK-33248][SQL] Add a configuration to control the legacy behavior of whether need to pad null value when value size less then schema

HyukjinKwon commented on pull request #30156: URL: https://github.com/apache/spark/pull/30156#issuecomment-719186403 Merged to master This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] SparkQA commented on pull request #30156: [SPARK-33248][SQL] Add a configuration to control the legacy behavior of whether need to pad null value when value size less then schema size

SparkQA commented on pull request #30156: URL: https://github.com/apache/spark/pull/30156#issuecomment-719177200 **[Test build #130439 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130439/testReport)** for PR 30156 at commit

[GitHub] [spark] AngersZhuuuu commented on pull request #30156: [SPARK-33248][SQL] Add a configuration to control the legacy behavior of whether need to pad null value when value size less then schema

AngersZh commented on pull request #30156: URL: https://github.com/apache/spark/pull/30156#issuecomment-719174956 > @AngersZh, sorry can you resolve conflict? I will just merge since the conflict is just in md file. Done

[GitHub] [spark] HyukjinKwon commented on a change in pull request #30181: [SPARK-33250][PYTHON][DOCS] Migration to NumPy documentation style in SQL (pyspark.sql.*)

HyukjinKwon commented on a change in pull request #30181: URL: https://github.com/apache/spark/pull/30181#discussion_r514863497 ## File path: python/pyspark/sql/dataframe.py ## @@ -935,19 +1090,32 @@ def sample(self, withReplacement=None, fraction=None, seed=None):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30191: [SPARK-33268][SQL][PYTHON][3.0] Fix bugs for casting data from/to PythonUserDefinedType

AmplabJenkins removed a comment on pull request #30191: URL: https://github.com/apache/spark/pull/30191#issuecomment-719172503 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30191: [SPARK-33268][SQL][PYTHON][3.0] Fix bugs for casting data from/to PythonUserDefinedType

AmplabJenkins commented on pull request #30191: URL: https://github.com/apache/spark/pull/30191#issuecomment-719172503 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30198: [SPARK-33297][BUILD] Switch to use flat class loader strategy in SBT

AmplabJenkins removed a comment on pull request #30198: URL: https://github.com/apache/spark/pull/30198#issuecomment-719170252 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on pull request #30191: [SPARK-33268][SQL][PYTHON][3.0] Fix bugs for casting data from/to PythonUserDefinedType

SparkQA removed a comment on pull request #30191: URL: https://github.com/apache/spark/pull/30191#issuecomment-719078571 **[Test build #130420 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130420/testReport)** for PR 30191 at commit

[GitHub] [spark] SparkQA commented on pull request #30191: [SPARK-33268][SQL][PYTHON][3.0] Fix bugs for casting data from/to PythonUserDefinedType

SparkQA commented on pull request #30191: URL: https://github.com/apache/spark/pull/30191#issuecomment-719170452 **[Test build #130420 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130420/testReport)** for PR 30191 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30198: [SPARK-33297][BUILD] Switch to use flat class loader strategy in SBT

AmplabJenkins removed a comment on pull request #30198: URL: https://github.com/apache/spark/pull/30198#issuecomment-719170248 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #30198: [SPARK-33297][BUILD] Switch to use flat class loader strategy in SBT

AmplabJenkins commented on pull request #30198: URL: https://github.com/apache/spark/pull/30198#issuecomment-719170248 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30198: [SPARK-33297][BUILD] Switch to use flat class loader strategy in SBT

SparkQA commented on pull request #30198: URL: https://github.com/apache/spark/pull/30198#issuecomment-719170235 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35041/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30145: [SPARK-33233][SQL]CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

AmplabJenkins removed a comment on pull request #30145: URL: https://github.com/apache/spark/pull/30145#issuecomment-719170149 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #30145: [SPARK-33233][SQL]CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

SparkQA commented on pull request #30145: URL: https://github.com/apache/spark/pull/30145#issuecomment-719170137 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35040/

[GitHub] [spark] HyukjinKwon commented on a change in pull request #30181: [SPARK-33250][PYTHON][DOCS] Migration to NumPy documentation style in SQL (pyspark.sql.*)

HyukjinKwon commented on a change in pull request #30181: URL: https://github.com/apache/spark/pull/30181#discussion_r514858052 ## File path: python/pyspark/sql/column.py ## @@ -219,11 +226,11 @@ def __init__(self, jc): |true| false| false|

[GitHub] [spark] AmplabJenkins commented on pull request #30145: [SPARK-33233][SQL]CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

AmplabJenkins commented on pull request #30145: URL: https://github.com/apache/spark/pull/30145#issuecomment-719170149 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] HyukjinKwon commented on pull request #30156: [SPARK-33248][SQL] Add a configuration to control the legacy behavior of whether need to pad null value when value size less then schema

HyukjinKwon commented on pull request #30156: URL: https://github.com/apache/spark/pull/30156#issuecomment-719169444 @AngersZh, sorry can you resolve conflict? I will just merge since the conflict is just in md file.

[GitHub] [spark] SparkQA commented on pull request #30198: [SPARK-33297][BUILD] Switch to use flat class loader strategy in SBT

SparkQA commented on pull request #30198: URL: https://github.com/apache/spark/pull/30198#issuecomment-719168632 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35042/

[GitHub] [spark] SparkQA commented on pull request #30199: [SPARK-33296][SQL] Format exception of unsupported nested grouping analytics

SparkQA commented on pull request #30199: URL: https://github.com/apache/spark/pull/30199#issuecomment-719168516 **[Test build #130438 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130438/testReport)** for PR 30199 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

AmplabJenkins commented on pull request #26935: URL: https://github.com/apache/spark/pull/26935#issuecomment-719168433 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

AmplabJenkins removed a comment on pull request #26935: URL: https://github.com/apache/spark/pull/26935#issuecomment-719168433 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

SparkQA removed a comment on pull request #26935: URL: https://github.com/apache/spark/pull/26935#issuecomment-719083509 **[Test build #130422 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130422/testReport)** for PR 26935 at commit

[GitHub] [spark] SparkQA commented on pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

SparkQA commented on pull request #26935: URL: https://github.com/apache/spark/pull/26935#issuecomment-719167440 **[Test build #130422 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130422/testReport)** for PR 26935 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30195: [SPARK-33183][SQL][3.0] Fix Optimizer rule EliminateSorts and add a physical rule to remove redundant sorts

AmplabJenkins removed a comment on pull request #30195: URL: https://github.com/apache/spark/pull/30195#issuecomment-719165952 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on pull request #30195: [SPARK-33183][SQL][3.0] Fix Optimizer rule EliminateSorts and add a physical rule to remove redundant sorts

SparkQA commented on pull request #30195: URL: https://github.com/apache/spark/pull/30195#issuecomment-719165926 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35038/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30195: [SPARK-33183][SQL][3.0] Fix Optimizer rule EliminateSorts and add a physical rule to remove redundant sorts

AmplabJenkins removed a comment on pull request #30195: URL: https://github.com/apache/spark/pull/30195#issuecomment-719165947 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #30195: [SPARK-33183][SQL][3.0] Fix Optimizer rule EliminateSorts and add a physical rule to remove redundant sorts

AmplabJenkins commented on pull request #30195: URL: https://github.com/apache/spark/pull/30195#issuecomment-719165947 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30197: [SPARK-33294][SQL] Add query resolved check before analyze InsertIntoDir

AmplabJenkins commented on pull request #30197: URL: https://github.com/apache/spark/pull/30197#issuecomment-719164495 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30197: [SPARK-33294][SQL] Add query resolved check before analyze InsertIntoDir

SparkQA commented on pull request #30197: URL: https://github.com/apache/spark/pull/30197#issuecomment-719164479 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35039/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30197: [SPARK-33294][SQL] Add query resolved check before analyze InsertIntoDir

AmplabJenkins removed a comment on pull request #30197: URL: https://github.com/apache/spark/pull/30197#issuecomment-719164495 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #30198: [SPARK-33297][BUILD] Switch to use flat class loader strategy in SBT

SparkQA commented on pull request #30198: URL: https://github.com/apache/spark/pull/30198#issuecomment-719164008 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35041/

[GitHub] [spark] AngersZhuuuu commented on pull request #30199: [SPARK-33296][SQL] Format exception of unsupported nested grouping analytics

AngersZh commented on pull request #30199: URL: https://github.com/apache/spark/pull/30199#issuecomment-719163634 FYI @maropu This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] SparkQA commented on pull request #30145: [SPARK-33233][SQL]CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

SparkQA commented on pull request #30145: URL: https://github.com/apache/spark/pull/30145#issuecomment-719163207 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35040/

[GitHub] [spark] cloud-fan commented on a change in pull request #30187: [SPARK-33290][SQL] REFRESH TABLE should invalidate cache even though the table itself may not be cached

cloud-fan commented on a change in pull request #30187: URL: https://github.com/apache/spark/pull/30187#discussion_r514830896 ## File path: sql/core/src/test/scala/org/apache/spark/sql/CachedTableSuite.scala ## @@ -1208,4 +1208,24 @@ class CachedTableSuite extends QueryTest

[GitHub] [spark] cloud-fan commented on a change in pull request #30187: [SPARK-33290][SQL] REFRESH TABLE should invalidate cache even though the table itself may not be cached

cloud-fan commented on a change in pull request #30187: URL: https://github.com/apache/spark/pull/30187#discussion_r514830043 ## File path: sql/core/src/test/scala/org/apache/spark/sql/CachedTableSuite.scala ## @@ -1208,4 +1208,24 @@ class CachedTableSuite extends QueryTest

[GitHub] [spark] AngersZhuuuu opened a new pull request #30199: [SPARK-33296][SQL] Format exception of unsupported nested grouping analytics

AngersZh opened a new pull request #30199: URL: https://github.com/apache/spark/pull/30199 ### What changes were proposed in this pull request? Nested grouping. analytics can't run but throw ambiguous exception, This pr make these case throw exceptions that are easy for users to

[GitHub] [spark] SparkQA commented on pull request #30195: [SPARK-33183][SQL][3.0] Fix Optimizer rule EliminateSorts and add a physical rule to remove redundant sorts

SparkQA commented on pull request #30195: URL: https://github.com/apache/spark/pull/30195#issuecomment-719161360 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35038/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30190: [SPARK-33292][SQL] Make Literal ArrayBasedMapData string representation disambiguous

AmplabJenkins removed a comment on pull request #30190: URL: https://github.com/apache/spark/pull/30190#issuecomment-719159450 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #30198: [SPARK-33297][BUILD] Switch to use flat class loader strategy in SBT

SparkQA commented on pull request #30198: URL: https://github.com/apache/spark/pull/30198#issuecomment-719159577 **[Test build #130437 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130437/testReport)** for PR 30198 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #30190: [SPARK-33292][SQL] Make Literal ArrayBasedMapData string representation disambiguous

AmplabJenkins commented on pull request #30190: URL: https://github.com/apache/spark/pull/30190#issuecomment-719159450 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30197: [SPARK-33294][SQL] Add query resolved check before analyze InsertIntoDir

SparkQA commented on pull request #30197: URL: https://github.com/apache/spark/pull/30197#issuecomment-719159428 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35039/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

AmplabJenkins removed a comment on pull request #30062: URL: https://github.com/apache/spark/pull/30062#issuecomment-719158845 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on pull request #30190: [SPARK-33292][SQL] Make Literal ArrayBasedMapData string representation disambiguous

SparkQA removed a comment on pull request #30190: URL: https://github.com/apache/spark/pull/30190#issuecomment-719073324 **[Test build #130419 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130419/testReport)** for PR 30190 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

AmplabJenkins removed a comment on pull request #30062: URL: https://github.com/apache/spark/pull/30062#issuecomment-719158836 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

AmplabJenkins commented on pull request #30062: URL: https://github.com/apache/spark/pull/30062#issuecomment-719158836 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30190: [SPARK-33292][SQL] Make Literal ArrayBasedMapData string representation disambiguous

SparkQA commented on pull request #30190: URL: https://github.com/apache/spark/pull/30190#issuecomment-719158764 **[Test build #130419 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130419/testReport)** for PR 30190 at commit

[GitHub] [spark] SparkQA commented on pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

SparkQA commented on pull request #30062: URL: https://github.com/apache/spark/pull/30062#issuecomment-719158826 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35035/

[GitHub] [spark] SparkQA commented on pull request #30198: [SPARK-33297][BUILD] Switch to use flat class loader strategy in SBT

SparkQA commented on pull request #30198: URL: https://github.com/apache/spark/pull/30198#issuecomment-719155376 **[Test build #130436 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130436/testReport)** for PR 30198 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

AmplabJenkins removed a comment on pull request #30062: URL: https://github.com/apache/spark/pull/30062#issuecomment-719155227 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

AmplabJenkins removed a comment on pull request #30062: URL: https://github.com/apache/spark/pull/30062#issuecomment-719155222 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

AmplabJenkins commented on pull request #30062: URL: https://github.com/apache/spark/pull/30062#issuecomment-719155222 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #30145: [SPARK-33233][SQL]CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

AngersZh commented on a change in pull request #30145: URL: https://github.com/apache/spark/pull/30145#discussion_r514793291 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala ## @@ -244,6 +244,7 @@ class Analyzer(

[GitHub] [spark] SparkQA removed a comment on pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

SparkQA removed a comment on pull request #30062: URL: https://github.com/apache/spark/pull/30062#issuecomment-719107693 **[Test build #130423 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130423/testReport)** for PR 30062 at commit

[GitHub] [spark] HyukjinKwon opened a new pull request #30198: [SPARK-33297][BUILD] Switch to use flat class loader strategy in SBT

HyukjinKwon opened a new pull request #30198: URL: https://github.com/apache/spark/pull/30198 ### What changes were proposed in this pull request? This PR proposes to switch the class loader strategy from `ScalaLibrary` to `Flat` (see

[GitHub] [spark] SparkQA commented on pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

SparkQA commented on pull request #30062: URL: https://github.com/apache/spark/pull/30062#issuecomment-719153334 **[Test build #130423 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130423/testReport)** for PR 30062 at commit

[GitHub] [spark] maropu commented on a change in pull request #30145: [SPARK-33233][SQL]CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

maropu commented on a change in pull request #30145: URL: https://github.com/apache/spark/pull/30145#discussion_r514791819 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala ## @@ -244,6 +244,7 @@ class Analyzer(

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30196: [SPARK-33292][SQL][2.4] Make Literal ArrayBasedMapData string representation disambiguous

AmplabJenkins removed a comment on pull request #30196: URL: https://github.com/apache/spark/pull/30196#issuecomment-719152026 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #30196: [SPARK-33292][SQL][2.4] Make Literal ArrayBasedMapData string representation disambiguous

SparkQA commented on pull request #30196: URL: https://github.com/apache/spark/pull/30196#issuecomment-719152009 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35037/

[GitHub] [spark] maropu commented on pull request #30191: [SPARK-33268][SQL][PYTHON][3.0] Fix bugs for casting data from/to PythonUserDefinedType

maropu commented on pull request #30191: URL: https://github.com/apache/spark/pull/30191#issuecomment-719152096 Thanks, all ~ This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30196: [SPARK-33292][SQL][2.4] Make Literal ArrayBasedMapData string representation disambiguous

AmplabJenkins commented on pull request #30196: URL: https://github.com/apache/spark/pull/30196#issuecomment-719152026 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30145: [SPARK-33233][SQL]CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

SparkQA commented on pull request #30145: URL: https://github.com/apache/spark/pull/30145#issuecomment-719151600 **[Test build #130435 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130435/testReport)** for PR 30145 at commit

[GitHub] [spark] SparkQA commented on pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

SparkQA commented on pull request #30062: URL: https://github.com/apache/spark/pull/30062#issuecomment-719151559 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35035/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30189: [SPARK-33291][SQL] Improve DataFrame.show for nulls in arrays and structs

AmplabJenkins removed a comment on pull request #30189: URL: https://github.com/apache/spark/pull/30189#issuecomment-719150069 This is an automated message from the Apache Git Service. To respond to the message, please log on

  1   2   3   4   5   6   7   >