[GitHub] [spark] AmplabJenkins commented on pull request #30573: [SPARK-26341][CORE]Expose executor memory metrics at the stage level, in the Stages tab

AmplabJenkins commented on pull request #30573: URL: https://github.com/apache/spark/pull/30573#issuecomment-738701059 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132202/

[GitHub] [spark] AmplabJenkins commented on pull request #30564: [SPARK-32670][SQL][FOLLOWUP] Group exception messages in Catalyst Analyzer in one file

AmplabJenkins commented on pull request #30564: URL: https://github.com/apache/spark/pull/30564#issuecomment-738701063 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132203/

[GitHub] [spark] AmplabJenkins commented on pull request #30586: [SPARK-33641][SQL] Invalidate new char-like types in public APIs that produce incorrect results

AmplabJenkins commented on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738701055 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30312: [SPARK-32917][SHUFFLE][CORE] Adds support for executors to push shuffle blocks after successful map task completion

AmplabJenkins commented on pull request #30312: URL: https://github.com/apache/spark/pull/30312#issuecomment-738701060 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132204/

[GitHub] [spark] AmplabJenkins commented on pull request #30595: [SPARK-33651][SQL] Allow CREATE EXTERNAL TABLE with LOCATION for data source tables

AmplabJenkins commented on pull request #30595: URL: https://github.com/apache/spark/pull/30595#issuecomment-738701061 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30595: [SPARK-33651][SQL] Allow CREATE EXTERNAL TABLE with LOCATION for data source tables

SparkQA commented on pull request #30595: URL: https://github.com/apache/spark/pull/30595#issuecomment-738700892 **[Test build #132210 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132210/testReport)** for PR 30595 at commit

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #30573: [SPARK-26341][CORE]Expose executor memory metrics at the stage level, in the Stages tab

AngersZh commented on a change in pull request #30573: URL: https://github.com/apache/spark/pull/30573#discussion_r535991231 ## File path: core/src/test/resources/HistoryServerExpectations/excludeOnFailure_for_stage_expectation.json ## @@ -698,6 +698,28 @@

[GitHub] [spark] SparkQA commented on pull request #30595: [SPARK-33651][SQL] Allow CREATE EXTERNAL TABLE with LOCATION for data source tables

SparkQA commented on pull request #30595: URL: https://github.com/apache/spark/pull/30595#issuecomment-738699459 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36816/

[GitHub] [spark] SparkQA removed a comment on pull request #30586: [SPARK-33641][SQL] Invalidate new char-like types in public APIs that produce incorrect results

SparkQA removed a comment on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738640150 **[Test build #132211 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132211/testReport)** for PR 30586 at commit

[GitHub] [spark] SparkQA commented on pull request #30586: [SPARK-33641][SQL] Invalidate new char-like types in public APIs that produce incorrect results

SparkQA commented on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738698633 **[Test build #132211 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132211/testReport)** for PR 30586 at commit

[GitHub] [spark] SparkQA commented on pull request #30604: [SPARK-33571][SQL][DOCS][3.0] Add a ref to INT96 config from the doc for `spark.sql.legacy.parquet.datetimeRebaseModeInWrite/Read`

SparkQA commented on pull request #30604: URL: https://github.com/apache/spark/pull/30604#issuecomment-738695745 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36815/

[GitHub] [spark] SparkQA commented on pull request #30559: [SPARK-33617][SQL] Add default parallelism configuration for Spark SQL queries

SparkQA commented on pull request #30559: URL: https://github.com/apache/spark/pull/30559#issuecomment-738694834 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36814/

[GitHub] [spark] SparkQA commented on pull request #30573: [SPARK-26341][CORE]Expose executor memory metrics at the stage level, in the Stages tab

SparkQA commented on pull request #30573: URL: https://github.com/apache/spark/pull/30573#issuecomment-738694695 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36812/

[GitHub] [spark] SparkQA commented on pull request #30586: [SPARK-33641][SQL] Invalidate new char-like types in public APIs that produce incorrect results

SparkQA commented on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738694503 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36811/

[GitHub] [spark] SparkQA removed a comment on pull request #30564: [SPARK-32670][SQL][FOLLOWUP] Group exception messages in Catalyst Analyzer in one file

SparkQA removed a comment on pull request #30564: URL: https://github.com/apache/spark/pull/30564#issuecomment-738615629 **[Test build #132203 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132203/testReport)** for PR 30564 at commit

[GitHub] [spark] SparkQA commented on pull request #30564: [SPARK-32670][SQL][FOLLOWUP] Group exception messages in Catalyst Analyzer in one file

SparkQA commented on pull request #30564: URL: https://github.com/apache/spark/pull/30564#issuecomment-738691395 **[Test build #132203 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132203/testReport)** for PR 30564 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #30586: [SPARK-33641][SQL] Invalidate new char-like types in public APIs that produce incorrect results

SparkQA removed a comment on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738577546 **[Test build #132190 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132190/testReport)** for PR 30586 at commit

[GitHub] [spark] SparkQA commented on pull request #30586: [SPARK-33641][SQL] Invalidate new char-like types in public APIs that produce incorrect results

SparkQA commented on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738690600 **[Test build #132190 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132190/testReport)** for PR 30586 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #30573: [SPARK-26341][CORE]Expose executor memory metrics at the stage level, in the Stages tab

SparkQA removed a comment on pull request #30573: URL: https://github.com/apache/spark/pull/30573#issuecomment-738615591 **[Test build #132202 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132202/testReport)** for PR 30573 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #30312: [SPARK-32917][SHUFFLE][CORE] Adds support for executors to push shuffle blocks after successful map task completion

SparkQA removed a comment on pull request #30312: URL: https://github.com/apache/spark/pull/30312#issuecomment-738615923 **[Test build #132204 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132204/testReport)** for PR 30312 at commit

[GitHub] [spark] SparkQA commented on pull request #30312: [SPARK-32917][SHUFFLE][CORE] Adds support for executors to push shuffle blocks after successful map task completion

SparkQA commented on pull request #30312: URL: https://github.com/apache/spark/pull/30312#issuecomment-738687310 **[Test build #132204 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132204/testReport)** for PR 30312 at commit

[GitHub] [spark] SparkQA commented on pull request #30573: [SPARK-26341][CORE]Expose executor memory metrics at the stage level, in the Stages tab

SparkQA commented on pull request #30573: URL: https://github.com/apache/spark/pull/30573#issuecomment-738687289 **[Test build #132202 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132202/testReport)** for PR 30573 at commit

[GitHub] [spark] SparkQA commented on pull request #30595: [SPARK-33651][SQL] Allow CREATE EXTERNAL TABLE with LOCATION for data source tables

SparkQA commented on pull request #30595: URL: https://github.com/apache/spark/pull/30595#issuecomment-738684001 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36810/

[GitHub] [spark] SparkQA commented on pull request #30421: [SPARK-33474][SQL] Support TypeConstructed partition spec value

SparkQA commented on pull request #30421: URL: https://github.com/apache/spark/pull/30421#issuecomment-738683038 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36808/

[GitHub] [spark] SparkQA commented on pull request #30590: [SPARK-33592][ML][PYTHON][3.0] Backport Fix: Pyspark ML Validator params in estimatorParamMaps may be lost after saving and reloading

SparkQA commented on pull request #30590: URL: https://github.com/apache/spark/pull/30590#issuecomment-738682377 **[Test build #13 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13/testReport)** for PR 30590 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30597: [SPARK-33652][SQL] DSv2: DeleteFrom should refresh cache

AmplabJenkins removed a comment on pull request #30597: URL: https://github.com/apache/spark/pull/30597#issuecomment-738680867 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36809/

[GitHub] [spark] SparkQA commented on pull request #30597: [SPARK-33652][SQL] DSv2: DeleteFrom should refresh cache

SparkQA commented on pull request #30597: URL: https://github.com/apache/spark/pull/30597#issuecomment-738680833 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36809/

[GitHub] [spark] AmplabJenkins commented on pull request #30597: [SPARK-33652][SQL] DSv2: DeleteFrom should refresh cache

AmplabJenkins commented on pull request #30597: URL: https://github.com/apache/spark/pull/30597#issuecomment-738680867 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36809/

[GitHub] [spark] zhengruifeng commented on pull request #30590: [SPARK-33592][ML][PYTHON][3.0] Backport Fix: Pyspark ML Validator params in estimatorParamMaps may be lost after saving and reloading

zhengruifeng commented on pull request #30590: URL: https://github.com/apache/spark/pull/30590#issuecomment-738680570 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] WeichenXu123 commented on pull request #30590: [SPARK-33592][ML][PYTHON][3.0] Backport Fix: Pyspark ML Validator params in estimatorParamMaps may be lost after saving and reloading

WeichenXu123 commented on pull request #30590: URL: https://github.com/apache/spark/pull/30590#issuecomment-738680529 Jenkins retest this This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] SparkQA commented on pull request #30586: [SPARK-33641][SQL] Invalidate new char-like types in public APIs that produce incorrect results

SparkQA commented on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738680084 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36811/

[GitHub] [spark] gengliangwang commented on a change in pull request #30573: [SPARK-26341][CORE]Expose executor memory metrics at the stage level, in the Stages tab

gengliangwang commented on a change in pull request #30573: URL: https://github.com/apache/spark/pull/30573#discussion_r535955823 ## File path: core/src/main/scala/org/apache/spark/status/LiveEntity.scala ## @@ -386,7 +386,7 @@ private class LiveExecutorStageSummary(

[GitHub] [spark] gengliangwang commented on a change in pull request #30573: [SPARK-26341][CORE]Expose executor memory metrics at the stage level, in the Stages tab

gengliangwang commented on a change in pull request #30573: URL: https://github.com/apache/spark/pull/30573#discussion_r535955674 ## File path: core/src/test/resources/HistoryServerExpectations/excludeOnFailure_for_stage_expectation.json ## @@ -698,6 +698,28 @@

[GitHub] [spark] gengliangwang commented on a change in pull request #30573: [SPARK-26341][CORE]Expose executor memory metrics at the stage level, in the Stages tab

gengliangwang commented on a change in pull request #30573: URL: https://github.com/apache/spark/pull/30573#discussion_r535954000 ## File path: core/src/main/scala/org/apache/spark/status/LiveEntity.scala ## @@ -386,7 +386,7 @@ private class LiveExecutorStageSummary(

[GitHub] [spark] SparkQA commented on pull request #29642: [SPARK-32792][SQL] Improve InSet filter pushdown

SparkQA commented on pull request #29642: URL: https://github.com/apache/spark/pull/29642#issuecomment-738672069 **[Test build #132221 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132221/testReport)** for PR 29642 at commit

[GitHub] [spark] SparkQA commented on pull request #30559: [SPARK-33617][SQL] Add default parallelism configuration for Spark SQL queries

SparkQA commented on pull request #30559: URL: https://github.com/apache/spark/pull/30559#issuecomment-738671891 **[Test build #132219 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132219/testReport)** for PR 30559 at commit

[GitHub] [spark] SparkQA commented on pull request #30575: [SPARK-33141][SQL][FOLLOW-UP] Store the max nested view depth in AnalysisContext

SparkQA commented on pull request #30575: URL: https://github.com/apache/spark/pull/30575#issuecomment-738671716 **[Test build #132217 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132217/testReport)** for PR 30575 at commit

[GitHub] [spark] SparkQA commented on pull request #30573: [SPARK-26341][CORE]Expose executor memory metrics at the stage level, in the Stages tab

SparkQA commented on pull request #30573: URL: https://github.com/apache/spark/pull/30573#issuecomment-738671761 **[Test build #132218 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132218/testReport)** for PR 30573 at commit

[GitHub] [spark] SparkQA commented on pull request #30604: [SPARK-33571][SQL][DOCS][3.0] Add a ref to INT96 config from the doc for `spark.sql.legacy.parquet.datetimeRebaseModeInWrite/Read`

SparkQA commented on pull request #30604: URL: https://github.com/apache/spark/pull/30604#issuecomment-738671709 **[Test build #132214 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132214/testReport)** for PR 30604 at commit

[GitHub] [spark] SparkQA commented on pull request #30387: [SPARK-33443][SQL] LEAD/LAG should support [ IGNORE NULLS | RESPECT NULLS ]

SparkQA commented on pull request #30387: URL: https://github.com/apache/spark/pull/30387#issuecomment-738671613 **[Test build #132220 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132220/testReport)** for PR 30387 at commit

[GitHub] [spark] AngersZhuuuu commented on pull request #30573: [SPARK-26341][CORE]Expose executor memory metrics at the stage level, in the Stages tab

AngersZh commented on pull request #30573: URL: https://github.com/apache/spark/pull/30573#issuecomment-738671603 > > Have change back, Use the latest code? > > O.K, it doesn't happen on the latest code. Yea, I miss some code relation and make the wrong change, sorry for

[GitHub] [spark] SparkQA commented on pull request #30586: [SPARK-33641][SQL] Invalidate new char-like types in public APIs that produce incorrect results

SparkQA commented on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738671394 **[Test build #132216 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132216/testReport)** for PR 30586 at commit

[GitHub] [spark] SparkQA commented on pull request #30595: [SPARK-33651][SQL] Allow CREATE EXTERNAL TABLE with LOCATION for data source tables

SparkQA commented on pull request #30595: URL: https://github.com/apache/spark/pull/30595#issuecomment-738671359 **[Test build #132215 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132215/testReport)** for PR 30595 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30603: [SPARK-33658][SQL] Suggest using Datetime conversion functions for invalid ANSI casting

AmplabJenkins removed a comment on pull request #30603: URL: https://github.com/apache/spark/pull/30603#issuecomment-738670707 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132186/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30312: [SPARK-32917][SHUFFLE][CORE] Adds support for executors to push shuffle blocks after successful map task completion

AmplabJenkins removed a comment on pull request #30312: URL: https://github.com/apache/spark/pull/30312#issuecomment-738670712 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36805/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30573: [SPARK-26341][CORE]Expose executor memory metrics at the stage level, in the Stages tab

AmplabJenkins removed a comment on pull request #30573: URL: https://github.com/apache/spark/pull/30573#issuecomment-738670703 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36803/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30586: [SPARK-33641][SQL] Invalidate new char-like types in public APIs that produce incorrect results

AmplabJenkins removed a comment on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738670708 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30598: [SPARK-33654][SQL] Migrate CACHE TABLE to use UnresolvedRelation to resolve identifier

AmplabJenkins removed a comment on pull request #30598: URL: https://github.com/apache/spark/pull/30598#issuecomment-738670705 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36801/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30564: [SPARK-32670][SQL][FOLLOWUP] Group exception messages in Catalyst Analyzer in one file

AmplabJenkins removed a comment on pull request #30564: URL: https://github.com/apache/spark/pull/30564#issuecomment-738670704 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36804/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30559: [SPARK-33617][SQL] Add default parallelism configuration for Spark SQL queries

AmplabJenkins removed a comment on pull request #30559: URL: https://github.com/apache/spark/pull/30559#issuecomment-738670714 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36807/

[GitHub] [spark] sarutak commented on pull request #30573: [SPARK-26341][CORE]Expose executor memory metrics at the stage level, in the Stages tab

sarutak commented on pull request #30573: URL: https://github.com/apache/spark/pull/30573#issuecomment-738670917 > Have change back, Use the latest code? O.K, it doesn't happen on the latest code. This is an automated

[GitHub] [spark] AmplabJenkins commented on pull request #30603: [SPARK-33658][SQL] Suggest using Datetime conversion functions for invalid ANSI casting

AmplabJenkins commented on pull request #30603: URL: https://github.com/apache/spark/pull/30603#issuecomment-738670707 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132186/

[GitHub] [spark] AmplabJenkins commented on pull request #30564: [SPARK-32670][SQL][FOLLOWUP] Group exception messages in Catalyst Analyzer in one file

AmplabJenkins commented on pull request #30564: URL: https://github.com/apache/spark/pull/30564#issuecomment-738670704 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36804/

[GitHub] [spark] AmplabJenkins commented on pull request #30598: [SPARK-33654][SQL] Migrate CACHE TABLE to use UnresolvedRelation to resolve identifier

AmplabJenkins commented on pull request #30598: URL: https://github.com/apache/spark/pull/30598#issuecomment-738670705 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36801/

[GitHub] [spark] AmplabJenkins commented on pull request #30586: [SPARK-33641][SQL] Invalidate new char-like types in public APIs that produce incorrect results

AmplabJenkins commented on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738670708 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30559: [SPARK-33617][SQL] Add default parallelism configuration for Spark SQL queries

AmplabJenkins commented on pull request #30559: URL: https://github.com/apache/spark/pull/30559#issuecomment-738670714 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36807/

[GitHub] [spark] AmplabJenkins commented on pull request #30573: [SPARK-26341][CORE]Expose executor memory metrics at the stage level, in the Stages tab

AmplabJenkins commented on pull request #30573: URL: https://github.com/apache/spark/pull/30573#issuecomment-738670703 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36803/

[GitHub] [spark] AmplabJenkins commented on pull request #30312: [SPARK-32917][SHUFFLE][CORE] Adds support for executors to push shuffle blocks after successful map task completion

AmplabJenkins commented on pull request #30312: URL: https://github.com/apache/spark/pull/30312#issuecomment-738670712 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36805/

[GitHub] [spark] AngersZhuuuu commented on pull request #30573: [SPARK-26341][CORE]Expose executor memory metrics at the stage level, in the Stages tab

AngersZh commented on pull request #30573: URL: https://github.com/apache/spark/pull/30573#issuecomment-738669196 > When we visit the StagePage, we'll get the following error. Have change back, Use the latest code?

[GitHub] [spark] sarutak commented on pull request #30573: [SPARK-26341][CORE]Expose executor memory metrics at the stage level, in the Stages tab

sarutak commented on pull request #30573: URL: https://github.com/apache/spark/pull/30573#issuecomment-738668569 When we visit the StagePage, we'll get the following error. ``` 20/12/04 18:09:36 WARN HttpChannel: handleException /api/v1/applications/local-1607072949034/stages/0/0

[GitHub] [spark] SparkQA removed a comment on pull request #30586: [SPARK-33641][SQL] Invalidate new char-like types in public APIs that produce incorrect results

SparkQA removed a comment on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738617264 **[Test build #132205 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132205/testReport)** for PR 30586 at commit

[GitHub] [spark] SparkQA commented on pull request #30586: [SPARK-33641][SQL] Invalidate new char-like types in public APIs that produce incorrect results

SparkQA commented on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738667485 **[Test build #132205 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132205/testReport)** for PR 30586 at commit

[GitHub] [spark] SparkQA commented on pull request #30421: [SPARK-33474][SQL] Support TypeConstructed partition spec value

SparkQA commented on pull request #30421: URL: https://github.com/apache/spark/pull/30421#issuecomment-738666071 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36808/

[GitHub] [spark] SparkQA commented on pull request #30595: [SPARK-33651][SQL] Allow CREATE EXTERNAL TABLE with LOCATION for data source tables

SparkQA commented on pull request #30595: URL: https://github.com/apache/spark/pull/30595#issuecomment-738665366 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36810/

[GitHub] [spark] wangyum commented on pull request #29642: [SPARK-32792][SQL] Improve InSet filter pushdown

wangyum commented on pull request #29642: URL: https://github.com/apache/spark/pull/29642#issuecomment-738663385 retest this please. This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] SparkQA commented on pull request #30597: [SPARK-33652][SQL] DSv2: DeleteFrom should refresh cache

SparkQA commented on pull request #30597: URL: https://github.com/apache/spark/pull/30597#issuecomment-738662926 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36809/

[GitHub] [spark] SparkQA removed a comment on pull request #30603: [SPARK-33658][SQL] Suggest using Datetime conversion functions for invalid ANSI casting

SparkQA removed a comment on pull request #30603: URL: https://github.com/apache/spark/pull/30603#issuecomment-738556731 **[Test build #132186 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132186/testReport)** for PR 30603 at commit

[GitHub] [spark] SparkQA commented on pull request #30603: [SPARK-33658][SQL] Suggest using Datetime conversion functions for invalid ANSI casting

SparkQA commented on pull request #30603: URL: https://github.com/apache/spark/pull/30603#issuecomment-738662200 **[Test build #132186 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132186/testReport)** for PR 30603 at commit

[GitHub] [spark] wangyum commented on pull request #29642: [SPARK-32792][SQL] Improve InSet filter pushdown

wangyum commented on pull request #29642: URL: https://github.com/apache/spark/pull/29642#issuecomment-738661573 ```scala package org.apache.spark.sql.execution.benchmark import java.io.File import scala.util.Random import org.apache.spark.SparkConf import

[GitHub] [spark] SparkQA commented on pull request #30312: [SPARK-32917][SHUFFLE][CORE] Adds support for executors to push shuffle blocks after successful map task completion

SparkQA commented on pull request #30312: URL: https://github.com/apache/spark/pull/30312#issuecomment-738660094 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36805/

[GitHub] [spark] SparkQA commented on pull request #30573: [SPARK-26341][CORE]Expose executor memory metrics at the stage level, in the Stages tab

SparkQA commented on pull request #30573: URL: https://github.com/apache/spark/pull/30573#issuecomment-738659920 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36803/

[GitHub] [spark] SparkQA commented on pull request #30564: [SPARK-32670][SQL][FOLLOWUP] Group exception messages in Catalyst Analyzer in one file

SparkQA commented on pull request #30564: URL: https://github.com/apache/spark/pull/30564#issuecomment-738659854 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36804/

[GitHub] [spark] SparkQA commented on pull request #30559: [SPARK-33617][SQL] Add default parallelism configuration for Spark SQL queries

SparkQA commented on pull request #30559: URL: https://github.com/apache/spark/pull/30559#issuecomment-738657942 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36807/

[GitHub] [spark] SparkQA commented on pull request #30586: [SPARK-33641][SQL] Invalidate new char-like types in public APIs that produce incorrect results

SparkQA commented on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738657542 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36806/

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30595: [SPARK-33651][SQL] Allow CREATE EXTERNAL TABLE with LOCATION for data source tables

dongjoon-hyun commented on a change in pull request #30595: URL: https://github.com/apache/spark/pull/30595#discussion_r535936234 ## File path: sql/core/src/test/scala/org/apache/spark/sql/connector/TestV2SessionCatalogBase.scala ## @@ -70,7 +70,21 @@ private[connector] trait

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #30421: [SPARK-33474][SQL] Support TypeConstructed partition spec value

AngersZh commented on a change in pull request #30421: URL: https://github.com/apache/spark/pull/30421#discussion_r535936734 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala ## @@ -509,13 +509,28 @@ class AstBuilder extends

[GitHub] [spark] gaborgsomogyi commented on pull request #30583: [SPARK-33640][TESTS] Extend connection timeout to DB server for DB2IntegrationSuite and its variants

gaborgsomogyi commented on pull request #30583: URL: https://github.com/apache/spark/pull/30583#issuecomment-738656326 Late LGTM. Thanks for notifying. This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] ulysses-you commented on pull request #30559: [SPARK-33617][SQL] Add default parallelism configuration for Spark SQL queries

ulysses-you commented on pull request #30559: URL: https://github.com/apache/spark/pull/30559#issuecomment-738655291 ah, it's a nice config. You can get something needed from [#28778](https://github.com/apache/spark/pull/28778).

[GitHub] [spark] gaborgsomogyi commented on pull request #30601: [SPARK-33656][TESTS] Add option to keep container after tests finish for DockerJDBCIntegrationSuites for debug

gaborgsomogyi commented on pull request #30601: URL: https://github.com/apache/spark/pull/30601#issuecomment-738654639 I was thinking about this before but never reached. Good to see that somebody added it because it's useful.

[GitHub] [spark] MaxGekk commented on pull request #30596: [SPARK-33571][SQL][DOCS] Add a ref to INT96 config from the doc for `spark.sql.legacy.parquet.datetimeRebaseModeInWrite/Read`

MaxGekk commented on pull request #30596: URL: https://github.com/apache/spark/pull/30596#issuecomment-738654352 @HyukjinKwon Here is the backport to branch-3.0 https://github.com/apache/spark/pull/30604 This is an

[GitHub] [spark] MaxGekk opened a new pull request #30604: [SPARK-33571][SQL][DOCS][3.0] Add a ref to INT96 config from the doc for `spark.sql.legacy.parquet.datetimeRebaseModeInWrite/Read`

MaxGekk opened a new pull request #30604: URL: https://github.com/apache/spark/pull/30604 ### What changes were proposed in this pull request? For the SQL configs `spark.sql.legacy.parquet.datetimeRebaseModeInWrite` and `spark.sql.legacy.parquet.datetimeRebaseModeInRead`, improve their

[GitHub] [spark] beliefer commented on a change in pull request #30564: [SPARK-32670][SQL][FOLLOWUP] Group exception messages in Catalyst Analyzer in one file

beliefer commented on a change in pull request #30564: URL: https://github.com/apache/spark/pull/30564#discussion_r535933387 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/QueryCompilationErrors.scala ## @@ -159,6 +164,174 @@ object QueryCompilationErrors {

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #30573: [SPARK-26341][CORE]Expose executor memory metrics at the stage level, in the Stages tab

AngersZh commented on a change in pull request #30573: URL: https://github.com/apache/spark/pull/30573#discussion_r535931995 ## File path: core/src/main/scala/org/apache/spark/status/LiveEntity.scala ## @@ -386,7 +386,7 @@ private class LiveExecutorStageSummary(

[GitHub] [spark] beliefer commented on a change in pull request #30387: [SPARK-33443][SQL] LEAD/LAG should support [ IGNORE NULLS | RESPECT NULLS ]

beliefer commented on a change in pull request #30387: URL: https://github.com/apache/spark/pull/30387#discussion_r535930689 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/window/WindowExecBase.scala ## @@ -136,8 +136,8 @@ trait WindowExecBase extends

[GitHub] [spark] WeichenXu123 commented on pull request #30587: [MINOR][ML] Improve LogisticRegression test error tolerance

WeichenXu123 commented on pull request #30587: URL: https://github.com/apache/spark/pull/30587#issuecomment-738649588 @srowen Is this change ok now? We need backport this to spark 3.1 branch, the adaptive blockify feature added in spark 3.1 increase the probability of this Bounded MLOR

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30586: [SPARK-33641][SQL] Invalidate new char-like types in public APIs that produce incorrect results

AmplabJenkins removed a comment on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738648532 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36802/

[GitHub] [spark] AmplabJenkins commented on pull request #30586: [SPARK-33641][SQL] Invalidate new char-like types in public APIs that produce incorrect results

AmplabJenkins commented on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738648532 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36802/

[GitHub] [spark] SparkQA commented on pull request #30586: [SPARK-33641][SQL] Invalidate new char-like types in public APIs that produce incorrect results

SparkQA commented on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738648504 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36802/

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #30573: [SPARK-26341][CORE]Expose executor memory metrics at the stage level, in the Stages tab

AngersZh commented on a change in pull request #30573: URL: https://github.com/apache/spark/pull/30573#discussion_r535927658 ## File path: core/src/main/resources/org/apache/spark/ui/static/webui.css ## @@ -357,6 +357,10 @@ a.expandbutton { width: 180px; }

[GitHub] [spark] SparkQA commented on pull request #30573: [SPARK-26341][CORE]Expose executor memory metrics at the stage level, in the Stages tab

SparkQA commented on pull request #30573: URL: https://github.com/apache/spark/pull/30573#issuecomment-738645780 **[Test build #132213 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132213/testReport)** for PR 30573 at commit

[GitHub] [spark] gengliangwang commented on a change in pull request #30573: [SPARK-26341][CORE]Expose executor memory metrics at the stage level, in the Stages tab

gengliangwang commented on a change in pull request #30573: URL: https://github.com/apache/spark/pull/30573#discussion_r535922748 ## File path: core/src/main/scala/org/apache/spark/status/LiveEntity.scala ## @@ -386,7 +386,7 @@ private class LiveExecutorStageSummary(

[GitHub] [spark] SparkQA commented on pull request #30559: [SPARK-33617][SQL] Add default parallelism configuration for Spark SQL queries

SparkQA commented on pull request #30559: URL: https://github.com/apache/spark/pull/30559#issuecomment-738643420 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36807/

[GitHub] [spark] SparkQA commented on pull request #30312: [SPARK-32917][SHUFFLE][CORE] Adds support for executors to push shuffle blocks after successful map task completion

SparkQA commented on pull request #30312: URL: https://github.com/apache/spark/pull/30312#issuecomment-738642898 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36805/

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #30573: [SPARK-26341][CORE]Expose executor memory metrics at the stage level, in the Stages tab

AngersZh commented on a change in pull request #30573: URL: https://github.com/apache/spark/pull/30573#discussion_r535920913 ## File path: core/src/main/scala/org/apache/spark/status/LiveEntity.scala ## @@ -386,7 +386,7 @@ private class LiveExecutorStageSummary(

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30581: [SPARK-33615][K8S] Make 'spark.archives' working in Kubernates

AmplabJenkins removed a comment on pull request #30581: URL: https://github.com/apache/spark/pull/30581#issuecomment-738642011 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132195/

[GitHub] [spark] gengliangwang commented on a change in pull request #30573: [SPARK-26341][CORE]Expose executor memory metrics at the stage level, in the Stages tab

gengliangwang commented on a change in pull request #30573: URL: https://github.com/apache/spark/pull/30573#discussion_r535920389 ## File path: core/src/main/resources/org/apache/spark/ui/static/webui.css ## @@ -357,6 +357,10 @@ a.expandbutton { width: 180px; }

[GitHub] [spark] AmplabJenkins commented on pull request #30581: [SPARK-33615][K8S] Make 'spark.archives' working in Kubernates

AmplabJenkins commented on pull request #30581: URL: https://github.com/apache/spark/pull/30581#issuecomment-738642011 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132195/

[GitHub] [spark] SparkQA commented on pull request #30573: [SPARK-26341][CORE]Expose executor memory metrics at the stage level, in the Stages tab

SparkQA commented on pull request #30573: URL: https://github.com/apache/spark/pull/30573#issuecomment-738641830 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36803/

[GitHub] [spark] SparkQA removed a comment on pull request #30581: [SPARK-33615][K8S] Make 'spark.archives' working in Kubernates

SparkQA removed a comment on pull request #30581: URL: https://github.com/apache/spark/pull/30581#issuecomment-738591809 **[Test build #132195 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132195/testReport)** for PR 30581 at commit

[GitHub] [spark] SparkQA commented on pull request #30586: [SPARK-33641][SQL] Invalidate new char-like types in public APIs that produce incorrect results

SparkQA commented on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-738641687 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36806/

<    2   3   4   5   6   7   8   >