[GitHub] [spark] SparkQA removed a comment on pull request #30598: [SPARK-33654][SQL] Migrate CACHE TABLE to use UnresolvedRelation to resolve identifier

2020-12-06 Thread GitBox
SparkQA removed a comment on pull request #30598: URL: https://github.com/apache/spark/pull/30598#issuecomment-739626713 **[Test build #132315 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132315/testReport)** for PR 30598 at commit

[GitHub] [spark] SparkQA commented on pull request #30598: [SPARK-33654][SQL] Migrate CACHE TABLE to use UnresolvedRelation to resolve identifier

2020-12-06 Thread GitBox
SparkQA commented on pull request #30598: URL: https://github.com/apache/spark/pull/30598#issuecomment-739652928 **[Test build #132315 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132315/testReport)** for PR 30598 at commit

[GitHub] [spark] AngersZhuuuu commented on pull request #30573: [SPARK-26341][WEBUI]Expose executor memory metrics at the stage level, in the Stages tab

2020-12-06 Thread GitBox
AngersZh commented on pull request #30573: URL: https://github.com/apache/spark/pull/30573#issuecomment-739652813 ping @sarutak @gengliangwang Any more update about merge this in spark-3.1.0? This is an automated message

[GitHub] [spark] SparkQA commented on pull request #29966: [SPARK-33084][CORE][SQL] Add jar support ivy path

2020-12-06 Thread GitBox
SparkQA commented on pull request #29966: URL: https://github.com/apache/spark/pull/29966#issuecomment-739652708 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36921/

[GitHub] [spark] SparkQA removed a comment on pull request #30564: [SPARK-32670][SQL][FOLLOWUP] Group exception messages in Catalyst Analyzer in one file

2020-12-06 Thread GitBox
SparkQA removed a comment on pull request #30564: URL: https://github.com/apache/spark/pull/30564#issuecomment-739626623 **[Test build #132316 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132316/testReport)** for PR 30564 at commit

[GitHub] [spark] SparkQA commented on pull request #30564: [SPARK-32670][SQL][FOLLOWUP] Group exception messages in Catalyst Analyzer in one file

2020-12-06 Thread GitBox
SparkQA commented on pull request #30564: URL: https://github.com/apache/spark/pull/30564#issuecomment-739652391 **[Test build #132316 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132316/testReport)** for PR 30564 at commit

[GitHub] [spark] SparkQA commented on pull request #30564: [SPARK-32670][SQL][FOLLOWUP] Group exception messages in Catalyst Analyzer in one file

2020-12-06 Thread GitBox
SparkQA commented on pull request #30564: URL: https://github.com/apache/spark/pull/30564#issuecomment-739650271 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36916/

[GitHub] [spark] sarutak commented on pull request #30634: [SPARK-33684][BUILD] Upgrade httpclient from 4.5.6 to 4.5.13

2020-12-06 Thread GitBox
sarutak commented on pull request #30634: URL: https://github.com/apache/spark/pull/30634#issuecomment-739649238 @dongjoon-hyun Yeah, I forgot to do it. Thanks! This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #30636: [SPARK-33685][SQL] Migrate DROP VIEW command to use UnresolvedView to resolve the identifier

2020-12-06 Thread GitBox
SparkQA commented on pull request #30636: URL: https://github.com/apache/spark/pull/30636#issuecomment-739647919 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36917/

[GitHub] [spark] SparkQA commented on pull request #30634: [SPARK-33684][BUILD] Upgrade httpclient from 4.5.6 to 4.5.13

2020-12-06 Thread GitBox
SparkQA commented on pull request #30634: URL: https://github.com/apache/spark/pull/30634#issuecomment-739647481 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36915/

[GitHub] [spark] imback82 commented on pull request #30636: [SPARK-33685][SQL] Migrate DROP VIEW command to use UnresolvedView to resolve the identifier

2020-12-06 Thread GitBox
imback82 commented on pull request #30636: URL: https://github.com/apache/spark/pull/30636#issuecomment-739647482 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] SparkQA removed a comment on pull request #29122: [SPARK-32320][PYSPARK] Remove mutable default arguments

2020-12-06 Thread GitBox
SparkQA removed a comment on pull request #29122: URL: https://github.com/apache/spark/pull/29122#issuecomment-739616690 **[Test build #132313 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132313/testReport)** for PR 29122 at commit

[GitHub] [spark] SparkQA commented on pull request #30638: [SPARK-31677][SS] Remove reduplicate cache of stream query progress info in StreamingExecution

2020-12-06 Thread GitBox
SparkQA commented on pull request #30638: URL: https://github.com/apache/spark/pull/30638#issuecomment-739647182 **[Test build #132323 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132323/testReport)** for PR 30638 at commit

[GitHub] [spark] SparkQA commented on pull request #29122: [SPARK-32320][PYSPARK] Remove mutable default arguments

2020-12-06 Thread GitBox
SparkQA commented on pull request #29122: URL: https://github.com/apache/spark/pull/29122#issuecomment-739647045 **[Test build #132313 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132313/testReport)** for PR 29122 at commit

[GitHub] [spark] uncleGen opened a new pull request #30638: Use kvstore to cache stream query progress

2020-12-06 Thread GitBox
uncleGen opened a new pull request #30638: URL: https://github.com/apache/spark/pull/30638 ### What changes were proposed in this pull request? Use KVStore instead to cache streaming query progress information. ### Why are the changes needed? Streaming query progress

[GitHub] [spark] linhongliu-db closed pull request #30589: [SPARK-33647][SQL] Fix cache table not working problem for persisted view

2020-12-06 Thread GitBox
linhongliu-db closed pull request #30589: URL: https://github.com/apache/spark/pull/30589 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] linhongliu-db commented on pull request #30589: [SPARK-33647][SQL] Fix cache table not working problem for persisted view

2020-12-06 Thread GitBox
linhongliu-db commented on pull request #30589: URL: https://github.com/apache/spark/pull/30589#issuecomment-739646139 close as this is merged in another PR. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30559: [SPARK-33617][SQL] Add default parallelism configuration for Spark SQL queries

2020-12-06 Thread GitBox
AmplabJenkins removed a comment on pull request #30559: URL: https://github.com/apache/spark/pull/30559#issuecomment-739645931 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132312/

[GitHub] [spark] SparkQA removed a comment on pull request #30559: [SPARK-33617][SQL] Add default parallelism configuration for Spark SQL queries

2020-12-06 Thread GitBox
SparkQA removed a comment on pull request #30559: URL: https://github.com/apache/spark/pull/30559#issuecomment-739611989 **[Test build #132312 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132312/testReport)** for PR 30559 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #30559: [SPARK-33617][SQL] Add default parallelism configuration for Spark SQL queries

2020-12-06 Thread GitBox
AmplabJenkins commented on pull request #30559: URL: https://github.com/apache/spark/pull/30559#issuecomment-739645931 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132312/

[GitHub] [spark] SparkQA commented on pull request #30559: [SPARK-33617][SQL] Add default parallelism configuration for Spark SQL queries

2020-12-06 Thread GitBox
SparkQA commented on pull request #30559: URL: https://github.com/apache/spark/pull/30559#issuecomment-739645807 **[Test build #132312 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132312/testReport)** for PR 30559 at commit

[GitHub] [spark] SparkQA commented on pull request #30628: [SPARK-33679][SQL] Enable spark.sql.adaptive.enabled by default

2020-12-06 Thread GitBox
SparkQA commented on pull request #30628: URL: https://github.com/apache/spark/pull/30628#issuecomment-739645668 **[Test build #132322 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132322/testReport)** for PR 30628 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #30636: [SPARK-33685][SQL] Migrate DROP VIEW command to use UnresolvedView to resolve the identifier

2020-12-06 Thread GitBox
SparkQA removed a comment on pull request #30636: URL: https://github.com/apache/spark/pull/30636#issuecomment-739631909 **[Test build #132317 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132317/testReport)** for PR 30636 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #30636: [SPARK-33685][SQL] Migrate DROP VIEW command to use UnresolvedView to resolve the identifier

2020-12-06 Thread GitBox
AmplabJenkins commented on pull request #30636: URL: https://github.com/apache/spark/pull/30636#issuecomment-739645578 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132317/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30636: [SPARK-33685][SQL] Migrate DROP VIEW command to use UnresolvedView to resolve the identifier

2020-12-06 Thread GitBox
AmplabJenkins removed a comment on pull request #30636: URL: https://github.com/apache/spark/pull/30636#issuecomment-739645578 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132317/

[GitHub] [spark] SparkQA commented on pull request #30636: [SPARK-33685][SQL] Migrate DROP VIEW command to use UnresolvedView to resolve the identifier

2020-12-06 Thread GitBox
SparkQA commented on pull request #30636: URL: https://github.com/apache/spark/pull/30636#issuecomment-739645407 **[Test build #132317 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132317/testReport)** for PR 30636 at commit

[GitHub] [spark] WeichenXu123 commented on pull request #30590: [SPARK-33592][ML][PYTHON][3.0] Backport Fix: Pyspark ML Validator params in estimatorParamMaps may be lost after saving and reloading

2020-12-06 Thread GitBox
WeichenXu123 commented on pull request #30590: URL: https://github.com/apache/spark/pull/30590#issuecomment-739644742 Merged to branch-3.0 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] WeichenXu123 closed pull request #30590: [SPARK-33592][ML][PYTHON][3.0] Backport Fix: Pyspark ML Validator params in estimatorParamMaps may be lost after saving and reloading

2020-12-06 Thread GitBox
WeichenXu123 closed pull request #30590: URL: https://github.com/apache/spark/pull/30590 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] dongjoon-hyun commented on pull request #30628: [SPARK-33679][SQL] Enable spark.sql.adaptive.enabled by default

2020-12-06 Thread GitBox
dongjoon-hyun commented on pull request #30628: URL: https://github.com/apache/spark/pull/30628#issuecomment-739644461 To bring the master branch change (#30631), I'll rebase this PR. This is an automated message from the

[GitHub] [spark] HyukjinKwon commented on pull request #30631: [SPARK-33680][SQL][TESTS] Fix PrunePartitionSuiteBase/BucketedReadWithHiveSupportSuite not to depend on the default conf

2020-12-06 Thread GitBox
HyukjinKwon commented on pull request #30631: URL: https://github.com/apache/spark/pull/30631#issuecomment-739642744 cc @gengliangwang, @cloud-fan and @maryannxue FYI it's CNF and AQE This is an automated message from the

[GitHub] [spark] HyukjinKwon removed a comment on pull request #30631: [SPARK-33680][SQL][TESTS] Fix PrunePartitionSuiteBase/BucketedReadWithHiveSupportSuite not to depend on the default conf

2020-12-06 Thread GitBox
HyukjinKwon removed a comment on pull request #30631: URL: https://github.com/apache/spark/pull/30631#issuecomment-739642599 cc @gengliangwang, @cloud-fan and @maryannxue FYI it's CNF and AQE This is an automated message

[GitHub] [spark] dongjoon-hyun closed pull request #30631: [SPARK-33680][SQL][TESTS] Fix PrunePartitionSuiteBase/BucketedReadWithHiveSupportSuite not to depend on the default conf

2020-12-06 Thread GitBox
dongjoon-hyun closed pull request #30631: URL: https://github.com/apache/spark/pull/30631 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] HyukjinKwon commented on pull request #30631: [SPARK-33680][SQL][TESTS] Fix PrunePartitionSuiteBase/BucketedReadWithHiveSupportSuite not to depend on the default conf

2020-12-06 Thread GitBox
HyukjinKwon commented on pull request #30631: URL: https://github.com/apache/spark/pull/30631#issuecomment-739642681 Sure, nice! This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [spark] SparkQA commented on pull request #29966: [SPARK-33084][CORE][SQL] Add jar support ivy path

2020-12-06 Thread GitBox
SparkQA commented on pull request #29966: URL: https://github.com/apache/spark/pull/29966#issuecomment-739642660 **[Test build #132321 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132321/testReport)** for PR 29966 at commit

[GitHub] [spark] SparkQA commented on pull request #30586: [SPARK-33641][SQL] Invalidate new char/varchar types in public APIs that produce incorrect results

2020-12-06 Thread GitBox
SparkQA commented on pull request #30586: URL: https://github.com/apache/spark/pull/30586#issuecomment-739642644 **[Test build #132319 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132319/testReport)** for PR 30586 at commit

[GitHub] [spark] SparkQA commented on pull request #30637: [SPARK-32680][SQL] Don't Preprocess V2 CTAS with Unresolved Query

2020-12-06 Thread GitBox
SparkQA commented on pull request #30637: URL: https://github.com/apache/spark/pull/30637#issuecomment-739642602 **[Test build #132318 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132318/testReport)** for PR 30637 at commit

[GitHub] [spark] HyukjinKwon commented on pull request #30631: [SPARK-33680][SQL][TESTS] Fix PrunePartitionSuiteBase/BucketedReadWithHiveSupportSuite not to depend on the default conf

2020-12-06 Thread GitBox
HyukjinKwon commented on pull request #30631: URL: https://github.com/apache/spark/pull/30631#issuecomment-739642599 cc @gengliangwang, @cloud-fan and @maryannxue FYI it's CNF and AQE This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #30543: [SPARK-33597][SQL] Support REGEXP_LIKE for consistent with mainstream databases

2020-12-06 Thread GitBox
SparkQA commented on pull request #30543: URL: https://github.com/apache/spark/pull/30543#issuecomment-739642610 **[Test build #132320 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132320/testReport)** for PR 30543 at commit

[GitHub] [spark] dongjoon-hyun commented on pull request #30631: [SPARK-33680][SQL][TESTS] Fix PrunePartitionSuiteBase/BucketedReadWithHiveSupportSuite not to depend on the default conf

2020-12-06 Thread GitBox
dongjoon-hyun commented on pull request #30631: URL: https://github.com/apache/spark/pull/30631#issuecomment-739642424 Thank you, @maropu , @HyukjinKwon , @viirya . The updated tests in `hive` module passed. Merged to master/3.1.

[GitHub] [spark] SparkQA commented on pull request #30564: [SPARK-32670][SQL][FOLLOWUP] Group exception messages in Catalyst Analyzer in one file

2020-12-06 Thread GitBox
SparkQA commented on pull request #30564: URL: https://github.com/apache/spark/pull/30564#issuecomment-739642423 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36916/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29122: [SPARK-32320][PYSPARK] Remove mutable default arguments

2020-12-06 Thread GitBox
AmplabJenkins removed a comment on pull request #29122: URL: https://github.com/apache/spark/pull/29122#issuecomment-739641679 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36913/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30559: [SPARK-33617][SQL] Add default parallelism configuration for Spark SQL queries

2020-12-06 Thread GitBox
AmplabJenkins removed a comment on pull request #30559: URL: https://github.com/apache/spark/pull/30559#issuecomment-739641678 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36912/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30598: [SPARK-33654][SQL] Migrate CACHE TABLE to use UnresolvedRelation to resolve identifier

2020-12-06 Thread GitBox
AmplabJenkins removed a comment on pull request #30598: URL: https://github.com/apache/spark/pull/30598#issuecomment-739641677 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36914/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30628: [SPARK-33679][SQL] Enable spark.sql.adaptive.enabled by default

2020-12-06 Thread GitBox
AmplabJenkins removed a comment on pull request #30628: URL: https://github.com/apache/spark/pull/30628#issuecomment-739641676 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132311/

[GitHub] [spark] AmplabJenkins commented on pull request #30559: [SPARK-33617][SQL] Add default parallelism configuration for Spark SQL queries

2020-12-06 Thread GitBox
AmplabJenkins commented on pull request #30559: URL: https://github.com/apache/spark/pull/30559#issuecomment-739641678 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36912/

[GitHub] [spark] AmplabJenkins commented on pull request #29122: [SPARK-32320][PYSPARK] Remove mutable default arguments

2020-12-06 Thread GitBox
AmplabJenkins commented on pull request #29122: URL: https://github.com/apache/spark/pull/29122#issuecomment-739641679 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36913/

[GitHub] [spark] SparkQA commented on pull request #30636: [SPARK-33685][SQL] Migrate DROP VIEW command to use UnresolvedView to resolve the identifier

2020-12-06 Thread GitBox
SparkQA commented on pull request #30636: URL: https://github.com/apache/spark/pull/30636#issuecomment-739641669 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36917/

[GitHub] [spark] AmplabJenkins commented on pull request #30628: [SPARK-33679][SQL] Enable spark.sql.adaptive.enabled by default

2020-12-06 Thread GitBox
AmplabJenkins commented on pull request #30628: URL: https://github.com/apache/spark/pull/30628#issuecomment-739641676 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132311/

[GitHub] [spark] AmplabJenkins commented on pull request #30598: [SPARK-33654][SQL] Migrate CACHE TABLE to use UnresolvedRelation to resolve identifier

2020-12-06 Thread GitBox
AmplabJenkins commented on pull request #30598: URL: https://github.com/apache/spark/pull/30598#issuecomment-739641677 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36914/

[GitHub] [spark] SparkQA removed a comment on pull request #30628: [SPARK-33679][SQL] Enable spark.sql.adaptive.enabled by default

2020-12-06 Thread GitBox
SparkQA removed a comment on pull request #30628: URL: https://github.com/apache/spark/pull/30628#issuecomment-739612251 **[Test build #132311 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132311/testReport)** for PR 30628 at commit

[GitHub] [spark] SparkQA commented on pull request #30628: [SPARK-33679][SQL] Enable spark.sql.adaptive.enabled by default

2020-12-06 Thread GitBox
SparkQA commented on pull request #30628: URL: https://github.com/apache/spark/pull/30628#issuecomment-739641105 **[Test build #132311 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132311/testReport)** for PR 30628 at commit

[GitHub] [spark] SparkQA commented on pull request #30634: [SPARK-33684][BUILD] Upgrade httpclient from 4.5.6 to 4.5.13

2020-12-06 Thread GitBox
SparkQA commented on pull request #30634: URL: https://github.com/apache/spark/pull/30634#issuecomment-739640667 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36915/

[GitHub] [spark] AngersZhuuuu edited a comment on pull request #29966: [SPARK-33084][CORE][SQL] Add jar support ivy path

2020-12-06 Thread GitBox
AngersZh edited a comment on pull request #29966: URL: https://github.com/apache/spark/pull/29966#issuecomment-739631644 Wait..seems we all ignore how can we pass these Jars to executor side Updated with below, WDYT? @xkrogen @maropu ```

[GitHub] [spark] SparkQA commented on pull request #30598: [SPARK-33654][SQL] Migrate CACHE TABLE to use UnresolvedRelation to resolve identifier

2020-12-06 Thread GitBox
SparkQA commented on pull request #30598: URL: https://github.com/apache/spark/pull/30598#issuecomment-739637825 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36914/

[GitHub] [spark] linhongliu-db commented on pull request #30637: [SPARK-32680][SQL] Don't Preprocess V2 CTAS with Unresolved Query

2020-12-06 Thread GitBox
linhongliu-db commented on pull request #30637: URL: https://github.com/apache/spark/pull/30637#issuecomment-739634479 This is a re-open PR of https://github.com/apache/spark/pull/29507. The previous is closed as a stale PR.

[GitHub] [spark] luluorta commented on a change in pull request #30625: [SPARK-33677][SQL] Skip LikeSimplification rule if escape is a wildcard character

2020-12-06 Thread GitBox
luluorta commented on a change in pull request #30625: URL: https://github.com/apache/spark/pull/30625#discussion_r537196808 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/expressions.scala ## @@ -543,13 +543,14 @@ object LikeSimplification

[GitHub] [spark] SparkQA commented on pull request #30559: [SPARK-33617][SQL] Add default parallelism configuration for Spark SQL queries

2020-12-06 Thread GitBox
SparkQA commented on pull request #30559: URL: https://github.com/apache/spark/pull/30559#issuecomment-739634285 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36912/

[GitHub] [spark] linhongliu-db opened a new pull request #30637: [SPARK-32680][SQL] Don't Preprocess V2 CTAS with Unresolved Query

2020-12-06 Thread GitBox
linhongliu-db opened a new pull request #30637: URL: https://github.com/apache/spark/pull/30637 ### What changes were proposed in this pull request? The analyzer rule `PreprocessTableCreation` will preprocess table creation related logical plan. But for CTAS, if the sub-query

[GitHub] [spark] luluorta commented on a change in pull request #30625: [SPARK-33677][SQL] Skip LikeSimplification rule if escape is a wildcard character

2020-12-06 Thread GitBox
luluorta commented on a change in pull request #30625: URL: https://github.com/apache/spark/pull/30625#discussion_r537196808 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/expressions.scala ## @@ -543,13 +543,14 @@ object LikeSimplification

[GitHub] [spark] SparkQA commented on pull request #30636: [SPARK-33685][SQL] Migrate DROP VIEW command to use UnresolvedView to resolve the identifier

2020-12-06 Thread GitBox
SparkQA commented on pull request #30636: URL: https://github.com/apache/spark/pull/30636#issuecomment-739631909 **[Test build #132317 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132317/testReport)** for PR 30636 at commit

[GitHub] [spark] sunchao commented on pull request #30597: [SPARK-33652][SQL] DSv2: DeleteFrom should refresh cache

2020-12-06 Thread GitBox
sunchao commented on pull request #30597: URL: https://github.com/apache/spark/pull/30597#issuecomment-739631923 Thanks for merging @dongjoon-hyun ! This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30628: [SPARK-33679][SQL] Enable spark.sql.adaptive.enabled by default

2020-12-06 Thread GitBox
AmplabJenkins removed a comment on pull request #30628: URL: https://github.com/apache/spark/pull/30628#issuecomment-739631661 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36911/

[GitHub] [spark] SparkQA commented on pull request #30628: [SPARK-33679][SQL] Enable spark.sql.adaptive.enabled by default

2020-12-06 Thread GitBox
SparkQA commented on pull request #30628: URL: https://github.com/apache/spark/pull/30628#issuecomment-739631646 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36911/

[GitHub] [spark] AngersZhuuuu commented on pull request #29966: [SPARK-33084][CORE][SQL] Add jar support ivy path

2020-12-06 Thread GitBox
AngersZh commented on pull request #29966: URL: https://github.com/apache/spark/pull/29966#issuecomment-739631644 Wait..seems we all ignore how can we pass these Jars to executor side This is an automated message

[GitHub] [spark] AmplabJenkins commented on pull request #30628: [SPARK-33679][SQL] Enable spark.sql.adaptive.enabled by default

2020-12-06 Thread GitBox
AmplabJenkins commented on pull request #30628: URL: https://github.com/apache/spark/pull/30628#issuecomment-739631661 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36911/

[GitHub] [spark] imback82 opened a new pull request #30636: [SPARK-33685][SQL] Migrate DROP VIEW command to use UnresolvedView to resolve the identifier

2020-12-06 Thread GitBox
imback82 opened a new pull request #30636: URL: https://github.com/apache/spark/pull/30636 ### What changes were proposed in this pull request? This PR introduces `UnresolvedView` in the resolution framework to resolve the identifier. This PR then migrates `DROP VIEW`

[GitHub] [spark] yaooqinn commented on a change in pull request #30586: [SPARK-33641][SQL] Invalidate new char/varchar types in public APIs that produce incorrect results

2020-12-06 Thread GitBox
yaooqinn commented on a change in pull request #30586: URL: https://github.com/apache/spark/pull/30586#discussion_r537195209 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -2954,6 +2954,15 @@ object SQLConf { .booleanConf

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30631: [SPARK-33680][SQL][TESTS] Fix PrunePartitionSuiteBase/BucketedReadWithHiveSupportSuite not to depend on the default conf

2020-12-06 Thread GitBox
AmplabJenkins removed a comment on pull request #30631: URL: https://github.com/apache/spark/pull/30631#issuecomment-739630564 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36910/

[GitHub] [spark] SparkQA commented on pull request #30631: [SPARK-33680][SQL][TESTS] Fix PrunePartitionSuiteBase/BucketedReadWithHiveSupportSuite not to depend on the default conf

2020-12-06 Thread GitBox
SparkQA commented on pull request #30631: URL: https://github.com/apache/spark/pull/30631#issuecomment-739630554 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36910/

[GitHub] [spark] AmplabJenkins commented on pull request #30631: [SPARK-33680][SQL][TESTS] Fix PrunePartitionSuiteBase/BucketedReadWithHiveSupportSuite not to depend on the default conf

2020-12-06 Thread GitBox
AmplabJenkins commented on pull request #30631: URL: https://github.com/apache/spark/pull/30631#issuecomment-739630564 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36910/

[GitHub] [spark] SparkQA commented on pull request #30598: [SPARK-33654][SQL] Migrate CACHE TABLE to use UnresolvedRelation to resolve identifier

2020-12-06 Thread GitBox
SparkQA commented on pull request #30598: URL: https://github.com/apache/spark/pull/30598#issuecomment-739630131 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36914/

[GitHub] [spark] HyukjinKwon commented on pull request #29966: [SPARK-33084][CORE][SQL] Add jar support ivy path

2020-12-06 Thread GitBox
HyukjinKwon commented on pull request #29966: URL: https://github.com/apache/spark/pull/29966#issuecomment-739629014 Okay, at least it makes it Hive compliant per [HIVE-9664](https://issues.apache.org/jira/browse/HIVE-9664). I am okay.

[GitHub] [spark] maropu commented on pull request #30481: [SPARK-33526][SQL] Add config to control if cancel invoke interrupt task on thriftserver

2020-12-06 Thread GitBox
maropu commented on pull request #30481: URL: https://github.com/apache/spark/pull/30481#issuecomment-739629138 Adding a new config for it looks fine. This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30623: [SPARK-33675][INFRA] Add GitHub Action job to publish snapshot

2020-12-06 Thread GitBox
AmplabJenkins removed a comment on pull request #30623: URL: https://github.com/apache/spark/pull/30623#issuecomment-739628820 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132307/

[GitHub] [spark] AmplabJenkins commented on pull request #30623: [SPARK-33675][INFRA] Add GitHub Action job to publish snapshot

2020-12-06 Thread GitBox
AmplabJenkins commented on pull request #30623: URL: https://github.com/apache/spark/pull/30623#issuecomment-739628820 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132307/

[GitHub] [spark] SparkQA removed a comment on pull request #30623: [SPARK-33675][INFRA] Add GitHub Action job to publish snapshot

2020-12-06 Thread GitBox
SparkQA removed a comment on pull request #30623: URL: https://github.com/apache/spark/pull/30623#issuecomment-739597281 **[Test build #132307 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132307/testReport)** for PR 30623 at commit

[GitHub] [spark] SparkQA commented on pull request #30623: [SPARK-33675][INFRA] Add GitHub Action job to publish snapshot

2020-12-06 Thread GitBox
SparkQA commented on pull request #30623: URL: https://github.com/apache/spark/pull/30623#issuecomment-739628432 **[Test build #132307 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132307/testReport)** for PR 30623 at commit

[GitHub] [spark] maropu commented on a change in pull request #30481: [SPARK-33526][SQL] Add config to control if cancel invoke interrupt task on thriftserver

2020-12-06 Thread GitBox
maropu commented on a change in pull request #30481: URL: https://github.com/apache/spark/pull/30481#discussion_r537192013 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -937,6 +937,16 @@ object SQLConf {

[GitHub] [spark] maropu commented on a change in pull request #30481: [SPARK-33526][SQL] Add config to control if cancel invoke interrupt task on thriftserver

2020-12-06 Thread GitBox
maropu commented on a change in pull request #30481: URL: https://github.com/apache/spark/pull/30481#discussion_r537191913 ## File path: sql/hive-thriftserver/src/test/scala/org/apache/spark/sql/hive/thriftserver/ThriftServerWithSparkContextSuite.scala ## @@ -79,6 +84,45 @@

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30631: [SPARK-33680][SQL][TESTS] Fix PrunePartitionSuiteBase/BucketedReadWithHiveSupportSuite not to depend on the default conf

2020-12-06 Thread GitBox
AmplabJenkins removed a comment on pull request #30631: URL: https://github.com/apache/spark/pull/30631#issuecomment-739627478 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132306/

[GitHub] [spark] AmplabJenkins commented on pull request #30631: [SPARK-33680][SQL][TESTS] Fix PrunePartitionSuiteBase/BucketedReadWithHiveSupportSuite not to depend on the default conf

2020-12-06 Thread GitBox
AmplabJenkins commented on pull request #30631: URL: https://github.com/apache/spark/pull/30631#issuecomment-739627478 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132306/

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #29966: [SPARK-33084][CORE][SQL] Add jar support ivy path

2020-12-06 Thread GitBox
AngersZh commented on a change in pull request #29966: URL: https://github.com/apache/spark/pull/29966#discussion_r537191270 ## File path: core/src/main/scala/org/apache/spark/SparkContext.scala ## @@ -1890,47 +1890,57 @@ class SparkContext(config: SparkConf) extends

[GitHub] [spark] SparkQA removed a comment on pull request #30631: [SPARK-33680][SQL][TESTS] Fix PrunePartitionSuiteBase/BucketedReadWithHiveSupportSuite not to depend on the default conf

2020-12-06 Thread GitBox
SparkQA removed a comment on pull request #30631: URL: https://github.com/apache/spark/pull/30631#issuecomment-739597038 **[Test build #132306 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132306/testReport)** for PR 30631 at commit

[GitHub] [spark] SparkQA commented on pull request #30631: [SPARK-33680][SQL][TESTS] Fix PrunePartitionSuiteBase/BucketedReadWithHiveSupportSuite not to depend on the default conf

2020-12-06 Thread GitBox
SparkQA commented on pull request #30631: URL: https://github.com/apache/spark/pull/30631#issuecomment-739626998 **[Test build #132306 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132306/testReport)** for PR 30631 at commit

[GitHub] [spark] SparkQA commented on pull request #30598: [SPARK-33654][SQL] Migrate CACHE TABLE to use UnresolvedRelation to resolve identifier

2020-12-06 Thread GitBox
SparkQA commented on pull request #30598: URL: https://github.com/apache/spark/pull/30598#issuecomment-739626713 **[Test build #132315 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132315/testReport)** for PR 30598 at commit

[GitHub] [spark] SparkQA commented on pull request #30564: [SPARK-32670][SQL][FOLLOWUP] Group exception messages in Catalyst Analyzer in one file

2020-12-06 Thread GitBox
SparkQA commented on pull request #30564: URL: https://github.com/apache/spark/pull/30564#issuecomment-739626623 **[Test build #132316 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132316/testReport)** for PR 30564 at commit

[GitHub] [spark] SparkQA commented on pull request #30634: [SPARK-33684][BUILD] Upgrade httpclient from 4.5.6 to 4.5.13

2020-12-06 Thread GitBox
SparkQA commented on pull request #30634: URL: https://github.com/apache/spark/pull/30634#issuecomment-739626568 **[Test build #132314 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132314/testReport)** for PR 30634 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30532: [MINOR] Spelling sql not core

2020-12-06 Thread GitBox
AmplabJenkins removed a comment on pull request #30532: URL: https://github.com/apache/spark/pull/30532#issuecomment-739626119 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36909/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30630: [SPARK-33675][INFRA][3.0] Add GitHub Action job to publish snapshot

2020-12-06 Thread GitBox
AmplabJenkins removed a comment on pull request #30630: URL: https://github.com/apache/spark/pull/30630#issuecomment-739626118 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132305/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30631: [SPARK-33680][SQL][TESTS] Fix PrunePartitionSuiteBase/BucketedReadWithHiveSupportSuite not to depend on the default conf

2020-12-06 Thread GitBox
AmplabJenkins removed a comment on pull request #30631: URL: https://github.com/apache/spark/pull/30631#issuecomment-739626120 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132310/

[GitHub] [spark] AmplabJenkins commented on pull request #30631: [SPARK-33680][SQL][TESTS] Fix PrunePartitionSuiteBase/BucketedReadWithHiveSupportSuite not to depend on the default conf

2020-12-06 Thread GitBox
AmplabJenkins commented on pull request #30631: URL: https://github.com/apache/spark/pull/30631#issuecomment-739626120 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132310/

[GitHub] [spark] AmplabJenkins commented on pull request #30630: [SPARK-33675][INFRA][3.0] Add GitHub Action job to publish snapshot

2020-12-06 Thread GitBox
AmplabJenkins commented on pull request #30630: URL: https://github.com/apache/spark/pull/30630#issuecomment-739626118 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132305/

[GitHub] [spark] AmplabJenkins commented on pull request #30532: [MINOR] Spelling sql not core

2020-12-06 Thread GitBox
AmplabJenkins commented on pull request #30532: URL: https://github.com/apache/spark/pull/30532#issuecomment-739626119 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/36909/

[GitHub] [spark] SparkQA commented on pull request #30559: [SPARK-33617][SQL] Add default parallelism configuration for Spark SQL queries

2020-12-06 Thread GitBox
SparkQA commented on pull request #30559: URL: https://github.com/apache/spark/pull/30559#issuecomment-739626115 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36912/

[GitHub] [spark] SparkQA removed a comment on pull request #30630: [SPARK-33675][INFRA][3.0] Add GitHub Action job to publish snapshot

2020-12-06 Thread GitBox
SparkQA removed a comment on pull request #30630: URL: https://github.com/apache/spark/pull/30630#issuecomment-739585064 **[Test build #132305 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132305/testReport)** for PR 30630 at commit

[GitHub] [spark] SparkQA commented on pull request #30630: [SPARK-33675][INFRA][3.0] Add GitHub Action job to publish snapshot

2020-12-06 Thread GitBox
SparkQA commented on pull request #30630: URL: https://github.com/apache/spark/pull/30630#issuecomment-739624888 **[Test build #132305 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/132305/testReport)** for PR 30630 at commit

[GitHub] [spark] SparkQA commented on pull request #30628: [SPARK-33679][SQL] Enable spark.sql.adaptive.enabled by default

2020-12-06 Thread GitBox
SparkQA commented on pull request #30628: URL: https://github.com/apache/spark/pull/30628#issuecomment-739624105 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36911/

[GitHub] [spark] HyukjinKwon commented on a change in pull request #29966: [SPARK-33084][CORE][SQL] Add jar support ivy path

2020-12-06 Thread GitBox
HyukjinKwon commented on a change in pull request #29966: URL: https://github.com/apache/spark/pull/29966#discussion_r537186739 ## File path: core/src/main/scala/org/apache/spark/SparkContext.scala ## @@ -1890,47 +1890,57 @@ class SparkContext(config: SparkConf) extends

[GitHub] [spark] SparkQA commented on pull request #30631: [SPARK-33680][SQL][TESTS] Fix PrunePartitionSuiteBase/BucketedReadWithHiveSupportSuite not to depend on the default conf

2020-12-06 Thread GitBox
SparkQA commented on pull request #30631: URL: https://github.com/apache/spark/pull/30631#issuecomment-739622666 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36910/

[GitHub] [spark] dongjoon-hyun closed pull request #30635: [SPARK-33675][INFRA][2.4][FOLLOWUP] Set GIT_REF to branch-2.4

2020-12-06 Thread GitBox
dongjoon-hyun closed pull request #30635: URL: https://github.com/apache/spark/pull/30635 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

<    1   2   3   4   5   6   >