[GitHub] [spark] SparkQA commented on pull request #34715: [WIP][SPARK-37445][BUILD] Rename the maven hadoop profile to hadoop-3 and hadoop-2

2021-11-25 Thread GitBox
SparkQA commented on pull request #34715: URL: https://github.com/apache/spark/pull/34715#issuecomment-979700274 **[Test build #145653 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145653/testReport)** for PR 34715 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #34715: [WIP][SPARK-37445][BUILD] Rename the maven hadoop profile to hadoop-3 and hadoop-2

2021-11-25 Thread GitBox
AmplabJenkins commented on pull request #34715: URL: https://github.com/apache/spark/pull/34715#issuecomment-979701043 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145653/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #34715: [WIP][SPARK-37445][BUILD] Rename the maven hadoop profile to hadoop-3 and hadoop-2

2021-11-25 Thread GitBox
SparkQA removed a comment on pull request #34715: URL: https://github.com/apache/spark/pull/34715#issuecomment-979702461 **[Test build #145655 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145655/testReport)** for PR 34715 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34715: [WIP][SPARK-37445][BUILD] Rename the maven hadoop profile to hadoop-3 and hadoop-2

2021-11-25 Thread GitBox
AmplabJenkins removed a comment on pull request #34715: URL: https://github.com/apache/spark/pull/34715#issuecomment-979703355 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145655/

[GitHub] [spark] AmplabJenkins commented on pull request #34715: [WIP][SPARK-37445][BUILD] Rename the maven hadoop profile to hadoop-3 and hadoop-2

2021-11-25 Thread GitBox
AmplabJenkins commented on pull request #34715: URL: https://github.com/apache/spark/pull/34715#issuecomment-979703355 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145655/ -- This

[GitHub] [spark] SparkQA commented on pull request #34715: [WIP][SPARK-37445][BUILD] Rename the maven hadoop profile to hadoop-3 and hadoop-2

2021-11-25 Thread GitBox
SparkQA commented on pull request #34715: URL: https://github.com/apache/spark/pull/34715#issuecomment-979703340 **[Test build #145655 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145655/testReport)** for PR 34715 at commit

[GitHub] [spark] AngersZhuuuu edited a comment on pull request #34715: [WIP][SPARK-37445][BUILD] Rename the maven hadoop profile to hadoop-3 and hadoop-2

2021-11-25 Thread GitBox
AngersZh edited a comment on pull request #34715: URL: https://github.com/apache/spark/pull/34715#issuecomment-979677759 Should we need to clarify this change in https://spark.apache.org/docs/latest/api/python/getting_started/install.html#manually-downloading ? cc @HyukjinKwon

[GitHub] [spark] SparkQA commented on pull request #34715: [WIP][SPARK-37445][BUILD] Rename the maven hadoop profile to hadoop-3 and hadoop-2

2021-11-25 Thread GitBox
SparkQA commented on pull request #34715: URL: https://github.com/apache/spark/pull/34715#issuecomment-979712340 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50119/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #34719: [SPARK-37381][SQL] Unify v1 and v2 SHOW CREATE TABLE tests

2021-11-25 Thread GitBox
SparkQA commented on pull request #34719: URL: https://github.com/apache/spark/pull/34719#issuecomment-979714836 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50122/ -- This is an automated message from the Apache

[GitHub] [spark] toujours33 opened a new pull request #34720: [SPARK-37469][WebUI] unified shuffle read block time to shuffle read fetch wait time in StagePage

2021-11-25 Thread GitBox
toujours33 opened a new pull request #34720: URL: https://github.com/apache/spark/pull/34720 ### What changes were proposed in this pull request? Change the metrics name `Shuffle Read Block Time` to `Shuffle Read Fetch Wait Time` in StagePage ### Why are the changes needed?

[GitHub] [spark] SparkQA commented on pull request #34596: [SPARK-37326][SQL] Support TimestampNTZ in CSV data source

2021-11-25 Thread GitBox
SparkQA commented on pull request #34596: URL: https://github.com/apache/spark/pull/34596#issuecomment-979718731 **[Test build #145658 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145658/testReport)** for PR 34596 at commit

[GitHub] [spark] SparkQA commented on pull request #34715: [WIP][SPARK-37445][BUILD] Rename the maven hadoop profile to hadoop-3 and hadoop-2

2021-11-25 Thread GitBox
SparkQA commented on pull request #34715: URL: https://github.com/apache/spark/pull/34715#issuecomment-979718612 **[Test build #145657 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145657/testReport)** for PR 34715 at commit

[GitHub] [spark] Peng-Lei commented on a change in pull request #34719: [SPARK-37381][SQL] Unify v1 and v2 SHOW CREATE TABLE tests

2021-11-25 Thread GitBox
Peng-Lei commented on a change in pull request #34719: URL: https://github.com/apache/spark/pull/34719#discussion_r757256714 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/command/v1/ShowCreateTableSuite.scala ## @@ -0,0 +1,140 @@ +/* + * Licensed to the

[GitHub] [spark] Peng-Lei commented on a change in pull request #34719: [SPARK-37381][SQL] Unify v1 and v2 SHOW CREATE TABLE tests

2021-11-25 Thread GitBox
Peng-Lei commented on a change in pull request #34719: URL: https://github.com/apache/spark/pull/34719#discussion_r757256714 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/command/v1/ShowCreateTableSuite.scala ## @@ -0,0 +1,140 @@ +/* + * Licensed to the

[GitHub] [spark] Peng-Lei commented on a change in pull request #34719: [SPARK-37381][SQL] Unify v1 and v2 SHOW CREATE TABLE tests

2021-11-25 Thread GitBox
Peng-Lei commented on a change in pull request #34719: URL: https://github.com/apache/spark/pull/34719#discussion_r757256714 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/command/v1/ShowCreateTableSuite.scala ## @@ -0,0 +1,140 @@ +/* + * Licensed to the

[GitHub] [spark] sarutak commented on pull request #34720: [SPARK-37469][WebUI] unified shuffle read block time to shuffle read fetch wait time in StagePage

2021-11-25 Thread GitBox
sarutak commented on pull request #34720: URL: https://github.com/apache/spark/pull/34720#issuecomment-979728617 @toujours33 nit, but could you update the [screenshot](http://spark.apache.org/docs/latest/img/AllStagesPageDetail6.png) in the

[GitHub] [spark] Peng-Lei commented on pull request #34719: [SPARK-37381][SQL] Unify v1 and v2 SHOW CREATE TABLE tests

2021-11-25 Thread GitBox
Peng-Lei commented on pull request #34719: URL: https://github.com/apache/spark/pull/34719#issuecomment-979730567 @MaxGekk @cloud-fan @imback82 Could you take a look? Thank you. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] sarutak edited a comment on pull request #34710: [SPARK-37461][YARN] YARN-CLIENT mode client.appId is always null

2021-11-25 Thread GitBox
sarutak edited a comment on pull request #34710: URL: https://github.com/apache/spark/pull/34710#issuecomment-979695437 @AngersZh Could you describe what you propose in `What changes were proposed in this pull request?`? `YARN-CLIENT mode client.appId is always null` doesn't

[GitHub] [spark] SparkQA commented on pull request #34702: [SPARK-37455][SQL] Replace hash with sort aggregate if child is already sorted

2021-11-25 Thread GitBox
SparkQA commented on pull request #34702: URL: https://github.com/apache/spark/pull/34702#issuecomment-979733581 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50120/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #34715: [WIP][SPARK-37445][BUILD] Rename the maven hadoop profile to hadoop-3 and hadoop-2

2021-11-25 Thread GitBox
SparkQA commented on pull request #34715: URL: https://github.com/apache/spark/pull/34715#issuecomment-979737447 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50125/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #34719: [SPARK-37381][SQL] Unify v1 and v2 SHOW CREATE TABLE tests

2021-11-25 Thread GitBox
SparkQA commented on pull request #34719: URL: https://github.com/apache/spark/pull/34719#issuecomment-979737271 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50122/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #34715: [WIP][SPARK-37445][BUILD] Rename the maven hadoop profile to hadoop-3 and hadoop-2

2021-11-25 Thread GitBox
SparkQA commented on pull request #34715: URL: https://github.com/apache/spark/pull/34715#issuecomment-979751257 **[Test build #145656 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145656/testReport)** for PR 34715 at commit

[GitHub] [spark] SparkQA commented on pull request #34715: [WIP][SPARK-37445][BUILD] Rename the maven hadoop profile to hadoop-3 and hadoop-2

2021-11-25 Thread GitBox
SparkQA commented on pull request #34715: URL: https://github.com/apache/spark/pull/34715#issuecomment-979734720 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50126/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #34596: [SPARK-37326][SQL] Support TimestampNTZ in CSV data source

2021-11-25 Thread GitBox
SparkQA commented on pull request #34596: URL: https://github.com/apache/spark/pull/34596#issuecomment-979761329 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50128/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA removed a comment on pull request #34715: [WIP][SPARK-37445][BUILD] Rename the maven hadoop profile to hadoop-3 and hadoop-2

2021-11-25 Thread GitBox
SparkQA removed a comment on pull request #34715: URL: https://github.com/apache/spark/pull/34715#issuecomment-979700274 **[Test build #145653 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145653/testReport)** for PR 34715 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34715: [WIP][SPARK-37445][BUILD] Rename the maven hadoop profile to hadoop-3 and hadoop-2

2021-11-25 Thread GitBox
AmplabJenkins removed a comment on pull request #34715: URL: https://github.com/apache/spark/pull/34715#issuecomment-979701043 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145653/

[GitHub] [spark] SparkQA commented on pull request #34702: [SPARK-37455][SQL] Replace hash with sort aggregate if child is already sorted

2021-11-25 Thread GitBox
SparkQA commented on pull request #34702: URL: https://github.com/apache/spark/pull/34702#issuecomment-979714259 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50120/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #34715: [WIP][SPARK-37445][BUILD] Rename the maven hadoop profile to hadoop-3 and hadoop-2

2021-11-25 Thread GitBox
SparkQA commented on pull request #34715: URL: https://github.com/apache/spark/pull/34715#issuecomment-979716442 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50124/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #34719: [SPARK-37381][SQL] Unify v1 and v2 SHOW CREATE TABLE tests

2021-11-25 Thread GitBox
SparkQA commented on pull request #34719: URL: https://github.com/apache/spark/pull/34719#issuecomment-979716499 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50123/ -- This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins commented on pull request #34720: [SPARK-37469][WebUI] unified shuffle read block time to shuffle read fetch wait time in StagePage

2021-11-25 Thread GitBox
AmplabJenkins commented on pull request #34720: URL: https://github.com/apache/spark/pull/34720#issuecomment-979719055 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [spark] Peng-Lei commented on a change in pull request #34719: [SPARK-37381][SQL] Unify v1 and v2 SHOW CREATE TABLE tests

2021-11-25 Thread GitBox
Peng-Lei commented on a change in pull request #34719: URL: https://github.com/apache/spark/pull/34719#discussion_r757257983 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/command/v2/ShowCreateTableSuite.scala ## @@ -0,0 +1,141 @@ +/* + * Licensed to the

[GitHub] [spark] sarutak commented on pull request #34720: [SPARK-37469][WebUI] unified shuffle read block time to shuffle read fetch wait time in StagePage

2021-11-25 Thread GitBox
sarutak commented on pull request #34720: URL: https://github.com/apache/spark/pull/34720#issuecomment-979729069 Also, could you add the screenshot of before/after this change to the description? -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] SparkQA commented on pull request #34715: [WIP][SPARK-37445][BUILD] Rename the maven hadoop profile to hadoop-3 and hadoop-2

2021-11-25 Thread GitBox
SparkQA commented on pull request #34715: URL: https://github.com/apache/spark/pull/34715#issuecomment-979732404 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50124/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #34719: [SPARK-37381][SQL] Unify v1 and v2 SHOW CREATE TABLE tests

2021-11-25 Thread GitBox
SparkQA commented on pull request #34719: URL: https://github.com/apache/spark/pull/34719#issuecomment-979732281 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50123/ -- This is an automated message from the

[GitHub] [spark] SparkQA removed a comment on pull request #34715: [WIP][SPARK-37445][BUILD] Rename the maven hadoop profile to hadoop-3 and hadoop-2

2021-11-25 Thread GitBox
SparkQA removed a comment on pull request #34715: URL: https://github.com/apache/spark/pull/34715#issuecomment-979703670 **[Test build #145656 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145656/testReport)** for PR 34715 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #34715: [WIP][SPARK-37445][BUILD] Rename the maven hadoop profile to hadoop-3 and hadoop-2

2021-11-25 Thread GitBox
SparkQA removed a comment on pull request #34715: URL: https://github.com/apache/spark/pull/34715#issuecomment-979654601 **[Test build #145642 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145642/testReport)** for PR 34715 at commit

[GitHub] [spark] SparkQA commented on pull request #34715: [WIP][SPARK-37445][BUILD] Rename the maven hadoop profile to hadoop-3 and hadoop-2

2021-11-25 Thread GitBox
SparkQA commented on pull request #34715: URL: https://github.com/apache/spark/pull/34715#issuecomment-979715522 **[Test build #145642 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145642/testReport)** for PR 34715 at commit

[GitHub] [spark] Peng-Lei commented on a change in pull request #34719: [SPARK-37381][SQL] Unify v1 and v2 SHOW CREATE TABLE tests

2021-11-25 Thread GitBox
Peng-Lei commented on a change in pull request #34719: URL: https://github.com/apache/spark/pull/34719#discussion_r757254642 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/command/v1/ShowCreateTableSuite.scala ## @@ -0,0 +1,140 @@ +/* + * Licensed to the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34719: [SPARK-37381][SQL] Unify v1 and v2 SHOW CREATE TABLE tests

2021-11-25 Thread GitBox
AmplabJenkins removed a comment on pull request #34719: URL: https://github.com/apache/spark/pull/34719#issuecomment-979740143 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins commented on pull request #34719: [SPARK-37381][SQL] Unify v1 and v2 SHOW CREATE TABLE tests

2021-11-25 Thread GitBox
AmplabJenkins commented on pull request #34719: URL: https://github.com/apache/spark/pull/34719#issuecomment-979740143 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [spark] AmplabJenkins commented on pull request #34715: [WIP][SPARK-37445][BUILD] Rename the maven hadoop profile to hadoop-3 and hadoop-2

2021-11-25 Thread GitBox
AmplabJenkins commented on pull request #34715: URL: https://github.com/apache/spark/pull/34715#issuecomment-979740142 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34575: [SPARK-37273][SQL] Support hidden file metadata columns in Spark SQL

2021-11-25 Thread GitBox
AmplabJenkins removed a comment on pull request #34575: URL: https://github.com/apache/spark/pull/34575#issuecomment-979740140 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50121/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34702: [SPARK-37455][SQL] Replace hash with sort aggregate if child is already sorted

2021-11-25 Thread GitBox
AmplabJenkins removed a comment on pull request #34702: URL: https://github.com/apache/spark/pull/34702#issuecomment-979740144 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50120/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34715: [WIP][SPARK-37445][BUILD] Rename the maven hadoop profile to hadoop-3 and hadoop-2

2021-11-25 Thread GitBox
AmplabJenkins removed a comment on pull request #34715: URL: https://github.com/apache/spark/pull/34715#issuecomment-979740142 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins commented on pull request #34702: [SPARK-37455][SQL] Replace hash with sort aggregate if child is already sorted

2021-11-25 Thread GitBox
AmplabJenkins commented on pull request #34702: URL: https://github.com/apache/spark/pull/34702#issuecomment-979740144 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50120/ --

[GitHub] [spark] AmplabJenkins commented on pull request #34575: [SPARK-37273][SQL] Support hidden file metadata columns in Spark SQL

2021-11-25 Thread GitBox
AmplabJenkins commented on pull request #34575: URL: https://github.com/apache/spark/pull/34575#issuecomment-979740140 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50121/ --

[GitHub] [spark] AmplabJenkins commented on pull request #34713: [SPARK-37464][SQL] SCHEMA and DATABASE should simply be aliases of NAMESPACE

2021-11-25 Thread GitBox
AmplabJenkins commented on pull request #34713: URL: https://github.com/apache/spark/pull/34713#issuecomment-979740580 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145641/ -- This

[GitHub] [spark] SparkQA commented on pull request #34715: [WIP][SPARK-37445][BUILD] Rename the maven hadoop profile to hadoop-3 and hadoop-2

2021-11-25 Thread GitBox
SparkQA commented on pull request #34715: URL: https://github.com/apache/spark/pull/34715#issuecomment-979760611 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50126/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #34720: [SPARK-37469][WebUI] unified shuffle read block time to shuffle read fetch wait time in StagePage

2021-11-25 Thread GitBox
SparkQA commented on pull request #34720: URL: https://github.com/apache/spark/pull/34720#issuecomment-979760810 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50129/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #34715: [WIP][SPARK-37445][BUILD] Rename the maven hadoop profile to hadoop-3 and hadoop-2

2021-11-25 Thread GitBox
SparkQA commented on pull request #34715: URL: https://github.com/apache/spark/pull/34715#issuecomment-979701025 **[Test build #145653 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145653/testReport)** for PR 34715 at commit

[GitHub] [spark] SparkQA commented on pull request #34715: [WIP][SPARK-37445][BUILD] Rename the maven hadoop profile to hadoop-3 and hadoop-2

2021-11-25 Thread GitBox
SparkQA commented on pull request #34715: URL: https://github.com/apache/spark/pull/34715#issuecomment-979701395 **[Test build #145654 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145654/testReport)** for PR 34715 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #34718: [SPARK-37460][DOCS] Add the description of ALTER DATABASE SET LOCATION

2021-11-25 Thread GitBox
AmplabJenkins commented on pull request #34718: URL: https://github.com/apache/spark/pull/34718#issuecomment-979718075 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50118/ --

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34715: [WIP][SPARK-37445][BUILD] Rename the maven hadoop profile to hadoop-3 and hadoop-2

2021-11-25 Thread GitBox
AmplabJenkins removed a comment on pull request #34715: URL: https://github.com/apache/spark/pull/34715#issuecomment-979718074 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34718: [SPARK-37460][DOCS] Add the description of ALTER DATABASE SET LOCATION

2021-11-25 Thread GitBox
AmplabJenkins removed a comment on pull request #34718: URL: https://github.com/apache/spark/pull/34718#issuecomment-979718075 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50118/

[GitHub] [spark] AmplabJenkins commented on pull request #34715: [WIP][SPARK-37445][BUILD] Rename the maven hadoop profile to hadoop-3 and hadoop-2

2021-11-25 Thread GitBox
AmplabJenkins commented on pull request #34715: URL: https://github.com/apache/spark/pull/34715#issuecomment-979718076 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [spark] Peng-Lei commented on a change in pull request #34719: [SPARK-37381][SQL] Unify v1 and v2 SHOW CREATE TABLE tests

2021-11-25 Thread GitBox
Peng-Lei commented on a change in pull request #34719: URL: https://github.com/apache/spark/pull/34719#discussion_r757251460 ## File path: sql/core/src/test/scala/org/apache/spark/sql/ShowCreateTableSuite.scala ## @@ -1,241 +0,0 @@ -/* - * Licensed to the Apache Software

[GitHub] [spark] SparkQA removed a comment on pull request #34702: [SPARK-37455][SQL] Replace hash with sort aggregate if child is already sorted

2021-11-25 Thread GitBox
SparkQA removed a comment on pull request #34702: URL: https://github.com/apache/spark/pull/34702#issuecomment-979683124 **[Test build #145649 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145649/testReport)** for PR 34702 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34702: [SPARK-37455][SQL] Replace hash with sort aggregate if child is already sorted

2021-11-25 Thread GitBox
AmplabJenkins removed a comment on pull request #34702: URL: https://github.com/apache/spark/pull/34702#issuecomment-979723310 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145649/

[GitHub] [spark] SparkQA commented on pull request #34702: [SPARK-37455][SQL] Replace hash with sort aggregate if child is already sorted

2021-11-25 Thread GitBox
SparkQA commented on pull request #34702: URL: https://github.com/apache/spark/pull/34702#issuecomment-979723157 **[Test build #145649 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145649/testReport)** for PR 34702 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #34702: [SPARK-37455][SQL] Replace hash with sort aggregate if child is already sorted

2021-11-25 Thread GitBox
AmplabJenkins commented on pull request #34702: URL: https://github.com/apache/spark/pull/34702#issuecomment-979723310 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145649/ -- This

[GitHub] [spark] Peng-Lei commented on a change in pull request #34719: [SPARK-37381][SQL] Unify v1 and v2 SHOW CREATE TABLE tests

2021-11-25 Thread GitBox
Peng-Lei commented on a change in pull request #34719: URL: https://github.com/apache/spark/pull/34719#discussion_r757256714 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/command/v1/ShowCreateTableSuite.scala ## @@ -0,0 +1,140 @@ +/* + * Licensed to the

[GitHub] [spark] Peng-Lei commented on a change in pull request #34719: [SPARK-37381][SQL] Unify v1 and v2 SHOW CREATE TABLE tests

2021-11-25 Thread GitBox
Peng-Lei commented on a change in pull request #34719: URL: https://github.com/apache/spark/pull/34719#discussion_r757256714 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/command/v1/ShowCreateTableSuite.scala ## @@ -0,0 +1,140 @@ +/* + * Licensed to the

[GitHub] [spark] sarutak commented on pull request #34720: [SPARK-37469][WebUI] unified shuffle read block time to shuffle read fetch wait time in StagePage

2021-11-25 Thread GitBox
sarutak commented on pull request #34720: URL: https://github.com/apache/spark/pull/34720#issuecomment-979727702 ok to test. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34713: [SPARK-37464][SQL] SCHEMA and DATABASE should simply be aliases of NAMESPACE

2021-11-25 Thread GitBox
AmplabJenkins removed a comment on pull request #34713: URL: https://github.com/apache/spark/pull/34713#issuecomment-979740580 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145641/

[GitHub] [spark] SparkQA commented on pull request #34715: [WIP][SPARK-37445][BUILD] Rename the maven hadoop profile to hadoop-3 and hadoop-2

2021-11-25 Thread GitBox
SparkQA commented on pull request #34715: URL: https://github.com/apache/spark/pull/34715#issuecomment-979740872 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50127/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #34712: [SPARK-37463][SQL] Read/Write Timestamp ntz or ltz to Orc uses UTC timestamp

2021-11-25 Thread GitBox
SparkQA commented on pull request #34712: URL: https://github.com/apache/spark/pull/34712#issuecomment-979749033 **[Test build #145660 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145660/testReport)** for PR 34712 at commit

[GitHub] [spark] beliefer commented on a change in pull request #34712: [SPARK-37463][SQL] Read/Write Timestamp ntz or ltz to Orc uses UTC timestamp

2021-11-25 Thread GitBox
beliefer commented on a change in pull request #34712: URL: https://github.com/apache/spark/pull/34712#discussion_r757277336 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/orc/OrcFileFormat.scala ## @@ -214,6 +213,21 @@ class OrcFileFormat

[GitHub] [spark] AmplabJenkins commented on pull request #34716: [SPARK-37468][SQL] Support ANSI intervals and TimestampNTZ for UnionEstimation

2021-11-25 Thread GitBox
AmplabJenkins commented on pull request #34716: URL: https://github.com/apache/spark/pull/34716#issuecomment-979703941 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50115/ --

[GitHub] [spark] SparkQA commented on pull request #34716: [SPARK-37468][SQL] Support ANSI intervals and TimestampNTZ for UnionEstimation

2021-11-25 Thread GitBox
SparkQA commented on pull request #34716: URL: https://github.com/apache/spark/pull/34716#issuecomment-979703925 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50115/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #34715: [WIP][SPARK-37445][BUILD] Rename the maven hadoop profile to hadoop-3 and hadoop-2

2021-11-25 Thread GitBox
SparkQA commented on pull request #34715: URL: https://github.com/apache/spark/pull/34715#issuecomment-979703670 **[Test build #145656 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145656/testReport)** for PR 34715 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34716: [SPARK-37468][SQL] Support ANSI intervals and TimestampNTZ for UnionEstimation

2021-11-25 Thread GitBox
AmplabJenkins removed a comment on pull request #34716: URL: https://github.com/apache/spark/pull/34716#issuecomment-979703941 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50115/

[GitHub] [spark] SparkQA commented on pull request #34575: [SPARK-37273][SQL] Support hidden file metadata columns in Spark SQL

2021-11-25 Thread GitBox
SparkQA commented on pull request #34575: URL: https://github.com/apache/spark/pull/34575#issuecomment-979713031 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50121/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #34715: [WIP][SPARK-37445][BUILD] Rename the maven hadoop profile to hadoop-3 and hadoop-2

2021-11-25 Thread GitBox
SparkQA commented on pull request #34715: URL: https://github.com/apache/spark/pull/34715#issuecomment-979720733 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50125/ -- This is an automated message from the Apache

[GitHub] [spark] Peng-Lei commented on a change in pull request #34719: [SPARK-37381][SQL] Unify v1 and v2 SHOW CREATE TABLE tests

2021-11-25 Thread GitBox
Peng-Lei commented on a change in pull request #34719: URL: https://github.com/apache/spark/pull/34719#discussion_r757251460 ## File path: sql/core/src/test/scala/org/apache/spark/sql/ShowCreateTableSuite.scala ## @@ -1,241 +0,0 @@ -/* - * Licensed to the Apache Software

[GitHub] [spark] toujours33 commented on pull request #34720: [SPARK-37469][WebUI] unified shuffle read block time to shuffle read fetch wait time in StagePage

2021-11-25 Thread GitBox
toujours33 commented on pull request #34720: URL: https://github.com/apache/spark/pull/34720#issuecomment-979739800 > @toujours33 nit, but could you update the [screenshot](http://spark.apache.org/docs/latest/img/AllStagesPageDetail6.png) in the

[GitHub] [spark] SparkQA removed a comment on pull request #34713: [SPARK-37464][SQL] SCHEMA and DATABASE should simply be aliases of NAMESPACE

2021-11-25 Thread GitBox
SparkQA removed a comment on pull request #34713: URL: https://github.com/apache/spark/pull/34713#issuecomment-979619854 **[Test build #145641 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145641/testReport)** for PR 34713 at commit

[GitHub] [spark] SparkQA commented on pull request #34713: [SPARK-37464][SQL] SCHEMA and DATABASE should simply be aliases of NAMESPACE

2021-11-25 Thread GitBox
SparkQA commented on pull request #34713: URL: https://github.com/apache/spark/pull/34713#issuecomment-979739731 **[Test build #145641 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145641/testReport)** for PR 34713 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #34715: [WIP][SPARK-37445][BUILD] Rename the maven hadoop profile to hadoop-3 and hadoop-2

2021-11-25 Thread GitBox
SparkQA removed a comment on pull request #34715: URL: https://github.com/apache/spark/pull/34715#issuecomment-979701395 **[Test build #145654 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145654/testReport)** for PR 34715 at commit

[GitHub] [spark] SparkQA commented on pull request #34715: [WIP][SPARK-37445][BUILD] Rename the maven hadoop profile to hadoop-3 and hadoop-2

2021-11-25 Thread GitBox
SparkQA commented on pull request #34715: URL: https://github.com/apache/spark/pull/34715#issuecomment-979702124 **[Test build #145654 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145654/testReport)** for PR 34715 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #34715: [WIP][SPARK-37445][BUILD] Rename the maven hadoop profile to hadoop-3 and hadoop-2

2021-11-25 Thread GitBox
AmplabJenkins commented on pull request #34715: URL: https://github.com/apache/spark/pull/34715#issuecomment-979702134 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145654/ -- This

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34715: [WIP][SPARK-37445][BUILD] Rename the maven hadoop profile to hadoop-3 and hadoop-2

2021-11-25 Thread GitBox
AmplabJenkins removed a comment on pull request #34715: URL: https://github.com/apache/spark/pull/34715#issuecomment-979702134 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145654/

[GitHub] [spark] SparkQA commented on pull request #34715: [WIP][SPARK-37445][BUILD] Rename the maven hadoop profile to hadoop-3 and hadoop-2

2021-11-25 Thread GitBox
SparkQA commented on pull request #34715: URL: https://github.com/apache/spark/pull/34715#issuecomment-979702461 **[Test build #145655 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145655/testReport)** for PR 34715 at commit

[GitHub] [spark] sadikovi commented on pull request #34596: [SPARK-37326][SQL] Support TimestampNTZ in CSV data source

2021-11-25 Thread GitBox
sadikovi commented on pull request #34596: URL: https://github.com/apache/spark/pull/34596#issuecomment-979711191 jenkins retest this please -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] SparkQA commented on pull request #34718: [SPARK-37460][DOCS] Add the description of ALTER DATABASE SET LOCATION

2021-11-25 Thread GitBox
SparkQA commented on pull request #34718: URL: https://github.com/apache/spark/pull/34718#issuecomment-979713631 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50118/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #34575: [SPARK-37273][SQL] Support hidden file metadata columns in Spark SQL

2021-11-25 Thread GitBox
SparkQA commented on pull request #34575: URL: https://github.com/apache/spark/pull/34575#issuecomment-979734219 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50121/ -- This is an automated message from the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34720: [SPARK-37469][WebUI] unified shuffle read block time to shuffle read fetch wait time in StagePage

2021-11-25 Thread GitBox
AmplabJenkins removed a comment on pull request #34720: URL: https://github.com/apache/spark/pull/34720#issuecomment-979719055 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [spark] SparkQA commented on pull request #34720: [SPARK-37469][WebUI] unified shuffle read block time to shuffle read fetch wait time in StagePage

2021-11-25 Thread GitBox
SparkQA commented on pull request #34720: URL: https://github.com/apache/spark/pull/34720#issuecomment-979742130 **[Test build #145659 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145659/testReport)** for PR 34720 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #34707: [SPARK-37459][BUILD] Upgrade commons-cli to 1.5.0

2021-11-25 Thread GitBox
AmplabJenkins commented on pull request #34707: URL: https://github.com/apache/spark/pull/34707#issuecomment-978925703 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145616/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #34701: [SPARK-37450][SQL] Prune unnecessary fiels from Generate under count-only Aggregate

2021-11-25 Thread GitBox
AmplabJenkins commented on pull request #34701: URL: https://github.com/apache/spark/pull/34701#issuecomment-978925620 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145611/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #34634: [SPARK-37357][SQL] Add small partition factor for rebalance partitions

2021-11-25 Thread GitBox
AmplabJenkins commented on pull request #34634: URL: https://github.com/apache/spark/pull/34634#issuecomment-978925705 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145601/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #34596: [SPARK-37326][SQL] Support TimestampNTZ in CSV data source

2021-11-25 Thread GitBox
AmplabJenkins commented on pull request #34596: URL: https://github.com/apache/spark/pull/34596#issuecomment-978925704 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50091/ --

[GitHub] [spark] AmplabJenkins commented on pull request #34575: [SPARK-37273][SQL] Support hidden file metadata columns in Spark SQL

2021-11-25 Thread GitBox
AmplabJenkins commented on pull request #34575: URL: https://github.com/apache/spark/pull/34575#issuecomment-978925706 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145602/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #34700: [SPARK-36861][SQL] Use `yyyy-MM-dd` as the date pattern in partition discovery

2021-11-25 Thread GitBox
AmplabJenkins commented on pull request #34700: URL: https://github.com/apache/spark/pull/34700#issuecomment-978925707 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50090/ --

[GitHub] [spark] AmplabJenkins commented on pull request #34610: [SPARK-34332][SQL][TEST] Unify v1 and v2 ALTER TABLE .. SET LOCATION tests

2021-11-25 Thread GitBox
AmplabJenkins commented on pull request #34610: URL: https://github.com/apache/spark/pull/34610#issuecomment-978925709 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50089/ --

[GitHub] [spark] SparkQA removed a comment on pull request #34701: [SPARK-37450][SQL] Prune unnecessary fiels from Generate under count-only Aggregate

2021-11-25 Thread GitBox
SparkQA removed a comment on pull request #34701: URL: https://github.com/apache/spark/pull/34701#issuecomment-978779238 **[Test build #145611 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145611/testReport)** for PR 34701 at commit

[GitHub] [spark] imback82 opened a new pull request #34708: [SPARK-37311][SQL] Migrate ALTER NAMESPACE ... SET LOCATION to use V2 command by default

2021-11-25 Thread GitBox
imback82 opened a new pull request #34708: URL: https://github.com/apache/spark/pull/34708 ### What changes were proposed in this pull request? This PR proposes to use V2 commands as default as outlined in [SPARK-36588](https://issues.apache.org/jira/browse/SPARK-36588), and

[GitHub] [spark] cloud-fan closed pull request #34634: [SPARK-37357][SQL] Add small partition factor for rebalance partitions

2021-11-25 Thread GitBox
cloud-fan closed pull request #34634: URL: https://github.com/apache/spark/pull/34634 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [spark] SparkQA commented on pull request #34708: [SPARK-37311][SQL] Migrate ALTER NAMESPACE ... SET LOCATION to use V2 command by default

2021-11-25 Thread GitBox
SparkQA commented on pull request #34708: URL: https://github.com/apache/spark/pull/34708#issuecomment-978993563 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50095/ -- This is an automated message from the Apache

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #29024: [SPARK-32001][SQL]Create JDBC authentication provider developer API

2021-11-25 Thread GitBox
gaborgsomogyi commented on a change in pull request #29024: URL: https://github.com/apache/spark/pull/29024#discussion_r756654435 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/connection/ConnectionProvider.scala ## @@ -18,60 +18,45 @@

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #29024: [SPARK-32001][SQL]Create JDBC authentication provider developer API

2021-11-25 Thread GitBox
gaborgsomogyi commented on a change in pull request #29024: URL: https://github.com/apache/spark/pull/29024#discussion_r756654435 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/connection/ConnectionProvider.scala ## @@ -18,60 +18,45 @@

  1   2   3   4   5   6   >