[GitHub] [spark] AngersZhuuuu commented on a change in pull request #30145: [SPARK-33233][SQL]CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

2021-04-07 Thread GitBox
AngersZh commented on a change in pull request #30145: URL: https://github.com/apache/spark/pull/30145#discussion_r609329246 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala ## @@ -1788,16 +1788,30 @@ class Analyzer(override

[GitHub] [spark] SparkQA commented on pull request #32054: [SPARK-34946][SQL] Block unsupported correlated scalar subquery in Aggregate

2021-04-07 Thread GitBox
SparkQA commented on pull request #32054: URL: https://github.com/apache/spark/pull/32054#issuecomment-815466094 **[Test build #137040 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137040/testReport)** for PR 32054 at commit

[GitHub] [spark] SparkQA commented on pull request #32054: [SPARK-34946][SQL] Block unsupported correlated scalar subquery in Aggregate

2021-04-07 Thread GitBox
SparkQA commented on pull request #32054: URL: https://github.com/apache/spark/pull/32054#issuecomment-815462255 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] SparkQA commented on pull request #32082: [SPARK-34981][SQL] Implement V2 function resolution and evaluation

2021-04-07 Thread GitBox
SparkQA commented on pull request #32082: URL: https://github.com/apache/spark/pull/32082#issuecomment-815460314 **[Test build #137041 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137041/testReport)** for PR 32082 at commit

[GitHub] [spark] SparkQA commented on pull request #31517: [SPARK-34309][BUILD][CORE][SQL][K8S]Use Caffeine instead of Guava Cache

2021-04-07 Thread GitBox
SparkQA commented on pull request #31517: URL: https://github.com/apache/spark/pull/31517#issuecomment-815459515 **[Test build #137047 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137047/testReport)** for PR 31517 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #32074: [SPARK-34977][SQL] LIST FILES/JARS/ARCHIVES cannot handle multiple arguments properly when at least one path is quoted

2021-04-07 Thread GitBox
AmplabJenkins commented on pull request #32074: URL: https://github.com/apache/spark/pull/32074#issuecomment-815457683 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41632/ --

[GitHub] [spark] SparkQA commented on pull request #32074: [SPARK-34977][SQL] LIST FILES/JARS/ARCHIVES cannot handle multiple arguments properly when at least one path is quoted

2021-04-07 Thread GitBox
SparkQA commented on pull request #32074: URL: https://github.com/apache/spark/pull/32074#issuecomment-815457653 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] SparkQA commented on pull request #32086: [DO-NOT-MERGE] Increase the number of retries

2021-04-07 Thread GitBox
SparkQA commented on pull request #32086: URL: https://github.com/apache/spark/pull/32086#issuecomment-815455277 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] AmplabJenkins commented on pull request #32086: [DO-NOT-MERGE] Increase the number of retries

2021-04-07 Thread GitBox
AmplabJenkins commented on pull request #32086: URL: https://github.com/apache/spark/pull/32086#issuecomment-815455305 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41631/ --

[GitHub] [spark] AmplabJenkins commented on pull request #32032: [SPARK-34701][SQL] Introduce AnalysisOnlyCommand that allows its children to be removed once the command is marked as analyzed.

2021-04-07 Thread GitBox
AmplabJenkins commented on pull request #32032: URL: https://github.com/apache/spark/pull/32032#issuecomment-815454994 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137046/ -- This

[GitHub] [spark] SparkQA commented on pull request #32032: [SPARK-34701][SQL] Introduce AnalysisOnlyCommand that allows its children to be removed once the command is marked as analyzed.

2021-04-07 Thread GitBox
SparkQA commented on pull request #32032: URL: https://github.com/apache/spark/pull/32032#issuecomment-815454110 **[Test build #137046 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137046/testReport)** for PR 32032 at commit

[GitHub] [spark] SparkQA commented on pull request #31666: [SPARK-34527][SQL] Resolve duplicated common columns from USING/NATURAL JOIN

2021-04-07 Thread GitBox
SparkQA commented on pull request #31666: URL: https://github.com/apache/spark/pull/31666#issuecomment-815453184 **[Test build #137058 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137058/testReport)** for PR 31666 at commit

[GitHub] [spark] SparkQA commented on pull request #32086: [DO-NOT-MERGE] Increase the number of retries

2021-04-07 Thread GitBox
SparkQA commented on pull request #32086: URL: https://github.com/apache/spark/pull/32086#issuecomment-815452977 **[Test build #137057 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137057/testReport)** for PR 32086 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #32074: [SPARK-34977][SQL] LIST FILES/JARS/ARCHIVES cannot handle multiple arguments properly when at least one path is quoted

2021-04-07 Thread GitBox
AmplabJenkins commented on pull request #32074: URL: https://github.com/apache/spark/pull/32074#issuecomment-815451838 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137053/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32083: [WIP][SPARK-34886][PYTHON] Port/integrate Koalas DataFrame unit test into PySpark

2021-04-07 Thread GitBox
AmplabJenkins commented on pull request #32083: URL: https://github.com/apache/spark/pull/32083#issuecomment-815451836 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41627/ --

[GitHub] [spark] AmplabJenkins commented on pull request #32085: [SPARK-34970][3.0][SQL][SERCURITY] Redact map-type options in the output of explain()

2021-04-07 Thread GitBox
AmplabJenkins commented on pull request #32085: URL: https://github.com/apache/spark/pull/32085#issuecomment-815451839 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41630/ --

[GitHub] [spark] AmplabJenkins commented on pull request #32084: [SPARK-34980][SQL] Support coalesce partition through union

2021-04-07 Thread GitBox
AmplabJenkins commented on pull request #32084: URL: https://github.com/apache/spark/pull/32084#issuecomment-815451835 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41626/ --

[GitHub] [spark] SparkQA commented on pull request #32085: [SPARK-34970][3.0][SQL][SERCURITY] Redact map-type options in the output of explain()

2021-04-07 Thread GitBox
SparkQA commented on pull request #32085: URL: https://github.com/apache/spark/pull/32085#issuecomment-815443094 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41630/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #32085: [SPARK-34970][3.0][SQL][SERCURITY] Redact map-type options in the output of explain()

2021-04-07 Thread GitBox
SparkQA commented on pull request #32085: URL: https://github.com/apache/spark/pull/32085#issuecomment-815441227 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41630/ -- This is an automated message from the Apache

[GitHub] [spark] KarlManong closed pull request #32080: [SPARK-34674] Spark app on k8s doesn't terminate without call to sparkContext.stop() method

2021-04-07 Thread GitBox
KarlManong closed pull request #32080: URL: https://github.com/apache/spark/pull/32080 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [spark] KarlManong commented on pull request #32080: [SPARK-34674] Spark app on k8s doesn't terminate without call to sparkContext.stop() method

2021-04-07 Thread GitBox
KarlManong commented on pull request #32080: URL: https://github.com/apache/spark/pull/32080#issuecomment-815440922 > BTW, this doesn't look like [SPARK-34674](https://issues.apache.org/jira/browse/SPARK-34674) because the case in

[GitHub] [spark] KarlManong commented on a change in pull request #32080: [SPARK-34674] Spark app on k8s doesn't terminate without call to sparkContext.stop() method

2021-04-07 Thread GitBox
KarlManong commented on a change in pull request #32080: URL: https://github.com/apache/spark/pull/32080#discussion_r609291585 ## File path: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala ## @@ -1031,6 +1031,8 @@ object SparkSubmit extends CommandLineUtils with

[GitHub] [spark] SparkQA commented on pull request #32083: [WIP][SPARK-34886][PYTHON] Port/integrate Koalas DataFrame unit test into PySpark

2021-04-07 Thread GitBox
SparkQA commented on pull request #32083: URL: https://github.com/apache/spark/pull/32083#issuecomment-815438615 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41627/ --

[GitHub] [spark] SparkQA removed a comment on pull request #32074: [SPARK-34977][SQL] LIST FILES/JARS/ARCHIVES cannot handle multiple arguments properly when at least one path is quoted

2021-04-07 Thread GitBox
SparkQA removed a comment on pull request #32074: URL: https://github.com/apache/spark/pull/32074#issuecomment-815419786 **[Test build #137053 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137053/testReport)** for PR 32074 at commit

[GitHub] [spark] SparkQA commented on pull request #32084: [SPARK-34980][SQL] Support coalesce partition through union

2021-04-07 Thread GitBox
SparkQA commented on pull request #32084: URL: https://github.com/apache/spark/pull/32084#issuecomment-815437826 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] SparkQA commented on pull request #32074: [SPARK-34977][SQL] LIST FILES/JARS/ARCHIVES cannot handle multiple arguments properly when at least one path is quoted

2021-04-07 Thread GitBox
SparkQA commented on pull request #32074: URL: https://github.com/apache/spark/pull/32074#issuecomment-815437760 **[Test build #137053 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137053/testReport)** for PR 32074 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29087: [SPARK-28227][SQL] Support projection, aggregate/window functions, and lateral view in the TRANSFORM clause

2021-04-07 Thread GitBox
AmplabJenkins removed a comment on pull request #29087: URL: https://github.com/apache/spark/pull/29087#issuecomment-815435047 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41629/

[GitHub] [spark] AmplabJenkins commented on pull request #29087: [SPARK-28227][SQL] Support projection, aggregate/window functions, and lateral view in the TRANSFORM clause

2021-04-07 Thread GitBox
AmplabJenkins commented on pull request #29087: URL: https://github.com/apache/spark/pull/29087#issuecomment-815435047 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41629/ --

[GitHub] [spark] SparkQA commented on pull request #29087: [SPARK-28227][SQL] Support projection, aggregate/window functions, and lateral view in the TRANSFORM clause

2021-04-07 Thread GitBox
SparkQA commented on pull request #29087: URL: https://github.com/apache/spark/pull/29087#issuecomment-815435025 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] SparkQA commented on pull request #32032: [SPARK-34701][SQL] Introduce AnalysisOnlyCommand that allows its children to be removed once the command is marked as analyzed.

2021-04-07 Thread GitBox
SparkQA commented on pull request #32032: URL: https://github.com/apache/spark/pull/32032#issuecomment-815433365 **[Test build #137056 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137056/testReport)** for PR 32032 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30144: [SPARK-33229][SQL] Support partial grouping analytics and concatenated grouping analytics

2021-04-07 Thread GitBox
AmplabJenkins removed a comment on pull request #30144: URL: https://github.com/apache/spark/pull/30144#issuecomment-815432956 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41628/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32032: [SPARK-34701][SQL] Introduce AnalysisOnlyCommand that allows its children to be removed once the command is marked as analyzed.

2021-04-07 Thread GitBox
AmplabJenkins removed a comment on pull request #32032: URL: https://github.com/apache/spark/pull/32032#issuecomment-815418245 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41621/

[GitHub] [spark] AmplabJenkins commented on pull request #30144: [SPARK-33229][SQL] Support partial grouping analytics and concatenated grouping analytics

2021-04-07 Thread GitBox
AmplabJenkins commented on pull request #30144: URL: https://github.com/apache/spark/pull/30144#issuecomment-815432956 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41628/ --

[GitHub] [spark] SparkQA commented on pull request #30144: [SPARK-33229][SQL] Support partial grouping analytics and concatenated grouping analytics

2021-04-07 Thread GitBox
SparkQA commented on pull request #30144: URL: https://github.com/apache/spark/pull/30144#issuecomment-815432933 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] SparkQA commented on pull request #32054: [SPARK-34946][SQL] Block unsupported correlated scalar subquery in Aggregate

2021-04-07 Thread GitBox
SparkQA commented on pull request #32054: URL: https://github.com/apache/spark/pull/32054#issuecomment-815432387 **[Test build #137055 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137055/testReport)** for PR 32054 at commit

[GitHub] [spark] SparkQA commented on pull request #32086: [DO-NOT-MERGE] Increase the number of retries

2021-04-07 Thread GitBox
SparkQA commented on pull request #32086: URL: https://github.com/apache/spark/pull/32086#issuecomment-815432339 **[Test build #137054 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137054/testReport)** for PR 32086 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31517: [SPARK-34309][BUILD][CORE][SQL][K8S]Use Caffeine instead of Guava Cache

2021-04-07 Thread GitBox
AmplabJenkins removed a comment on pull request #31517: URL: https://github.com/apache/spark/pull/31517#issuecomment-815431356 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41625/

[GitHub] [spark] AmplabJenkins commented on pull request #31517: [SPARK-34309][BUILD][CORE][SQL][K8S]Use Caffeine instead of Guava Cache

2021-04-07 Thread GitBox
AmplabJenkins commented on pull request #31517: URL: https://github.com/apache/spark/pull/31517#issuecomment-815431356 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41625/ --

[GitHub] [spark] allisonwang-db commented on a change in pull request #32054: [SPARK-34946][SQL] Block unsupported correlated scalar subquery in Aggregate

2021-04-07 Thread GitBox
allisonwang-db commented on a change in pull request #32054: URL: https://github.com/apache/spark/pull/32054#discussion_r609152666 ## File path: sql/core/src/test/scala/org/apache/spark/sql/SubquerySuite.scala ## @@ -1765,4 +1765,35 @@ class SubquerySuite extends QueryTest

[GitHub] [spark] allisonwang-db commented on a change in pull request #32054: [SPARK-34946][SQL] Block unsupported correlated scalar subquery in Aggregate

2021-04-07 Thread GitBox
allisonwang-db commented on a change in pull request #32054: URL: https://github.com/apache/spark/pull/32054#discussion_r609265541 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala ## @@ -305,6 +305,12 @@ trait CheckAnalysis

[GitHub] [spark] HyukjinKwon opened a new pull request #32086: [DO-NOT-MERGE] Increase the number of retries

2021-04-07 Thread GitBox
HyukjinKwon opened a new pull request #32086: URL: https://github.com/apache/spark/pull/32086 ### What changes were proposed in this pull request? See if it makes the situation better. ### Why are the changes needed? ### Does this PR introduce _any_ user-facing change?

[GitHub] [spark] SparkQA commented on pull request #31517: [SPARK-34309][BUILD][CORE][SQL][K8S]Use Caffeine instead of Guava Cache

2021-04-07 Thread GitBox
SparkQA commented on pull request #31517: URL: https://github.com/apache/spark/pull/31517#issuecomment-815421455 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] HyukjinKwon commented on pull request #24559: [SPARK-27658][SQL] Add FunctionCatalog API

2021-04-07 Thread GitBox
HyukjinKwon commented on pull request #24559: URL: https://github.com/apache/spark/pull/24559#issuecomment-815420455  -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [spark] HyukjinKwon commented on pull request #32052: [SPARK-34955][SQL] ADD JAR command cannot add jar files which contains whitespaces in the path

2021-04-07 Thread GitBox
HyukjinKwon commented on pull request #32052: URL: https://github.com/apache/spark/pull/32052#issuecomment-815420143 I agree with this change. Thanks @sarutak and @dongjoon-hyun -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #32074: [SPARK-34977][SQL] LIST FILES/JARS/ARCHIVES cannot handle multiple arguments properly when at least one path is quoted

2021-04-07 Thread GitBox
SparkQA commented on pull request #32074: URL: https://github.com/apache/spark/pull/32074#issuecomment-815419786 **[Test build #137053 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137053/testReport)** for PR 32074 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #32032: [SPARK-34701][SQL] Introduce AnalysisOnlyCommand that allows its children to be removed once the command is marked as analyzed.

2021-04-07 Thread GitBox
AmplabJenkins commented on pull request #32032: URL: https://github.com/apache/spark/pull/32032#issuecomment-815418245 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41621/ --

[GitHub] [spark] SparkQA commented on pull request #32032: [SPARK-34701][SQL] Introduce AnalysisOnlyCommand that allows its children to be removed once the command is marked as analyzed.

2021-04-07 Thread GitBox
SparkQA commented on pull request #32032: URL: https://github.com/apache/spark/pull/32032#issuecomment-815418216 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41621/ -- This is an automated message from the

[GitHub] [spark] HyukjinKwon commented on pull request #32078: [SPARK-34762][BUILD][FOLLOWUP] Remove the workaround for SPARK-34762

2021-04-07 Thread GitBox
HyukjinKwon commented on pull request #32078: URL: https://github.com/apache/spark/pull/32078#issuecomment-815416885 Thanks guys! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] dongjoon-hyun commented on pull request #32079: [SPARK-34970][SQL][SERCURITY][3.1] Redact map-type options in the output of explain()

2021-04-07 Thread GitBox
dongjoon-hyun commented on pull request #32079: URL: https://github.com/apache/spark/pull/32079#issuecomment-815416368 Thank you! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] SparkQA commented on pull request #32085: [SPARK-34970][3.0][SQL][SERCURITY] Redact map-type options in the output of explain()

2021-04-07 Thread GitBox
SparkQA commented on pull request #32085: URL: https://github.com/apache/spark/pull/32085#issuecomment-815415610 **[Test build #137052 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137052/testReport)** for PR 32085 at commit

[GitHub] [spark] SparkQA commented on pull request #32032: [SPARK-34701][SQL] Introduce AnalysisOnlyCommand that allows its children to be removed once the command is marked as analyzed.

2021-04-07 Thread GitBox
SparkQA commented on pull request #32032: URL: https://github.com/apache/spark/pull/32032#issuecomment-815415395 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41621/ -- This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30144: [SPARK-33229][SQL] Support partial grouping analytics and concatenated grouping analytics

2021-04-07 Thread GitBox
AmplabJenkins removed a comment on pull request #30144: URL: https://github.com/apache/spark/pull/30144#issuecomment-815398553 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41624/

[GitHub] [spark] AmplabJenkins commented on pull request #30145: [SPARK-33233][SQL]CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

2021-04-07 Thread GitBox
AmplabJenkins commented on pull request #30145: URL: https://github.com/apache/spark/pull/30145#issuecomment-815415003 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41623/ --

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30145: [SPARK-33233][SQL]CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

2021-04-07 Thread GitBox
AmplabJenkins removed a comment on pull request #30145: URL: https://github.com/apache/spark/pull/30145#issuecomment-815415003 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41623/

[GitHub] [spark] SparkQA commented on pull request #30145: [SPARK-33233][SQL]CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

2021-04-07 Thread GitBox
SparkQA commented on pull request #30145: URL: https://github.com/apache/spark/pull/30145#issuecomment-815414975 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] SparkQA commented on pull request #29087: [SPARK-28227][SQL] Support projection, aggregate/window functions, and lateral view in the TRANSFORM clause

2021-04-07 Thread GitBox
SparkQA commented on pull request #29087: URL: https://github.com/apache/spark/pull/29087#issuecomment-815414900 **[Test build #137051 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137051/testReport)** for PR 29087 at commit

[GitHub] [spark] SparkQA commented on pull request #30144: [SPARK-33229][SQL] Support partial grouping analytics and concatenated grouping analytics

2021-04-07 Thread GitBox
SparkQA commented on pull request #30144: URL: https://github.com/apache/spark/pull/30144#issuecomment-815414821 **[Test build #137050 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137050/testReport)** for PR 30144 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32037: [SPARK-34944][SQL][TESTS] Replace bigint with int for web_returns and store_returns in TPCDS tests to employ correct data type

2021-04-07 Thread GitBox
AmplabJenkins removed a comment on pull request #32037: URL: https://github.com/apache/spark/pull/32037#issuecomment-815414560 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41620/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32083: [WIP][SPARK-34886][PYTHON] Port/integrate Koalas DataFrame unit test into PySpark

2021-04-07 Thread GitBox
AmplabJenkins removed a comment on pull request #32083: URL: https://github.com/apache/spark/pull/32083#issuecomment-815396462 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [spark] gengliangwang commented on pull request #32085: [SPARK-34970][3.0][SQL][SERCURITY] Redact map-type options in the output of explain()

2021-04-07 Thread GitBox
gengliangwang commented on pull request #32085: URL: https://github.com/apache/spark/pull/32085#issuecomment-815414590 This is to backport https://github.com/apache/spark/pull/32066 to branch-3.0 -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins commented on pull request #32037: [SPARK-34944][SQL][TESTS] Replace bigint with int for web_returns and store_returns in TPCDS tests to employ correct data type

2021-04-07 Thread GitBox
AmplabJenkins commented on pull request #32037: URL: https://github.com/apache/spark/pull/32037#issuecomment-815414560 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41620/ --

[GitHub] [spark] SparkQA commented on pull request #32037: [SPARK-34944][SQL][TESTS] Replace bigint with int for web_returns and store_returns in TPCDS tests to employ correct data type

2021-04-07 Thread GitBox
SparkQA commented on pull request #32037: URL: https://github.com/apache/spark/pull/32037#issuecomment-815414539 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] SparkQA commented on pull request #32084: [SPARK-34980][SQL] Support coalesce partition through union

2021-04-07 Thread GitBox
SparkQA commented on pull request #32084: URL: https://github.com/apache/spark/pull/32084#issuecomment-815414403 **[Test build #137048 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137048/testReport)** for PR 32084 at commit

[GitHub] [spark] SparkQA commented on pull request #32083: [WIP][SPARK-34886][PYTHON] Port/integrate Koalas DataFrame unit test into PySpark

2021-04-07 Thread GitBox
SparkQA commented on pull request #32083: URL: https://github.com/apache/spark/pull/32083#issuecomment-815414458 **[Test build #137049 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137049/testReport)** for PR 32083 at commit

[GitHub] [spark] gengliangwang opened a new pull request #32085: [SPARK-34970][SQL][SERCURITY] Redact map-type options in the output of explain()

2021-04-07 Thread GitBox
gengliangwang opened a new pull request #32085: URL: https://github.com/apache/spark/pull/32085 ### What changes were proposed in this pull request? The `explain()` method prints the arguments of tree nodes in logical/physical plans. The arguments could contain a map-type

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30334: [SPARK-33411][SQL] Cardinality estimation of union, sort and range operator

2021-04-07 Thread GitBox
AmplabJenkins removed a comment on pull request #30334: URL: https://github.com/apache/spark/pull/30334#issuecomment-815413565 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41622/

[GitHub] [spark] SparkQA commented on pull request #30334: [SPARK-33411][SQL] Cardinality estimation of union, sort and range operator

2021-04-07 Thread GitBox
SparkQA commented on pull request #30334: URL: https://github.com/apache/spark/pull/30334#issuecomment-815413557 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41622/ --

[GitHub] [spark] AmplabJenkins commented on pull request #30334: [SPARK-33411][SQL] Cardinality estimation of union, sort and range operator

2021-04-07 Thread GitBox
AmplabJenkins commented on pull request #30334: URL: https://github.com/apache/spark/pull/30334#issuecomment-815413565 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41622/ --

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31666: [SPARK-34527][SQL] Resolve duplicated common columns from USING/NATURAL JOIN

2021-04-07 Thread GitBox
AmplabJenkins removed a comment on pull request #31666: URL: https://github.com/apache/spark/pull/31666#issuecomment-815413212 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137035/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32082: [SPARK-34981][SQL] Implement V2 function resolution and evaluation

2021-04-07 Thread GitBox
AmplabJenkins removed a comment on pull request #32082: URL: https://github.com/apache/spark/pull/32082#issuecomment-815413210 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137039/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32030: [WIP] Improve the performance of mapChildren and withNewChildren methods

2021-04-07 Thread GitBox
AmplabJenkins removed a comment on pull request #32030: URL: https://github.com/apache/spark/pull/32030#issuecomment-815413211 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137038/

[GitHub] [spark] AmplabJenkins commented on pull request #32030: [WIP] Improve the performance of mapChildren and withNewChildren methods

2021-04-07 Thread GitBox
AmplabJenkins commented on pull request #32030: URL: https://github.com/apache/spark/pull/32030#issuecomment-815413211 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137038/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32082: [SPARK-34981][SQL] Implement V2 function resolution and evaluation

2021-04-07 Thread GitBox
AmplabJenkins commented on pull request #32082: URL: https://github.com/apache/spark/pull/32082#issuecomment-815413210 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137039/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #31666: [SPARK-34527][SQL] Resolve duplicated common columns from USING/NATURAL JOIN

2021-04-07 Thread GitBox
AmplabJenkins commented on pull request #31666: URL: https://github.com/apache/spark/pull/31666#issuecomment-815413212 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137035/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #32030: [WIP] Improve the performance of mapChildren and withNewChildren methods

2021-04-07 Thread GitBox
SparkQA removed a comment on pull request #32030: URL: https://github.com/apache/spark/pull/32030#issuecomment-815353635 **[Test build #137038 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137038/testReport)** for PR 32030 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #31666: [SPARK-34527][SQL] Resolve duplicated common columns from USING/NATURAL JOIN

2021-04-07 Thread GitBox
SparkQA removed a comment on pull request #31666: URL: https://github.com/apache/spark/pull/31666#issuecomment-815299424 **[Test build #137035 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137035/testReport)** for PR 31666 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #32082: [SPARK-34981][SQL] Implement V2 function resolution and evaluation

2021-04-07 Thread GitBox
SparkQA removed a comment on pull request #32082: URL: https://github.com/apache/spark/pull/32082#issuecomment-815355595 **[Test build #137039 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137039/testReport)** for PR 32082 at commit

[GitHub] [spark] SparkQA commented on pull request #32082: [SPARK-34981][SQL] Implement V2 function resolution and evaluation

2021-04-07 Thread GitBox
SparkQA commented on pull request #32082: URL: https://github.com/apache/spark/pull/32082#issuecomment-815409002 **[Test build #137039 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137039/testReport)** for PR 32082 at commit

[GitHub] [spark] ulysses-you opened a new pull request #32084: [SPARK-34980][SQL] Support coalesce partition through union

2021-04-07 Thread GitBox
ulysses-you opened a new pull request #32084: URL: https://github.com/apache/spark/pull/32084 ### What changes were proposed in this pull request? Coalesce children if plan is `Union`. ### Why are the changes needed? The rule `CoalesceShufflePartitions` can only

[GitHub] [spark] SparkQA commented on pull request #32030: [WIP] Improve the performance of mapChildren and withNewChildren methods

2021-04-07 Thread GitBox
SparkQA commented on pull request #32030: URL: https://github.com/apache/spark/pull/32030#issuecomment-815406859 **[Test build #137038 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137038/testReport)** for PR 32030 at commit

[GitHub] [spark] SparkQA commented on pull request #31666: [SPARK-34527][SQL] Resolve duplicated common columns from USING/NATURAL JOIN

2021-04-07 Thread GitBox
SparkQA commented on pull request #31666: URL: https://github.com/apache/spark/pull/31666#issuecomment-815405904 **[Test build #137035 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137035/testReport)** for PR 31666 at commit

[GitHub] [spark] maropu commented on a change in pull request #30145: [SPARK-33233][SQL]CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

2021-04-07 Thread GitBox
maropu commented on a change in pull request #30145: URL: https://github.com/apache/spark/pull/30145#discussion_r609224510 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala ## @@ -1788,16 +1788,30 @@ class Analyzer(override val

[GitHub] [spark] maropu commented on a change in pull request #30145: [SPARK-33233][SQL]CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

2021-04-07 Thread GitBox
maropu commented on a change in pull request #30145: URL: https://github.com/apache/spark/pull/30145#discussion_r609223977 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala ## @@ -1788,16 +1788,30 @@ class Analyzer(override val

[GitHub] [spark] gengliangwang commented on pull request #32079: [SPARK-34970][SQL][SERCURITY][3.1] Redact map-type options in the output of explain()

2021-04-07 Thread GitBox
gengliangwang commented on pull request #32079: URL: https://github.com/apache/spark/pull/32079#issuecomment-815402168 @dongjoon-hyun Sure, I will backport to 3.0 and update the JIRA -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] ueshin commented on pull request #32083: [WIP][SPARK-34886][PYTHON] Port/integrate Koalas DataFrame unit test into PySpark

2021-04-07 Thread GitBox
ueshin commented on pull request #32083: URL: https://github.com/apache/spark/pull/32083#issuecomment-815401615 ok to test. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [spark] maropu commented on pull request #29087: [SPARK-28227][SQL] Support projection, aggregate/window functions, and lateral view in the TRANSFORM clause

2021-04-07 Thread GitBox
maropu commented on pull request #29087: URL: https://github.com/apache/spark/pull/29087#issuecomment-815400618 retest this please -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins commented on pull request #30144: [SPARK-33229][SQL] Support partial grouping analytics and concatenated grouping analytics

2021-04-07 Thread GitBox
AmplabJenkins commented on pull request #30144: URL: https://github.com/apache/spark/pull/30144#issuecomment-815398553 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41624/ --

[GitHub] [spark] SparkQA commented on pull request #30144: [SPARK-33229][SQL] Support partial grouping analytics and concatenated grouping analytics

2021-04-07 Thread GitBox
SparkQA commented on pull request #30144: URL: https://github.com/apache/spark/pull/30144#issuecomment-815398540 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41624/ --

[GitHub] [spark] SparkQA commented on pull request #31517: [SPARK-34309][BUILD][CORE][SQL][K8S]Use Caffeine instead of Guava Cache

2021-04-07 Thread GitBox
SparkQA commented on pull request #31517: URL: https://github.com/apache/spark/pull/31517#issuecomment-815398569 **[Test build #137047 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137047/testReport)** for PR 31517 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #30144: [SPARK-33229][SQL] Support partial grouping analytics and concatenated grouping analytics

2021-04-07 Thread GitBox
SparkQA removed a comment on pull request #30144: URL: https://github.com/apache/spark/pull/30144#issuecomment-815395423 **[Test build #137045 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137045/testReport)** for PR 30144 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30144: [SPARK-33229][SQL] Support partial grouping analytics and concatenated grouping analytics

2021-04-07 Thread GitBox
AmplabJenkins removed a comment on pull request #30144: URL: https://github.com/apache/spark/pull/30144#issuecomment-815397425 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137045/

[GitHub] [spark] AmplabJenkins commented on pull request #30144: [SPARK-33229][SQL] Support partial grouping analytics and concatenated grouping analytics

2021-04-07 Thread GitBox
AmplabJenkins commented on pull request #30144: URL: https://github.com/apache/spark/pull/30144#issuecomment-815397425 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137045/ -- This

[GitHub] [spark] SparkQA commented on pull request #30144: [SPARK-33229][SQL] Support partial grouping analytics and concatenated grouping analytics

2021-04-07 Thread GitBox
SparkQA commented on pull request #30144: URL: https://github.com/apache/spark/pull/30144#issuecomment-815397407 **[Test build #137045 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137045/testReport)** for PR 30144 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #32083: [WIP] [SPARK-34886] Port/integrate Koalas DataFrame unit test into PySpark

2021-04-07 Thread GitBox
AmplabJenkins commented on pull request #32083: URL: https://github.com/apache/spark/pull/32083#issuecomment-815396462 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [spark] SparkQA commented on pull request #32032: [SPARK-34701][SQL] Introduce AnalysisOnlyCommand that allows its children to be removed once the command is marked as analyzed.

2021-04-07 Thread GitBox
SparkQA commented on pull request #32032: URL: https://github.com/apache/spark/pull/32032#issuecomment-815396136 **[Test build #137046 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137046/testReport)** for PR 32032 at commit

[GitHub] [spark] imback82 commented on a change in pull request #32032: [SPARK-34701][SQL] Introduce AnalysisOnlyCommand that allows its children to be removed once the command is marked as analyzed.

2021-04-07 Thread GitBox
imback82 commented on a change in pull request #32032: URL: https://github.com/apache/spark/pull/32032#discussion_r609213767 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/CacheTableExec.scala ## @@ -94,19 +94,19 @@ case class

[GitHub] [spark] xinrong-databricks opened a new pull request #32083: [WIP] [SPARK-34886] Port/integrate Koalas DataFrame unit test into PySpark

2021-04-07 Thread GitBox
xinrong-databricks opened a new pull request #32083: URL: https://github.com/apache/spark/pull/32083 ### What changes were proposed in this pull request? Now that we merged the Koalas main code into the PySpark code base (#32036), we should port the Koalas DataFrame unit test to

[GitHub] [spark] yaooqinn commented on a change in pull request #32037: [SPARK-34944][SQL][TESTS] Replace bigint with int for web_returns and store_returns in TPCDS tests to employ correct data type

2021-04-07 Thread GitBox
yaooqinn commented on a change in pull request #32037: URL: https://github.com/apache/spark/pull/32037#discussion_r609213392 ## File path: sql/core/src/test/scala/org/apache/spark/sql/TPCDSBase.scala ## @@ -21,6 +21,49 @@ import org.apache.spark.sql.catalyst.TableIdentifier

[GitHub] [spark] SparkQA commented on pull request #30144: [SPARK-33229][SQL] Support partial grouping analytics and concatenated grouping analytics

2021-04-07 Thread GitBox
SparkQA commented on pull request #30144: URL: https://github.com/apache/spark/pull/30144#issuecomment-815395423 **[Test build #137045 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137045/testReport)** for PR 30144 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32032: [SPARK-34701][SQL] Introduce AnalysisOnlyCommand that allows its children to be removed once the command is marked as analyzed.

2021-04-07 Thread GitBox
AmplabJenkins removed a comment on pull request #32032: URL: https://github.com/apache/spark/pull/32032#issuecomment-814862152 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136992/

  1   2   3   4   5   6   7   >