[GitHub] [spark] SparkQA commented on pull request #30650: [SPARK-24818][CORE] Support delay scheduling for barrier execution

SparkQA commented on pull request #30650: URL: https://github.com/apache/spark/pull/30650#issuecomment-769644475 **[Test build #134640 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134640/testReport)** for PR 30650 at commit

[GitHub] [spark] SparkQA commented on pull request #31264: [SPARK-34144][SQL] Exception thrown when trying to write LocalDate and Instant values to a JDBC relation

SparkQA commented on pull request #31264: URL: https://github.com/apache/spark/pull/31264#issuecomment-769643165 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39231/

[GitHub] [spark] SparkQA commented on pull request #31245: [SPARK-34157][SQL] Unify output of SHOW TABLES and pass output attributes properly

SparkQA commented on pull request #31245: URL: https://github.com/apache/spark/pull/31245#issuecomment-769641399 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39232/

[GitHub] [spark] AmplabJenkins commented on pull request #31377: [SPARK-34239][SQL] Unify output of SHOW COLUMNS pass output attributes properly

AmplabJenkins commented on pull request #31377: URL: https://github.com/apache/spark/pull/31377#issuecomment-769635442 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134633/

[GitHub] [spark] AmplabJenkins commented on pull request #31389: [SPARK-34284][CORE][TESTS] Fix deprecated API usage of Apache commons-io

AmplabJenkins commented on pull request #31389: URL: https://github.com/apache/spark/pull/31389#issuecomment-769635443 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134638/

[GitHub] [spark] SparkQA commented on pull request #31245: [SPARK-34157][SQL] Unify output of SHOW TABLES and pass output attributes properly

SparkQA commented on pull request #31245: URL: https://github.com/apache/spark/pull/31245#issuecomment-769633875 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39232/

[GitHub] [spark] zhengruifeng commented on a change in pull request #29185: [SPARK-32384][CORE] repartitionAndSortWithinPartitions avoid shuffle with same partitioner

zhengruifeng commented on a change in pull request #29185: URL: https://github.com/apache/spark/pull/29185#discussion_r566626246 ## File path: core/src/main/scala/org/apache/spark/rdd/OrderedRDDFunctions.scala ## @@ -73,7 +75,21 @@ class OrderedRDDFunctions[K : Ordering :

[GitHub] [spark] SparkQA commented on pull request #31264: [SPARK-34144][SQL] Exception thrown when trying to write LocalDate and Instant values to a JDBC relation

SparkQA commented on pull request #31264: URL: https://github.com/apache/spark/pull/31264#issuecomment-769631155 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39231/

[GitHub] [spark] maropu commented on a change in pull request #31207: [SPARK-34136][PYTHON][SQL] Add support for complex literals in PySpark

maropu commented on a change in pull request #31207: URL: https://github.com/apache/spark/pull/31207#discussion_r566624021 ## File path: python/pyspark/sql/functions.py ## @@ -91,13 +92,48 @@ def lit(col): Creates a :class:`Column` of literal value. ..

[GitHub] [spark] Ngone51 commented on pull request #31348: [SPARK-34245][CORE] Ensure Master removes executors that failed to send finished state

Ngone51 commented on pull request #31348: URL: https://github.com/apache/spark/pull/31348#issuecomment-769621949 > for example to trigger the schedule() function periodically. I have considered this approach and think it might not work in the case of the `requestedCores` is

[GitHub] [spark] skestle closed pull request #31252: [SPARK-33888][SQL][FOLLOWUP] Restored scale metadata for ARRAY type (Postgres)

skestle closed pull request #31252: URL: https://github.com/apache/spark/pull/31252 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [spark] skestle commented on pull request #31252: [SPARK-33888][SQL][FOLLOWUP] Restored scale metadata for ARRAY type (Postgres)

skestle commented on pull request #31252: URL: https://github.com/apache/spark/pull/31252#issuecomment-769621669 Thankyou @sarutak for following up with #31262 when I didn't have the time ;) This is an automated message from

[GitHub] [spark] SparkQA removed a comment on pull request #31389: [SPARK-34284][CORE][TESTS] Fix deprecated API usage of Apache commons-io

SparkQA removed a comment on pull request #31389: URL: https://github.com/apache/spark/pull/31389#issuecomment-769569671 **[Test build #134638 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134638/testReport)** for PR 31389 at commit

[GitHub] [spark] SparkQA commented on pull request #31389: [SPARK-34284][CORE][TESTS] Fix deprecated API usage of Apache commons-io

SparkQA commented on pull request #31389: URL: https://github.com/apache/spark/pull/31389#issuecomment-769620214 **[Test build #134638 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134638/testReport)** for PR 31389 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #31377: [SPARK-34239][SQL] Unify output of SHOW COLUMNS pass output attributes properly

SparkQA removed a comment on pull request #31377: URL: https://github.com/apache/spark/pull/31377#issuecomment-769537068 **[Test build #134633 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134633/testReport)** for PR 31377 at commit

[GitHub] [spark] SparkQA commented on pull request #31377: [SPARK-34239][SQL] Unify output of SHOW COLUMNS pass output attributes properly

SparkQA commented on pull request #31377: URL: https://github.com/apache/spark/pull/31377#issuecomment-769618672 **[Test build #134633 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134633/testReport)** for PR 31377 at commit

[GitHub] [spark] cristichircu commented on a change in pull request #31264: [SPARK-34144][SQL] Exception thrown when trying to write LocalDate and Instant values to a JDBC relation

cristichircu commented on a change in pull request #31264: URL: https://github.com/apache/spark/pull/31264#discussion_r566612985 ## File path: sql/core/src/test/scala/org/apache/spark/sql/jdbc/JDBCWriteSuite.scala ## @@ -606,4 +610,70 @@ class JDBCWriteSuite extends

[GitHub] [spark] SparkQA removed a comment on pull request #31378: [SPARK-34240][SQL] Unify output of SHOW TBLPROPERTIES pass output attribute properly

SparkQA removed a comment on pull request #31378: URL: https://github.com/apache/spark/pull/31378#issuecomment-769534379 **[Test build #134632 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134632/testReport)** for PR 31378 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #31245: [SPARK-34157][SQL] Unify output of SHOW TABLES and pass output attributes properly

AmplabJenkins commented on pull request #31245: URL: https://github.com/apache/spark/pull/31245#issuecomment-769614926 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134644/

[GitHub] [spark] AmplabJenkins commented on pull request #31264: [SPARK-34144][SQL] Exception thrown when trying to write LocalDate and Instant values to a JDBC relation

AmplabJenkins commented on pull request #31264: URL: https://github.com/apache/spark/pull/31264#issuecomment-769614925 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134643/

[GitHub] [spark] AmplabJenkins commented on pull request #31391: [SPARK-33212][FOLLOW-UP][BUILD] Fix test "built-in Hadoop version should support shaded client" for hadoop-2.7

AmplabJenkins commented on pull request #31391: URL: https://github.com/apache/spark/pull/31391#issuecomment-769614924 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] cloud-fan commented on pull request #31352: [SPARK-34252][SQL] Subquery with view in aggregate's grouping expression fails during the analysis check

cloud-fan commented on pull request #31352: URL: https://github.com/apache/spark/pull/31352#issuecomment-769614946 Hi @imback82 , can you re-open the PR to add the tests? thanks! This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins commented on pull request #31382: [SPARK-34144][SQL][3.0] Exception thrown when trying to write LocalDate and Instant values to a table

AmplabJenkins commented on pull request #31382: URL: https://github.com/apache/spark/pull/31382#issuecomment-769614927 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134642/

[GitHub] [spark] cloud-fan commented on pull request #31182: [SPARK-34108][SQL] Caching with permanent view doesn't work in certain cases

cloud-fan commented on pull request #31182: URL: https://github.com/apache/spark/pull/31182#issuecomment-769614860 Hi @sunchao , can you re-open the PR to add the tests? thanks! This is an automated message from the Apache

[GitHub] [spark] HyukjinKwon commented on pull request #31384: [SPARK-31816][SQL] Added high level description about JDBC connection providers for users/developers

HyukjinKwon commented on pull request #31384: URL: https://github.com/apache/spark/pull/31384#issuecomment-769614770 cc @huaxingao, @dilipbiswal FYI This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] AmplabJenkins commented on pull request #31378: [SPARK-34240][SQL] Unify output of SHOW TBLPROPERTIES pass output attribute properly

AmplabJenkins commented on pull request #31378: URL: https://github.com/apache/spark/pull/31378#issuecomment-769614748 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134632/

[GitHub] [spark] HyukjinKwon commented on pull request #31391: [SPARK-33212][FOLLOW-UP][BUILD] Fix test "built-in Hadoop version should support shaded client" for hadoop-2.7

HyukjinKwon commented on pull request #31391: URL: https://github.com/apache/spark/pull/31391#issuecomment-769614229 Merged to master. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] HyukjinKwon closed pull request #31391: [SPARK-33212][FOLLOW-UP][BUILD] Fix test "built-in Hadoop version should support shaded client" for hadoop-2.7

HyukjinKwon closed pull request #31391: URL: https://github.com/apache/spark/pull/31391 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] cloud-fan closed pull request #31368: [SPARK-34269][SQL] Simplify SQL view resolution

cloud-fan closed pull request #31368: URL: https://github.com/apache/spark/pull/31368 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [spark] SparkQA commented on pull request #31378: [SPARK-34240][SQL] Unify output of SHOW TBLPROPERTIES pass output attribute properly

SparkQA commented on pull request #31378: URL: https://github.com/apache/spark/pull/31378#issuecomment-769614050 **[Test build #134632 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134632/testReport)** for PR 31378 at commit

[GitHub] [spark] cloud-fan commented on pull request #31368: [SPARK-34269][SQL] Simplify SQL view resolution

cloud-fan commented on pull request #31368: URL: https://github.com/apache/spark/pull/31368#issuecomment-769613707 GA passed, merging to master, thanks for the review! This is an automated message from the Apache Git

[GitHub] [spark] cloud-fan commented on a change in pull request #31372: [SPARK-34272][SQL] Pretty SQL should check NonSQLExpression

cloud-fan commented on a change in pull request #31372: URL: https://github.com/apache/spark/pull/31372#discussion_r566610241 ## File path: sql/core/src/test/resources/sql-tests/results/udf/postgreSQL/udf-aggregates_part1.sql.out ## @@ -109,7 +109,7 @@ struct -- !query

[GitHub] [spark] AmplabJenkins commented on pull request #30650: [SPARK-24818][CORE] Support delay scheduling for barrier execution

AmplabJenkins commented on pull request #30650: URL: https://github.com/apache/spark/pull/30650#issuecomment-769610134 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39228/

[GitHub] [spark] AmplabJenkins commented on pull request #31368: [SPARK-34269][SQL] Simplify SQL view resolution

AmplabJenkins commented on pull request #31368: URL: https://github.com/apache/spark/pull/31368#issuecomment-769610135 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134639/

[GitHub] [spark] AmplabJenkins commented on pull request #31258: [SPARK-34168] [SQL] Support DPP in AQE when the join is Broadcast hash join at the beginning

AmplabJenkins commented on pull request #31258: URL: https://github.com/apache/spark/pull/31258#issuecomment-769610136 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134636/

[GitHub] [spark] AmplabJenkins commented on pull request #31389: [SPARK-34284][CORE][TESTS] Fix deprecated API usage of Apache commons-io

AmplabJenkins commented on pull request #31389: URL: https://github.com/apache/spark/pull/31389#issuecomment-769610133 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39226/

[GitHub] [spark] cloud-fan commented on a change in pull request #31245: [SPARK-34157][SQL] Unify output of SHOW TABLES and pass output attributes properly

cloud-fan commented on a change in pull request #31245: URL: https://github.com/apache/spark/pull/31245#discussion_r566607701 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/command/ShowTablesSuiteBase.scala ## @@ -37,13 +36,14 @@ trait

[GitHub] [spark] c21 commented on pull request #31340: [SPARK-34237][SQL] Add more metrics (fallback, spill) to object hash aggregate

c21 commented on pull request #31340: URL: https://github.com/apache/spark/pull/31340#issuecomment-769606994 Thanks @maropu and @cloud-fan for review! This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] c21 commented on a change in pull request #31340: [SPARK-34237][SQL] Add more metrics (fallback, spill) to object hash aggregate

c21 commented on a change in pull request #31340: URL: https://github.com/apache/spark/pull/31340#discussion_r566604963 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/ObjectAggregationIterator.scala ## @@ -76,6 +82,11 @@ class

[GitHub] [spark] beliefer commented on a change in pull request #31245: [SPARK-34157][SQL] Unify output of SHOW TABLES and pass output attributes properly

beliefer commented on a change in pull request #31245: URL: https://github.com/apache/spark/pull/31245#discussion_r566539660 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/command/v1/ShowTablesSuite.scala ## @@ -138,4 +121,21 @@ class ShowTablesSuite

[GitHub] [spark] SparkQA commented on pull request #31258: [SPARK-34168] [SQL] Support DPP in AQE when the join is Broadcast hash join at the beginning

SparkQA commented on pull request #31258: URL: https://github.com/apache/spark/pull/31258#issuecomment-769601744 **[Test build #134636 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134636/testReport)** for PR 31258 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #31258: [SPARK-34168] [SQL] Support DPP in AQE when the join is Broadcast hash join at the beginning

SparkQA removed a comment on pull request #31258: URL: https://github.com/apache/spark/pull/31258#issuecomment-769555073 **[Test build #134636 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134636/testReport)** for PR 31258 at commit

[GitHub] [spark] beliefer commented on a change in pull request #31245: [SPARK-34157][SQL] Unify output of SHOW TABLES and pass output attributes properly

beliefer commented on a change in pull request #31245: URL: https://github.com/apache/spark/pull/31245#discussion_r566539660 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/command/v1/ShowTablesSuite.scala ## @@ -138,4 +121,21 @@ class ShowTablesSuite

[GitHub] [spark] SparkQA commented on pull request #31389: [SPARK-34284][CORE][TESTS] Fix deprecated API usage of Apache commons-io

SparkQA commented on pull request #31389: URL: https://github.com/apache/spark/pull/31389#issuecomment-769594305 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39226/

[GitHub] [spark] HyukjinKwon commented on pull request #31391: [SPARK-33212][FOLLOW-UP][BUILD] Fix test "built-in Hadoop version should support shaded client" for hadoop-2.7

HyukjinKwon commented on pull request #31391: URL: https://github.com/apache/spark/pull/31391#issuecomment-769591236 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [spark] HyukjinKwon commented on pull request #31363: [SPARK-34154][YARN] Extend LocalityPlacementStrategySuite's test with a timeout

HyukjinKwon commented on pull request #31363: URL: https://github.com/apache/spark/pull/31363#issuecomment-769590677 Thanks @attilapiros. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] SparkQA commented on pull request #30650: [SPARK-24818][CORE] Support delay scheduling for barrier execution

SparkQA commented on pull request #30650: URL: https://github.com/apache/spark/pull/30650#issuecomment-769589402 **[Test build #134640 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134640/testReport)** for PR 30650 at commit

[GitHub] [spark] Ngone51 commented on pull request #30650: [SPARK-24818][CORE] Support delay scheduling for barrier execution

Ngone51 commented on pull request #30650: URL: https://github.com/apache/spark/pull/30650#issuecomment-769587926 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] Ngone51 commented on pull request #30650: [SPARK-24818][CORE] Support delay scheduling for barrier execution

Ngone51 commented on pull request #30650: URL: https://github.com/apache/spark/pull/30650#issuecomment-769587860 kindly ping @mridulm @tgravescs This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] AmplabJenkins commented on pull request #31391: [SPARK-33212][FOLLOW-UP][BUILD] Fix test "built-in Hadoop version should support shaded client" for hadoop-2.7

AmplabJenkins commented on pull request #31391: URL: https://github.com/apache/spark/pull/31391#issuecomment-769587564 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31258: [SPARK-34168] [SQL] Support DPP in AQE when the join is Broadcast hash join at the beginning

AmplabJenkins removed a comment on pull request #31258: URL: https://github.com/apache/spark/pull/31258#issuecomment-769587200 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39224/

[GitHub] [spark] AmplabJenkins commented on pull request #31245: [SPARK-34157][SQL] Unify output of SHOW TABLES and pass output attributes properly

AmplabJenkins commented on pull request #31245: URL: https://github.com/apache/spark/pull/31245#issuecomment-769587193 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134635/

[GitHub] [spark] AmplabJenkins commented on pull request #31388: [SPARK-34260][SQL][2.4] Fix UnresolvedException when creating temp view twice

AmplabJenkins commented on pull request #31388: URL: https://github.com/apache/spark/pull/31388#issuecomment-769587197 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134631/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31368: [SPARK-34269][SQL] Simplify SQL view resolution

AmplabJenkins removed a comment on pull request #31368: URL: https://github.com/apache/spark/pull/31368#issuecomment-769587192 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39227/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31390: [SPARK-28123][SQL] String Functions: support btrim

AmplabJenkins removed a comment on pull request #31390: URL: https://github.com/apache/spark/pull/31390#issuecomment-769587194 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31245: [SPARK-34157][SQL] Unify output of SHOW TABLES and pass output attributes properly

AmplabJenkins removed a comment on pull request #31245: URL: https://github.com/apache/spark/pull/31245#issuecomment-769587193 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134635/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31388: [SPARK-34260][SQL][2.4] Fix UnresolvedException when creating temp view twice

AmplabJenkins removed a comment on pull request #31388: URL: https://github.com/apache/spark/pull/31388#issuecomment-769587197 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134631/

[GitHub] [spark] AmplabJenkins commented on pull request #31368: [SPARK-34269][SQL] Simplify SQL view resolution

AmplabJenkins commented on pull request #31368: URL: https://github.com/apache/spark/pull/31368#issuecomment-769587192 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39227/

[GitHub] [spark] AmplabJenkins commented on pull request #31390: [SPARK-28123][SQL] String Functions: support btrim

AmplabJenkins commented on pull request #31390: URL: https://github.com/apache/spark/pull/31390#issuecomment-769587194 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #31258: [SPARK-34168] [SQL] Support DPP in AQE when the join is Broadcast hash join at the beginning

AmplabJenkins commented on pull request #31258: URL: https://github.com/apache/spark/pull/31258#issuecomment-769587200 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39224/

[GitHub] [spark] SparkQA removed a comment on pull request #31245: [SPARK-34157][SQL] Unify output of SHOW TABLES and pass output attributes properly

SparkQA removed a comment on pull request #31245: URL: https://github.com/apache/spark/pull/31245#issuecomment-769534158 **[Test build #134635 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134635/testReport)** for PR 31245 at commit

[GitHub] [spark] SparkQA commented on pull request #31245: [SPARK-34157][SQL] Unify output of SHOW TABLES and pass output attributes properly

SparkQA commented on pull request #31245: URL: https://github.com/apache/spark/pull/31245#issuecomment-769585837 **[Test build #134635 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134635/testReport)** for PR 31245 at commit

[GitHub] [spark] SparkQA commented on pull request #31390: [SPARK-28123][SQL] String Functions: support btrim

SparkQA commented on pull request #31390: URL: https://github.com/apache/spark/pull/31390#issuecomment-769584623 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39225/

[GitHub] [spark] SparkQA commented on pull request #31389: [SPARK-34284][CORE][TESTS] Fix deprecated API usage of Apache commons-io

SparkQA commented on pull request #31389: URL: https://github.com/apache/spark/pull/31389#issuecomment-769584117 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39226/

[GitHub] [spark] SparkQA commented on pull request #31390: [SPARK-28123][SQL] String Functions: support btrim

SparkQA commented on pull request #31390: URL: https://github.com/apache/spark/pull/31390#issuecomment-769583147 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39225/

[GitHub] [spark] cloud-fan commented on pull request #31391: [SPARK-33212][FOLLOW-UP][BUILD] Fix test "built-in Hadoop version should support shaded client" for hadoop-2.7

cloud-fan commented on pull request #31391: URL: https://github.com/apache/spark/pull/31391#issuecomment-769581661 cc @sunchao @dongjoon-hyun This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] attilapiros edited a comment on pull request #31363: [SPARK-34154][YARN] Extend LocalityPlacementStrategySuite's test with a timeout

attilapiros edited a comment on pull request #31363: URL: https://github.com/apache/spark/pull/31363#issuecomment-769579261 This was expected. The goal was to avoid endless wait for the test to finish and get more info about the problem via a stack trace. And we have the stack

[GitHub] [spark] attilapiros commented on pull request #31363: [SPARK-34154][YARN] Extend LocalityPlacementStrategySuite's test with a timeout

attilapiros commented on pull request #31363: URL: https://github.com/apache/spark/pull/31363#issuecomment-769579261 This was expected. The goal was to avoid endless wait for the test to finish and get more info about the problem via a stack trace. And we have the stack trace:

[GitHub] [spark] SparkQA removed a comment on pull request #31388: [SPARK-34260][SQL][2.4] Fix UnresolvedException when creating temp view twice

SparkQA removed a comment on pull request #31388: URL: https://github.com/apache/spark/pull/31388#issuecomment-769537466 **[Test build #134631 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134631/testReport)** for PR 31388 at commit

[GitHub] [spark] SparkQA commented on pull request #31388: [SPARK-34260][SQL][2.4] Fix UnresolvedException when creating temp view twice

SparkQA commented on pull request #31388: URL: https://github.com/apache/spark/pull/31388#issuecomment-769577476 **[Test build #134631 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134631/testReport)** for PR 31388 at commit

[GitHub] [spark] bozhang2820 opened a new pull request #31391: [SPARK-33212][FOLLOW-UP][BUILD] Fix test "built-in Hadoop version should support shaded client" for hadoop-2.7

bozhang2820 opened a new pull request #31391: URL: https://github.com/apache/spark/pull/31391 ### What changes were proposed in this pull request? We added test "built-in Hadoop version should support shaded client" in https://github.com/apache/spark/pull/31203, but it fails when

[GitHub] [spark] viirya commented on a change in pull request #31368: [SPARK-34269][SQL] Simplify SQL view resolution

viirya commented on a change in pull request #31368: URL: https://github.com/apache/spark/pull/31368#discussion_r566578589 ## File path: sql/core/src/test/resources/sql-tests/results/group-by-filter.sql.out ## @@ -796,14 +796,16 @@ IN/EXISTS predicate sub-queries can only be

[GitHub] [spark] imback82 commented on a change in pull request #31368: [SPARK-34269][SQL] Simplify SQL view resolution

imback82 commented on a change in pull request #31368: URL: https://github.com/apache/spark/pull/31368#discussion_r566577976 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/LogicalPlan.scala ## @@ -230,7 +230,7 @@ object

[GitHub] [spark] SparkQA commented on pull request #31390: [SPARK-28123][SQL] String Functions: support btrim

SparkQA commented on pull request #31390: URL: https://github.com/apache/spark/pull/31390#issuecomment-769572709 **[Test build #134637 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134637/testReport)** for PR 31390 at commit

[GitHub] [spark] SparkQA commented on pull request #31258: [SPARK-34168] [SQL] Support DPP in AQE when the join is Broadcast hash join at the beginning

SparkQA commented on pull request #31258: URL: https://github.com/apache/spark/pull/31258#issuecomment-769572412 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39224/

[GitHub] [spark] maropu commented on a change in pull request #31207: [SPARK-34136][PYTHON][SQL] Add support for complex literals in PySpark

maropu commented on a change in pull request #31207: URL: https://github.com/apache/spark/pull/31207#discussion_r566568600 ## File path: python/pyspark/sql/functions.py ## @@ -91,13 +92,48 @@ def lit(col): Creates a :class:`Column` of literal value. ..

[GitHub] [spark] cloud-fan commented on a change in pull request #31368: [SPARK-34269][SQL] Simplify SQL view resolution

cloud-fan commented on a change in pull request #31368: URL: https://github.com/apache/spark/pull/31368#discussion_r566575842 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/LogicalPlan.scala ## @@ -230,7 +230,7 @@ object

[GitHub] [spark] cloud-fan commented on a change in pull request #31368: [SPARK-34269][SQL] Simplify SQL view resolution

cloud-fan commented on a change in pull request #31368: URL: https://github.com/apache/spark/pull/31368#discussion_r566575842 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/LogicalPlan.scala ## @@ -230,7 +230,7 @@ object

[GitHub] [spark] cloud-fan commented on a change in pull request #31368: [SPARK-34269][SQL] Simplify SQL view resolution

cloud-fan commented on a change in pull request #31368: URL: https://github.com/apache/spark/pull/31368#discussion_r566575428 ## File path: sql/core/src/test/resources/sql-tests/results/group-by-filter.sql.out ## @@ -796,14 +796,16 @@ IN/EXISTS predicate sub-queries can only

[GitHub] [spark] SparkQA commented on pull request #31389: [SPARK-34284][CORE][TESTS] Fix deprecated API usage of Apache commons-io

SparkQA commented on pull request #31389: URL: https://github.com/apache/spark/pull/31389#issuecomment-769569671 **[Test build #134638 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134638/testReport)** for PR 31389 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31378: [SPARK-34240][SQL] Unify output of SHOW TBLPROPERTIES pass output attribute properly

AmplabJenkins removed a comment on pull request #31378: URL: https://github.com/apache/spark/pull/31378#issuecomment-769569104 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39220/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31388: [SPARK-34260][SQL][2.4] Fix UnresolvedException when creating temp view twice

AmplabJenkins removed a comment on pull request #31388: URL: https://github.com/apache/spark/pull/31388#issuecomment-769569105 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39219/

[GitHub] [spark] AmplabJenkins commented on pull request #31388: [SPARK-34260][SQL][2.4] Fix UnresolvedException when creating temp view twice

AmplabJenkins commented on pull request #31388: URL: https://github.com/apache/spark/pull/31388#issuecomment-769569105 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39219/

[GitHub] [spark] AmplabJenkins commented on pull request #31378: [SPARK-34240][SQL] Unify output of SHOW TBLPROPERTIES pass output attribute properly

AmplabJenkins commented on pull request #31378: URL: https://github.com/apache/spark/pull/31378#issuecomment-769569104 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39220/

[GitHub] [spark] cloud-fan closed pull request #31340: [SPARK-34237][SQL] Add more metrics (fallback, spill) to object hash aggregate

cloud-fan closed pull request #31340: URL: https://github.com/apache/spark/pull/31340 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [spark] cloud-fan commented on pull request #31340: [SPARK-34237][SQL] Add more metrics (fallback, spill) to object hash aggregate

cloud-fan commented on pull request #31340: URL: https://github.com/apache/spark/pull/31340#issuecomment-769568965 thanks, merging to master! This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] SparkQA commented on pull request #31258: [SPARK-34168] [SQL] Support DPP in AQE when the join is Broadcast hash join at the beginning

SparkQA commented on pull request #31258: URL: https://github.com/apache/spark/pull/31258#issuecomment-769564911 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39224/

[GitHub] [spark] maropu commented on a change in pull request #31207: [SPARK-34136][PYTHON][SQL] Add support for complex literals in PySpark

maropu commented on a change in pull request #31207: URL: https://github.com/apache/spark/pull/31207#discussion_r566570144 ## File path: python/pyspark/sql/functions.py ## @@ -91,13 +92,58 @@ def lit(col): Creates a :class:`Column` of literal value. ..

[GitHub] [spark] maropu commented on a change in pull request #31207: [SPARK-34136][PYTHON][SQL] Add support for complex literals in PySpark

maropu commented on a change in pull request #31207: URL: https://github.com/apache/spark/pull/31207#discussion_r566569587 ## File path: python/pyspark/sql/functions.py ## @@ -91,13 +92,58 @@ def lit(col): Creates a :class:`Column` of literal value. ..

[GitHub] [spark] maropu commented on a change in pull request #31207: [SPARK-34136][PYTHON][SQL] Add support for complex literals in PySpark

maropu commented on a change in pull request #31207: URL: https://github.com/apache/spark/pull/31207#discussion_r566568861 ## File path: python/pyspark/sql/functions.py ## @@ -91,13 +92,58 @@ def lit(col): Creates a :class:`Column` of literal value. ..

[GitHub] [spark] maropu commented on a change in pull request #31207: [SPARK-34136][PYTHON][SQL] Add support for complex literals in PySpark

maropu commented on a change in pull request #31207: URL: https://github.com/apache/spark/pull/31207#discussion_r566568600 ## File path: python/pyspark/sql/functions.py ## @@ -91,13 +92,48 @@ def lit(col): Creates a :class:`Column` of literal value. ..

[GitHub] [spark] beliefer commented on pull request #31128: [SPARK-28123][SQL] String Functions: support btrim

beliefer commented on pull request #31128: URL: https://github.com/apache/spark/pull/31128#issuecomment-769559957 The function adopt the new PR https://github.com/apache/spark/pull/31390 This is an automated message from the

[GitHub] [spark] beliefer closed pull request #31128: [SPARK-28123][SQL] String Functions: support btrim

beliefer closed pull request #31128: URL: https://github.com/apache/spark/pull/31128 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [spark] beliefer opened a new pull request #31390: [SPARK-28123][SQL] String Functions: support btrim

beliefer opened a new pull request #31390: URL: https://github.com/apache/spark/pull/31390 ### What changes were proposed in this pull request? Spark support `trim`/`ltrim`/`rtrim` now. The function `btrim` is an alternate form of `TRIM(BOTH FROM )`. `btrim` removes the longest

[GitHub] [spark] akiyamaneko commented on pull request #30446: [SPARK-33504][CORE] The application log in the Spark history server contains sensitive attributes should be redacted

akiyamaneko commented on pull request #30446: URL: https://github.com/apache/spark/pull/30446#issuecomment-769559581 @tgravescs sorry for delay, Is there anything I can do？ This is an automated message from the Apache Git

[GitHub] [spark] LuciferYang opened a new pull request #31389: [SPARK-34284][CORE] Fix deprecated API usage of Apache commons-io

LuciferYang opened a new pull request #31389: URL: https://github.com/apache/spark/pull/31389 ### What changes were proposed in this pull request? There are some deprecated API usage compilation warning related to Apache commons-io as follows: ``` [WARNING] [Warn]

[GitHub] [spark] SparkQA commented on pull request #31388: [SPARK-34260][SQL][2.4] Fix UnresolvedException when creating temp view twice

SparkQA commented on pull request #31388: URL: https://github.com/apache/spark/pull/31388#issuecomment-769558511 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39219/

[GitHub] [spark] SparkQA commented on pull request #31258: [SPARK-34168] [SQL] Support DPP in AQE when the join is Broadcast hash join at the beginning

SparkQA commented on pull request #31258: URL: https://github.com/apache/spark/pull/31258#issuecomment-769555073 **[Test build #134636 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134636/testReport)** for PR 31258 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31377: [SPARK-34239][SQL] Unify output of SHOW COLUMNS pass output attributes properly

AmplabJenkins removed a comment on pull request #31377: URL: https://github.com/apache/spark/pull/31377#issuecomment-769553519 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39221/

[GitHub] [spark] AmplabJenkins commented on pull request #31377: [SPARK-34239][SQL] Unify output of SHOW COLUMNS pass output attributes properly

AmplabJenkins commented on pull request #31377: URL: https://github.com/apache/spark/pull/31377#issuecomment-769553519 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39221/

  1   2   3   4   5   6   >