[GitHub] [spark] cloud-fan commented on a change in pull request #27988: [SPARK-31226][CORE][TEST] SizeBasedCoalesce logic will lose partition

cloud-fan commented on a change in pull request #27988: URL: https://github.com/apache/spark/pull/27988#discussion_r452668934 ## File path: core/src/test/scala/org/apache/spark/rdd/RDDSuite.scala ## @@ -1298,18 +1298,18 @@ class SizeBasedCoalescer(val maxSize: Int) extends

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #29024: [WIP][SPARK-32001][SQL]Create JDBC authentication provider developer API

gaborgsomogyi commented on a change in pull request #29024: URL: https://github.com/apache/spark/pull/29024#discussion_r452675542 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JDBCOptions.scala ## @@ -23,12 +23,15 @@ import

[GitHub] [spark] peter-toth commented on a change in pull request #29053: [SPARK-32241][SQL] Remove empty children of union

peter-toth commented on a change in pull request #29053: URL: https://github.com/apache/spark/pull/29053#discussion_r452691649 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/PropagateEmptyRelation.scala ## @@ -50,8 +50,25 @@ object

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29021: [WIP][SPARK-32201][SQL] More general skew join pattern matching

AmplabJenkins removed a comment on pull request #29021: URL: https://github.com/apache/spark/pull/29021#issuecomment-656549396 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] sarutak commented on pull request #29002: [SPARK-32175][CORE] Fix the order between initialization for ExecutorPlugin and starting heartbeat thread

sarutak commented on pull request #29002: URL: https://github.com/apache/spark/pull/29002#issuecomment-656571024 retest this please. This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #29024: [WIP][SPARK-32001][SQL]Create JDBC authentication provider developer API

gaborgsomogyi commented on a change in pull request #29024: URL: https://github.com/apache/spark/pull/29024#discussion_r452729440 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JDBCOptions.scala ## @@ -23,12 +23,15 @@ import

[GitHub] [spark] maropu commented on pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should show error message

maropu commented on pull request #29054: URL: https://github.com/apache/spark/pull/29054#issuecomment-656603797 > 1. Make Expression failed in SessionCatalog for function name = longProductSum: Invalid number of arguments for function longProductSum. Expected: 2; Found: 1; > 2. No

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

AmplabJenkins removed a comment on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-656503288 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] viirya commented on a change in pull request #29053: [SPARK-32241][SQL] Remove empty children of union

viirya commented on a change in pull request #29053: URL: https://github.com/apache/spark/pull/29053#discussion_r452641906 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/PropagateEmptyRelation.scala ## @@ -50,8 +50,25 @@ object

[GitHub] [spark] AmplabJenkins commented on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

AmplabJenkins commented on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-656503288 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

SparkQA commented on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-656503433 **[Test build #125560 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125560/testReport)** for PR 28969 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28996: [SPARK-29358][SQL] Make unionByName optionally fill missing columns with nulls

AmplabJenkins commented on pull request #28996: URL: https://github.com/apache/spark/pull/28996#issuecomment-656509472 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28996: [SPARK-29358][SQL] Make unionByName optionally fill missing columns with nulls

AmplabJenkins removed a comment on pull request #28996: URL: https://github.com/apache/spark/pull/28996#issuecomment-656509482 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

AmplabJenkins commented on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656509802 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

AmplabJenkins removed a comment on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656509802 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

SparkQA commented on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656509745 **[Test build #125562 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125562/testReport)** for PR 29057 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

AmplabJenkins commented on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-656514679 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] cloud-fan commented on a change in pull request #29031: [SPARK-32216][SQL] Remove redundant ProjectExec

cloud-fan commented on a change in pull request #29031: URL: https://github.com/apache/spark/pull/29031#discussion_r452666532 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/RemoveRedundantProjectsSuite.scala ## @@ -0,0 +1,128 @@ +/* + * Licensed to the

[GitHub] [spark] SparkQA commented on pull request #28996: [SPARK-29358][SQL] Make unionByName optionally fill missing columns with nulls

SparkQA commented on pull request #28996: URL: https://github.com/apache/spark/pull/28996#issuecomment-656525135 **[Test build #125572 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125572/testReport)** for PR 28996 at commit

[GitHub] [spark] SparkQA commented on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

SparkQA commented on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656525134 **[Test build #125570 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125570/testReport)** for PR 29057 at commit

[GitHub] [spark] SparkQA commented on pull request #29035: [SPARK-32220][SQL]SHUFFLE_REPLICATE_NL Hint should not change Non-Cartesian Product join result

SparkQA commented on pull request #29035: URL: https://github.com/apache/spark/pull/29035#issuecomment-656525047 **[Test build #125571 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125571/testReport)** for PR 29035 at commit

[GitHub] [spark] cloud-fan commented on a change in pull request #29031: [SPARK-32216][SQL] Remove redundant ProjectExec

cloud-fan commented on a change in pull request #29031: URL: https://github.com/apache/spark/pull/29031#discussion_r452666212 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/RemoveRedundantProjectsSuite.scala ## @@ -0,0 +1,128 @@ +/* + * Licensed to the

[GitHub] [spark] cloud-fan commented on a change in pull request #29031: [SPARK-32216][SQL] Remove redundant ProjectExec

cloud-fan commented on a change in pull request #29031: URL: https://github.com/apache/spark/pull/29031#discussion_r452665849 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/RemoveRedundantProjects.scala ## @@ -0,0 +1,87 @@ +/* + * Licensed to the Apache

[GitHub] [spark] HyukjinKwon commented on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

HyukjinKwon commented on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-656524904 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] HyukjinKwon commented on pull request #29059: [SPARK-32256][SQL][test-hadoop2.7] Force to initialize Hadoop VersionInfo in HiveExternalCatalog

HyukjinKwon commented on pull request #29059: URL: https://github.com/apache/spark/pull/29059#issuecomment-656524998 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins commented on pull request #28967: [SPARK-32149][SHUFFLE] Improve file path name normalisation at block resolution within the external shuffle service

AmplabJenkins commented on pull request #28967: URL: https://github.com/apache/spark/pull/28967#issuecomment-656561939 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28911: [SPARK-32077][CORE] Support host-local shuffle data reading when external shuffle service is disabled

AmplabJenkins commented on pull request #28911: URL: https://github.com/apache/spark/pull/28911#issuecomment-656561913 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28967: [SPARK-32149][SHUFFLE] Improve file path name normalisation at block resolution within the external shuffle service

SparkQA commented on pull request #28967: URL: https://github.com/apache/spark/pull/28967#issuecomment-656561358 **[Test build #125588 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125588/testReport)** for PR 28967 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28911: [SPARK-32077][CORE] Support host-local shuffle data reading when external shuffle service is disabled

AmplabJenkins removed a comment on pull request #28911: URL: https://github.com/apache/spark/pull/28911#issuecomment-656561913 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29024: [WIP][SPARK-32001][SQL]Create JDBC authentication provider developer API

AmplabJenkins removed a comment on pull request #29024: URL: https://github.com/apache/spark/pull/29024#issuecomment-656565124 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28967: [SPARK-32149][SHUFFLE] Improve file path name normalisation at block resolution within the external shuffle service

AmplabJenkins removed a comment on pull request #28967: URL: https://github.com/apache/spark/pull/28967#issuecomment-656561939 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28904: [SPARK-30462][SS] Streamline the logic on file stream source and sink metadata log to avoid memory issue

AmplabJenkins commented on pull request #28904: URL: https://github.com/apache/spark/pull/28904#issuecomment-656584135 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28904: [SPARK-30462][SS] Streamline the logic on file stream source and sink metadata log to avoid memory issue

AmplabJenkins removed a comment on pull request #28904: URL: https://github.com/apache/spark/pull/28904#issuecomment-656584135 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28412: [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI faster

AmplabJenkins commented on pull request #28412: URL: https://github.com/apache/spark/pull/28412#issuecomment-656594980 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28412: [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI faster

SparkQA commented on pull request #28412: URL: https://github.com/apache/spark/pull/28412#issuecomment-656594552 **[Test build #125598 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125598/testReport)** for PR 28412 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

AmplabJenkins removed a comment on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656603151 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

AmplabJenkins commented on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656603151 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

AmplabJenkins removed a comment on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656602485 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

SparkQA commented on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656602940 **[Test build #125599 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125599/testReport)** for PR 29057 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should show error message

AmplabJenkins removed a comment on pull request #29054: URL: https://github.com/apache/spark/pull/29054#issuecomment-656607537 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] Ngone51 commented on a change in pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

Ngone51 commented on a change in pull request #29057: URL: https://github.com/apache/spark/pull/29057#discussion_r452773774 ## File path: core/src/test/scala/org/apache/spark/deploy/master/MasterSuite.scala ## @@ -685,7 +685,8 @@ class MasterSuite extends SparkFunSuite }

[GitHub] [spark] MaxGekk commented on a change in pull request #29064: [SPARK-32272][SQL] Add and extend SQL standard command SET TIME ZONE

MaxGekk commented on a change in pull request #29064: URL: https://github.com/apache/spark/pull/29064#discussion_r452789330 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/command/ListTimeZonesCommand.scala ## @@ -0,0 +1,49 @@ +/* + * Licensed to the

[GitHub] [spark] yaooqinn commented on a change in pull request #29064: [SPARK-32272][SQL] Add and extend SQL standard command SET TIME ZONE

yaooqinn commented on a change in pull request #29064: URL: https://github.com/apache/spark/pull/29064#discussion_r452795994 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/command/ListTimeZonesCommand.scala ## @@ -0,0 +1,49 @@ +/* + * Licensed to the

[GitHub] [spark] peter-toth commented on pull request #28885: [SPARK-29375][SPARK-28940][SPARK-32041][SQL] Whole plan exchange and subquery reuse

peter-toth commented on pull request #28885: URL: https://github.com/apache/spark/pull/28885#issuecomment-656634873 @cloud-fan, @maryannxue, @maropu, @viirya could you please review this PR? This is an automated message from

[GitHub] [spark] SparkQA removed a comment on pull request #28967: [SPARK-32149][SHUFFLE] Improve file path name normalisation at block resolution within the external shuffle service

SparkQA removed a comment on pull request #28967: URL: https://github.com/apache/spark/pull/28967#issuecomment-656561358 **[Test build #125588 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125588/testReport)** for PR 28967 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27428: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

AmplabJenkins removed a comment on pull request #27428: URL: https://github.com/apache/spark/pull/27428#issuecomment-656506978 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

SparkQA commented on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656507240 **[Test build #125561 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125561/testReport)** for PR 29057 at commit

[GitHub] [spark] jiangxb1987 commented on a change in pull request #29014: [SPARK-32199][SPARK-32198] Reduce job failures during decommissioning

jiangxb1987 commented on a change in pull request #29014: URL: https://github.com/apache/spark/pull/29014#discussion_r452640653 ## File path: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala ## @@ -1767,8 +1772,15 @@ private[spark] class DAGScheduler(

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27428: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

AmplabJenkins removed a comment on pull request #27428: URL: https://github.com/apache/spark/pull/27428#issuecomment-656506973 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #27428: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

AmplabJenkins commented on pull request #27428: URL: https://github.com/apache/spark/pull/27428#issuecomment-656506973 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #27428: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

AmplabJenkins commented on pull request #27428: URL: https://github.com/apache/spark/pull/27428#issuecomment-656512071 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28996: [SPARK-29358][SQL] Make unionByName optionally fill missing columns with nulls

AmplabJenkins commented on pull request #28996: URL: https://github.com/apache/spark/pull/28996#issuecomment-656512088 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28996: [SPARK-29358][SQL] Make unionByName optionally fill missing columns with nulls

SparkQA commented on pull request #28996: URL: https://github.com/apache/spark/pull/28996#issuecomment-656511780 **[Test build #125563 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125563/testReport)** for PR 28996 at commit

[GitHub] [spark] maropu commented on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

maropu commented on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-656512074 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29059: [SPARK-32256][SQL][test-hadoop2.7] Force to initialize Hadoop VersionInfo in HiveExternalCatalog

AmplabJenkins removed a comment on pull request #29059: URL: https://github.com/apache/spark/pull/29059#issuecomment-656521788 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

AmplabJenkins commented on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-656522613 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29050: [SPARK-32238][SQL] Use Utils.getSimpleName to avoid hitting Malformed class name in ScalaUDF

AmplabJenkins removed a comment on pull request #29050: URL: https://github.com/apache/spark/pull/29050#issuecomment-656521949 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] viirya commented on a change in pull request #29053: [SPARK-32241][SQL] Remove empty children of union

viirya commented on a change in pull request #29053: URL: https://github.com/apache/spark/pull/29053#discussion_r452663150 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/PropagateEmptyRelation.scala ## @@ -50,8 +50,25 @@ object

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29062: [SPARK-32237][SQL] Resolve hint in CTE

AmplabJenkins removed a comment on pull request #29062: URL: https://github.com/apache/spark/pull/29062#issuecomment-656521759 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should show error message

AmplabJenkins removed a comment on pull request #29054: URL: https://github.com/apache/spark/pull/29054#issuecomment-656521757 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #29035: [SPARK-32220][SQL]SHUFFLE_REPLICATE_NL Hint should not change Non-Cartesian Product join result

AmplabJenkins commented on pull request #29035: URL: https://github.com/apache/spark/pull/29035#issuecomment-656522451 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28967: [SPARK-32149][SHUFFLE] Improve file path name normalisation at block resolution within the external shuffle service

AmplabJenkins removed a comment on pull request #28967: URL: https://github.com/apache/spark/pull/28967#issuecomment-656521764 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29035: [SPARK-32220][SQL]SHUFFLE_REPLICATE_NL Hint should not change Non-Cartesian Product join result

AmplabJenkins removed a comment on pull request #29035: URL: https://github.com/apache/spark/pull/29035#issuecomment-656522451 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

AmplabJenkins removed a comment on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-656521357 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29031: [SPARK-32216][SQL] Remove redundant ProjectExec

AmplabJenkins removed a comment on pull request #29031: URL: https://github.com/apache/spark/pull/29031#issuecomment-656521488 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

AmplabJenkins removed a comment on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-656522613 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28979: [SPARK-32154][SQL] Use ExpressionEncoder for the return type of ScalaUDF to convert to catalyst type

AmplabJenkins removed a comment on pull request #28979: URL: https://github.com/apache/spark/pull/28979#issuecomment-656522247 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #28676: [SPARK-31869][SQL] BroadcastHashJoinExec can utilize the build side for its output partitioning

AmplabJenkins commented on pull request #28676: URL: https://github.com/apache/spark/pull/28676#issuecomment-656522852 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

AmplabJenkins removed a comment on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656522863 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29055: [SPARK-32251][SQL][DOCS][TESTS] Fix SQL keyword document

AmplabJenkins removed a comment on pull request #29055: URL: https://github.com/apache/spark/pull/29055#issuecomment-656521864 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28979: [SPARK-32154][SQL] Use ExpressionEncoder for the return type of ScalaUDF to convert to catalyst type

AmplabJenkins removed a comment on pull request #28979: URL: https://github.com/apache/spark/pull/28979#issuecomment-656522232 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28926: [SPARK-32133][SQL] Forbid time field steps for date start/end in Sequence

AmplabJenkins commented on pull request #28926: URL: https://github.com/apache/spark/pull/28926#issuecomment-656528391 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] cloud-fan commented on a change in pull request #29053: [SPARK-32241][SQL] Remove empty children of union

cloud-fan commented on a change in pull request #29053: URL: https://github.com/apache/spark/pull/29053#discussion_r452670472 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/PropagateEmptyRelation.scala ## @@ -50,8 +50,25 @@ object

[GitHub] [spark] AmplabJenkins commented on pull request #27428: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

AmplabJenkins commented on pull request #27428: URL: https://github.com/apache/spark/pull/27428#issuecomment-656528474 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28926: [SPARK-32133][SQL] Forbid time field steps for date start/end in Sequence

SparkQA commented on pull request #28926: URL: https://github.com/apache/spark/pull/28926#issuecomment-656530852 **[Test build #125577 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125577/testReport)** for PR 28926 at commit

[GitHub] [spark] SparkQA commented on pull request #27988: [SPARK-31226][CORE][TEST] SizeBasedCoalesce logic will lose partition

SparkQA commented on pull request #27988: URL: https://github.com/apache/spark/pull/27988#issuecomment-656539559 **[Test build #125580 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125580/testReport)** for PR 27988 at commit

[GitHub] [spark] AngersZhuuuu commented on pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should show error message

AngersZh commented on pull request #29054: URL: https://github.com/apache/spark/pull/29054#issuecomment-656579403 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should show error message

SparkQA commented on pull request #29054: URL: https://github.com/apache/spark/pull/29054#issuecomment-656580156 **[Test build #125592 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125592/testReport)** for PR 29054 at commit

[GitHub] [spark] HyukjinKwon opened a new pull request #29063: [SPARK-32270][SQL] Use text file sources in CSV's schema inference in different encoding as well

HyukjinKwon opened a new pull request #29063: URL: https://github.com/apache/spark/pull/29063 ### What changes were proposed in this pull request? This PR proposes to use text datasource in CSV's schema inference. This shares the same reasons of SPARK-18362, SPARK-19885 and

[GitHub] [spark] SparkQA commented on pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

SparkQA commented on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-656580147 **[Test build #125593 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125593/testReport)** for PR 29045 at commit

[GitHub] [spark] HyukjinKwon commented on a change in pull request #15813: [SPARK-18362][SQL] Use TextFileFormat in implementation of CSVFileFormat

HyukjinKwon commented on a change in pull request #15813: URL: https://github.com/apache/spark/pull/15813#discussion_r452740030 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/CSVFileFormat.scala ## @@ -173,51 +179,37 @@ class

[GitHub] [spark] HyukjinKwon commented on a change in pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

HyukjinKwon commented on a change in pull request #29057: URL: https://github.com/apache/spark/pull/29057#discussion_r452756207 ## File path: dev/run-tests.py ## @@ -595,13 +601,28 @@ def main(): changed_modules = None changed_files = None -if test_env ==

[GitHub] [spark] SparkQA commented on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

SparkQA commented on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656605355 **[Test build #125600 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125600/testReport)** for PR 29057 at commit

[GitHub] [spark] gengliangwang commented on a change in pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

gengliangwang commented on a change in pull request #29057: URL: https://github.com/apache/spark/pull/29057#discussion_r452770049 ## File path: core/src/test/scala/org/apache/spark/deploy/master/MasterSuite.scala ## @@ -685,7 +685,8 @@ class MasterSuite extends SparkFunSuite

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28904: [SPARK-30462][SS] Streamline the logic on file stream source and sink metadata log to avoid memory issue

AmplabJenkins removed a comment on pull request #28904: URL: https://github.com/apache/spark/pull/28904#issuecomment-656626272 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29064: [SPARK-32272][SQL] Add and extend SQL standard command SET TIME ZONE

AmplabJenkins removed a comment on pull request #29064: URL: https://github.com/apache/spark/pull/29064#issuecomment-656626285 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28967: [SPARK-32149][SHUFFLE] Improve file path name normalisation at block resolution within the external shuffle service

AmplabJenkins removed a comment on pull request #28967: URL: https://github.com/apache/spark/pull/28967#issuecomment-656636556 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29059: [SPARK-32256][SQL][test-hadoop2.7] Force to initialize Hadoop VersionInfo in HiveExternalCatalog

AmplabJenkins commented on pull request #29059: URL: https://github.com/apache/spark/pull/29059#issuecomment-656637125 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29059: [SPARK-32256][SQL][test-hadoop2.7] Force to initialize Hadoop VersionInfo in HiveExternalCatalog

AmplabJenkins removed a comment on pull request #29059: URL: https://github.com/apache/spark/pull/29059#issuecomment-656637125 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] manuzhang commented on pull request #28954: [SPARK-32083][SQL] Apply CoalesceShufflePartitions when input RDD has 0 partitions with AQE

manuzhang commented on pull request #28954: URL: https://github.com/apache/spark/pull/28954#issuecomment-656637276 @cloud-fan I find an issue with updating metrics if I convert a `LogicalQueryStage` to `LocalRelation` when its child's `mapStats` is empty. ```

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28967: [SPARK-32149][SHUFFLE] Improve file path name normalisation at block resolution within the external shuffle service

AmplabJenkins removed a comment on pull request #28967: URL: https://github.com/apache/spark/pull/28967#issuecomment-656636561 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

AmplabJenkins commented on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-656501286 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

AmplabJenkins removed a comment on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-656501286 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] HyukjinKwon commented on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

HyukjinKwon commented on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-656501412 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] SparkQA commented on pull request #28977: [WIP] Add all hive.execution suite in the parallel test group

SparkQA commented on pull request #28977: URL: https://github.com/apache/spark/pull/28977#issuecomment-656510697 **[Test build #125548 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125548/testReport)** for PR 28977 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28977: [WIP] Add all hive.execution suite in the parallel test group

SparkQA removed a comment on pull request #28977: URL: https://github.com/apache/spark/pull/28977#issuecomment-656463331 **[Test build #125548 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125548/testReport)** for PR 28977 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #27983: [SPARK-32105][SQL]Refactor current ScriptTransformationExec code

AmplabJenkins commented on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-656512529 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

SparkQA commented on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-656512881 **[Test build #125543 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125543/testReport)** for PR 28998 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29034: [SPARK-32219][SQL] Add SHOW CACHED TABLES Command

AmplabJenkins removed a comment on pull request #29034: URL: https://github.com/apache/spark/pull/29034#issuecomment-656513688 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28977: [WIP] Add all hive.execution suite in the parallel test group

AmplabJenkins removed a comment on pull request #28977: URL: https://github.com/apache/spark/pull/28977#issuecomment-656511775 Test FAILed. Refer to this link for build results (access rights to CI server needed):

<    1   2   3   4   5   6   7   8   9   10   >