[GitHub] [spark] SparkQA removed a comment on pull request #28979: [SPARK-32154][SQL] Use ExpressionEncoder for the return type of ScalaUDF to convert to catalyst type

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #28979: URL: https://github.com/apache/spark/pull/28979#issuecomment-655818734 **[Test build #125423 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125423/testReport)** for PR 28979 at commit

[GitHub] [spark] SparkQA commented on pull request #28979: [SPARK-32154][SQL] Use ExpressionEncoder for the return type of ScalaUDF to convert to catalyst type

2020-07-08 Thread GitBox
SparkQA commented on pull request #28979: URL: https://github.com/apache/spark/pull/28979#issuecomment-655918547 **[Test build #125423 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125423/testReport)** for PR 28979 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655918148 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] Ngone51 commented on pull request #28911: [SPARK-32077][CORE] Support host-local shuffle data reading when external shuffle service is disabled

2020-07-08 Thread GitBox
Ngone51 commented on pull request #28911: URL: https://github.com/apache/spark/pull/28911#issuecomment-655918176 Jenkins, retest this please. This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] AmplabJenkins commented on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655918148 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655791996 **[Test build #125403 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125403/testReport)** for PR 28975 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655856334 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

2020-07-08 Thread GitBox
SparkQA commented on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655917157 **[Test build #125403 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125403/testReport)** for PR 28975 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29031: [SPARK-32216][SQL] Remove redundant ProjectExec

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29031: URL: https://github.com/apache/spark/pull/29031#issuecomment-655915736 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29031: [SPARK-32216][SQL] Remove redundant ProjectExec

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29031: URL: https://github.com/apache/spark/pull/29031#issuecomment-655915736 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29031: [SPARK-32216][SQL] Remove redundant ProjectExec

2020-07-08 Thread GitBox
SparkQA commented on pull request #29031: URL: https://github.com/apache/spark/pull/29031#issuecomment-655915346 **[Test build #125436 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125436/testReport)** for PR 29031 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29031: [SPARK-32216][SQL] Remove redundant ProjectExec

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29031: URL: https://github.com/apache/spark/pull/29031#issuecomment-655198271 Can one of the admins verify this patch? This is an automated message from the Apache Git

[GitHub] [spark] gatorsmile commented on pull request #29031: [SPARK-32216][SQL] Remove redundant ProjectExec

2020-07-08 Thread GitBox
gatorsmile commented on pull request #29031: URL: https://github.com/apache/spark/pull/29031#issuecomment-655913481 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27428: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #27428: URL: https://github.com/apache/spark/pull/27428#issuecomment-655912463 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27428: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #27428: URL: https://github.com/apache/spark/pull/27428#issuecomment-655912458 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #27428: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #27428: URL: https://github.com/apache/spark/pull/27428#issuecomment-655912458 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #27428: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #27428: URL: https://github.com/apache/spark/pull/27428#issuecomment-655885393 **[Test build #125433 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125433/testReport)** for PR 27428 at commit

[GitHub] [spark] SparkQA commented on pull request #27428: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

2020-07-08 Thread GitBox
SparkQA commented on pull request #27428: URL: https://github.com/apache/spark/pull/27428#issuecomment-655912251 **[Test build #125433 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125433/testReport)** for PR 27428 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-655911295 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-655911289 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-655911289 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-655865673 **[Test build #125430 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125430/testReport)** for PR 28969 at commit

[GitHub] [spark] SparkQA commented on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

2020-07-08 Thread GitBox
SparkQA commented on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-655910768 **[Test build #125430 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125430/testReport)** for PR 28969 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-655909144 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-655909144 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

2020-07-08 Thread GitBox
SparkQA commented on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-655908793 **[Test build #125435 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125435/testReport)** for PR 29022 at commit

[GitHub] [spark] yaooqinn commented on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

2020-07-08 Thread GitBox
yaooqinn commented on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-655908460 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29049: [SPARK-32236][CORE] Local cluster should shutdown gracefully

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29049: URL: https://github.com/apache/spark/pull/29049#issuecomment-655907932 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29049: [SPARK-32236][CORE] Local cluster should shutdown gracefully

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29049: URL: https://github.com/apache/spark/pull/29049#issuecomment-655907926 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29049: [SPARK-32236][CORE] Local cluster should shutdown gracefully

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29049: URL: https://github.com/apache/spark/pull/29049#issuecomment-655907926 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #29049: [SPARK-32236][CORE] Local cluster should shutdown gracefully

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #29049: URL: https://github.com/apache/spark/pull/29049#issuecomment-655865303 **[Test build #125429 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125429/testReport)** for PR 29049 at commit

[GitHub] [spark] SparkQA commented on pull request #29049: [SPARK-32236][CORE] Local cluster should shutdown gracefully

2020-07-08 Thread GitBox
SparkQA commented on pull request #29049: URL: https://github.com/apache/spark/pull/29049#issuecomment-655907471 **[Test build #125429 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125429/testReport)** for PR 29049 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-655902919 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28983: [SPARK-32159][SQL] Fix integration between Aggregator[Array[_], _, _] and UnresolvedMapObjects

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28983: URL: https://github.com/apache/spark/pull/28983#issuecomment-655902963 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28983: [SPARK-32159][SQL] Fix integration between Aggregator[Array[_], _, _] and UnresolvedMapObjects

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #28983: URL: https://github.com/apache/spark/pull/28983#issuecomment-655902963 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-655902919 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28983: [SPARK-32159][SQL] Fix integration between Aggregator[Array[_], _, _] and UnresolvedMapObjects

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #28983: URL: https://github.com/apache/spark/pull/28983#issuecomment-655756730 **[Test build #125397 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125397/testReport)** for PR 28983 at commit

[GitHub] [spark] SparkQA commented on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

2020-07-08 Thread GitBox
SparkQA commented on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-655902143 **[Test build #125434 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125434/testReport)** for PR 28998 at commit

[GitHub] [spark] SparkQA commented on pull request #28983: [SPARK-32159][SQL] Fix integration between Aggregator[Array[_], _, _] and UnresolvedMapObjects

2020-07-08 Thread GitBox
SparkQA commented on pull request #28983: URL: https://github.com/apache/spark/pull/28983#issuecomment-655901600 **[Test build #125397 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125397/testReport)** for PR 28983 at commit

[GitHub] [spark] MaxGekk commented on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

2020-07-08 Thread GitBox
MaxGekk commented on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-655900503 jenkins, retest this, please This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-655894045 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-655894039 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-655854837 **[Test build #125425 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125425/testReport)** for PR 29022 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-655894039 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

2020-07-08 Thread GitBox
SparkQA commented on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-655893868 **[Test build #125425 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125425/testReport)** for PR 29022 at commit

[GitHub] [spark] WinkerDu commented on pull request #29000: [SPARK-27194][SPARK-29302][SQL] Fix commit collision in dynamic partition overwrite mode

2020-07-08 Thread GitBox
WinkerDu commented on pull request #29000: URL: https://github.com/apache/spark/pull/29000#issuecomment-655893223 Thanks for your reply @turboFei Gentle ping @dongjoon-hyun @cloud-fan @xuanyuanking to review this pr, thank you

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655889485 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655889485 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] WinkerDu closed pull request #26971: [SPARK-30320][SQL] Fix insert overwrite to DataSource table with dynamic partition error

2020-07-08 Thread GitBox
WinkerDu closed pull request #26971: URL: https://github.com/apache/spark/pull/26971 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [spark] SparkQA removed a comment on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655812807 **[Test build #125415 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125415/testReport)** for PR 28986 at commit

[GitHub] [spark] SaurabhChawla100 commented on pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-08 Thread GitBox
SaurabhChawla100 commented on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-655888981 > Thank you for your contribution, @SaurabhChawla100 . > In order to prevent the future regression, could you make a UT with your example, please? Sure I will

[GitHub] [spark] SparkQA commented on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

2020-07-08 Thread GitBox
SparkQA commented on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655888775 **[Test build #125415 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125415/testReport)** for PR 28986 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27428: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #27428: URL: https://github.com/apache/spark/pull/27428#issuecomment-655885619 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #27428: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #27428: URL: https://github.com/apache/spark/pull/27428#issuecomment-655885619 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #27428: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

2020-07-08 Thread GitBox
SparkQA commented on pull request #27428: URL: https://github.com/apache/spark/pull/27428#issuecomment-655885393 **[Test build #125433 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125433/testReport)** for PR 27428 at commit

[GitHub] [spark] beliefer commented on pull request #27428: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

2020-07-08 Thread GitBox
beliefer commented on pull request #27428: URL: https://github.com/apache/spark/pull/27428#issuecomment-655884784 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] beliefer commented on a change in pull request #27428: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

2020-07-08 Thread GitBox
beliefer commented on a change in pull request #27428: URL: https://github.com/apache/spark/pull/27428#discussion_r451948803 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/RewriteDistinctAggregates.scala ## @@ -118,7 +118,75 @@ import

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28926: [SPARK-32133][SQL] Forbid time field steps for date start/end in Sequence

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28926: URL: https://github.com/apache/spark/pull/28926#issuecomment-655881034 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28926: [SPARK-32133][SQL] Forbid time field steps for date start/end in Sequence

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28926: URL: https://github.com/apache/spark/pull/28926#issuecomment-655881031 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28926: [SPARK-32133][SQL] Forbid time field steps for date start/end in Sequence

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #28926: URL: https://github.com/apache/spark/pull/28926#issuecomment-655881031 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] LuciferYang commented on a change in pull request #29037: [SPARK-32224][CORE] Add a simpler way to pass 'spark.yarn.priority' through the SparkSubmit

2020-07-08 Thread GitBox
LuciferYang commented on a change in pull request #29037: URL: https://github.com/apache/spark/pull/29037#discussion_r451946296 ## File path: core/src/main/scala/org/apache/spark/deploy/SparkSubmitArguments.scala ## @@ -562,6 +570,7 @@ private[deploy] class

[GitHub] [spark] SparkQA commented on pull request #28926: [SPARK-32133][SQL] Forbid time field steps for date start/end in Sequence

2020-07-08 Thread GitBox
SparkQA commented on pull request #28926: URL: https://github.com/apache/spark/pull/28926#issuecomment-655880534 **[Test build #125419 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125419/testReport)** for PR 28926 at commit

[GitHub] [spark] LuciferYang commented on a change in pull request #29037: [SPARK-32224][CORE] Add a simpler way to pass 'spark.yarn.priority' through the SparkSubmit

2020-07-08 Thread GitBox
LuciferYang commented on a change in pull request #29037: URL: https://github.com/apache/spark/pull/29037#discussion_r451946296 ## File path: core/src/main/scala/org/apache/spark/deploy/SparkSubmitArguments.scala ## @@ -562,6 +570,7 @@ private[deploy] class

[GitHub] [spark] SparkQA removed a comment on pull request #28926: [SPARK-32133][SQL] Forbid time field steps for date start/end in Sequence

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #28926: URL: https://github.com/apache/spark/pull/28926#issuecomment-655816718 **[Test build #125419 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125419/testReport)** for PR 28926 at commit

[GitHub] [spark] LuciferYang closed pull request #29037: [SPARK-32224][CORE] Add a simpler way to pass 'spark.yarn.priority' through the SparkSubmit

2020-07-08 Thread GitBox
LuciferYang closed pull request #29037: URL: https://github.com/apache/spark/pull/29037 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29047: [SPARK-32024][WEBUI][FOLLOWUP][3.0] Quick fix on test failure on missing when statements

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29047: URL: https://github.com/apache/spark/pull/29047#issuecomment-655878813 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29047: [SPARK-32024][WEBUI][FOLLOWUP][3.0] Quick fix on test failure on missing when statements

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29047: URL: https://github.com/apache/spark/pull/29047#issuecomment-655878800 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29047: [SPARK-32024][WEBUI][FOLLOWUP][3.0] Quick fix on test failure on missing when statements

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29047: URL: https://github.com/apache/spark/pull/29047#issuecomment-655878800 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #29047: [SPARK-32024][WEBUI][FOLLOWUP][3.0] Quick fix on test failure on missing when statements

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #29047: URL: https://github.com/apache/spark/pull/29047#issuecomment-655810840 **[Test build #125414 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125414/testReport)** for PR 29047 at commit

[GitHub] [spark] SparkQA commented on pull request #29047: [SPARK-32024][WEBUI][FOLLOWUP][3.0] Quick fix on test failure on missing when statements

2020-07-08 Thread GitBox
SparkQA commented on pull request #29047: URL: https://github.com/apache/spark/pull/29047#issuecomment-655878113 **[Test build #125414 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125414/testReport)** for PR 29047 at commit

[GitHub] [spark] LuciferYang edited a comment on pull request #29037: [SPARK-32224][CORE] Add a simpler way to pass 'spark.yarn.priority' through the SparkSubmit

2020-07-08 Thread GitBox
LuciferYang edited a comment on pull request #29037: URL: https://github.com/apache/spark/pull/29037#issuecomment-655874942 @dongjoon-hyun, Got it ~, `-- priority` is very popular with users like `--queue` in our production environment, although use `--conf spark.yarn.priority` can

[GitHub] [spark] LuciferYang commented on pull request #29037: [SPARK-32224][CORE] Add a simpler way to pass 'spark.yarn.priority' through the SparkSubmit

2020-07-08 Thread GitBox
LuciferYang commented on pull request #29037: URL: https://github.com/apache/spark/pull/29037#issuecomment-655874942 @dongjoon-hyun, Got it ~, `-- priority` is very popular with users like `--queue` in our production environment, although use '-- conf spark.yarn.priority` can achieve

[GitHub] [spark] LuciferYang commented on a change in pull request #29037: [SPARK-32224][CORE] Add a simpler way to pass 'spark.yarn.priority' through the SparkSubmit

2020-07-08 Thread GitBox
LuciferYang commented on a change in pull request #29037: URL: https://github.com/apache/spark/pull/29037#discussion_r451937882 ## File path: core/src/main/scala/org/apache/spark/deploy/SparkSubmitArguments.scala ## @@ -562,6 +570,7 @@ private[deploy] class

[GitHub] [spark] srowen commented on a change in pull request #29037: [SPARK-32224][CORE] Add a simpler way to pass 'spark.yarn.priority' through the SparkSubmit

2020-07-08 Thread GitBox
srowen commented on a change in pull request #29037: URL: https://github.com/apache/spark/pull/29037#discussion_r451939730 ## File path: core/src/main/scala/org/apache/spark/deploy/SparkSubmitArguments.scala ## @@ -562,6 +570,7 @@ private[deploy] class

[GitHub] [spark] leoluan2009 commented on pull request #28991: [SPARK-26533][SQL][test-hive1.2][test-hadoop2.7] Support query auto timeout cancel on thriftserver

2020-07-08 Thread GitBox
leoluan2009 commented on pull request #28991: URL: https://github.com/apache/spark/pull/28991#issuecomment-655871326 ok, I will make another PR to support global config for timeout @maropu @wangyum @juliuszsompolski thanks for your review!

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29041: [SPARK-20680][SQL][FOLLOW-UP] Revert NullType.simpleString from 'unknown' to 'null'

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29041: URL: https://github.com/apache/spark/pull/29041#issuecomment-655870378 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29041: [SPARK-20680][SQL][FOLLOW-UP] Revert NullType.simpleString from 'unknown' to 'null'

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29041: URL: https://github.com/apache/spark/pull/29041#issuecomment-655870378 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29041: [SPARK-20680][SQL][FOLLOW-UP] Revert NullType.simpleString from 'unknown' to 'null'

2020-07-08 Thread GitBox
SparkQA commented on pull request #29041: URL: https://github.com/apache/spark/pull/29041#issuecomment-655870033 **[Test build #125432 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125432/testReport)** for PR 29041 at commit

[GitHub] [spark] LuciferYang commented on a change in pull request #29037: [SPARK-32224][CORE] Support pass 'spark.yarn.priority' through the SparkSubmit

2020-07-08 Thread GitBox
LuciferYang commented on a change in pull request #29037: URL: https://github.com/apache/spark/pull/29037#discussion_r451937882 ## File path: core/src/main/scala/org/apache/spark/deploy/SparkSubmitArguments.scala ## @@ -562,6 +570,7 @@ private[deploy] class

[GitHub] [spark] sarutak commented on pull request #29049: [SPARK-32236][CORE] Local cluster should shutdown gracefully

2020-07-08 Thread GitBox
sarutak commented on pull request #29049: URL: https://github.com/apache/spark/pull/29049#issuecomment-655868059 Even applying this change, like the following warn message can be shown but it happens even with standalone cluster mode so it should be a separate issue. ``` 20/07/09

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29041: [SPARK-20680][SQL][FOLLOW-UP] Revert NullType.simpleString from 'unknown' to 'null'

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29041: URL: https://github.com/apache/spark/pull/29041#issuecomment-655866997 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29041: [SPARK-20680][SQL][FOLLOW-UP] Revert NullType.simpleString from 'unknown' to 'null'

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29041: URL: https://github.com/apache/spark/pull/29041#issuecomment-655866989 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29041: [SPARK-20680][SQL][FOLLOW-UP] Revert NullType.simpleString from 'unknown' to 'null'

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29041: URL: https://github.com/apache/spark/pull/29041#issuecomment-655866989 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29009: [SPARK-32193][DOCS] Update regexp usage in docs

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29009: URL: https://github.com/apache/spark/pull/29009#issuecomment-655866811 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #29009: [SPARK-32193][DOCS] Update regexp usage in docs

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #29009: URL: https://github.com/apache/spark/pull/29009#issuecomment-655863107 **[Test build #125427 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125427/testReport)** for PR 29009 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29009: [SPARK-32193][DOCS] Update regexp usage in docs

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29009: URL: https://github.com/apache/spark/pull/29009#issuecomment-655866811 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #29009: [SPARK-32193][DOCS] Update regexp usage in docs

2020-07-08 Thread GitBox
SparkQA commented on pull request #29009: URL: https://github.com/apache/spark/pull/29009#issuecomment-655866686 **[Test build #125427 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125427/testReport)** for PR 29009 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29041: [SPARK-20680][SQL][FOLLOW-UP] Revert NullType.simpleString from 'unknown' to 'null'

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #29041: URL: https://github.com/apache/spark/pull/29041#issuecomment-655753134 **[Test build #125395 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125395/testReport)** for PR 29041 at commit

[GitHub] [spark] SparkQA commented on pull request #29041: [SPARK-20680][SQL][FOLLOW-UP] Revert NullType.simpleString from 'unknown' to 'null'

2020-07-08 Thread GitBox
SparkQA commented on pull request #29041: URL: https://github.com/apache/spark/pull/29041#issuecomment-655866323 **[Test build #125395 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125395/testReport)** for PR 29041 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29049: [SPARK-32236][CORE] Local cluster should shutdown gracefully

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29049: URL: https://github.com/apache/spark/pull/29049#issuecomment-655865794 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-655864333 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

2020-07-08 Thread GitBox
SparkQA commented on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-655865673 **[Test build #125430 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125430/testReport)** for PR 28969 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29049: [SPARK-32236][CORE] Local cluster should shutdown gracefully

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29049: URL: https://github.com/apache/spark/pull/29049#issuecomment-655865794 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-655865665 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] turboFei commented on pull request #28989: [SPARK-27194][SPARK-29302][SQL] Define a spark staging committer to resolve FileAlreadyExistingException

2020-07-08 Thread GitBox
turboFei commented on pull request #28989: URL: https://github.com/apache/spark/pull/28989#issuecomment-655865529 close this, I am wrong about that, I thought the taskAttemptContext.getTaskAttemptId.getId is same with the taskAttemptId of spark and it would at most create several(the

[GitHub] [spark] turboFei closed pull request #28989: [SPARK-27194][SPARK-29302][SQL] Define a spark staging committer to resolve FileAlreadyExistingException

2020-07-08 Thread GitBox
turboFei closed pull request #28989: URL: https://github.com/apache/spark/pull/28989 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [spark] SparkQA commented on pull request #29049: [SPARK-32236][CORE] Local cluster should shutdown gracefully

2020-07-08 Thread GitBox
SparkQA commented on pull request #29049: URL: https://github.com/apache/spark/pull/29049#issuecomment-655865303 **[Test build #125429 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125429/testReport)** for PR 29049 at commit

[GitHub] [spark] turboFei commented on pull request #29000: [SPARK-27194][SPARK-29302][SQL] Fix commit collision in dynamic partition overwrite mode

2020-07-08 Thread GitBox
turboFei commented on pull request #29000: URL: https://github.com/apache/spark/pull/29000#issuecomment-655865186 Thanks for your reply @WinkerDu I am wrong about that, In #28989 I thought the taskAttemptContext.getTaskAttemptId.getId is same with the taskAttemptId of spark and it

[GitHub] [spark] SparkQA commented on pull request #27983: [SPARK-32105][SQL]Refactor current ScriptTransformationExec code

2020-07-08 Thread GitBox
SparkQA commented on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-655865341 **[Test build #125431 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125431/testReport)** for PR 27983 at commit

[GitHub] [spark] sarutak opened a new pull request #29049: [SPARK-32236][CORE] Local cluster should shutdown gracefully

2020-07-08 Thread GitBox
sarutak opened a new pull request #29049: URL: https://github.com/apache/spark/pull/29049 ### What changes were proposed in this pull request? This PR introduced a new internal configuration property `spark.localCluster.shutdown.wait.timeoutMs` to shutdown local cluster gracefully.

  1   2   3   4   5   6   7   8   9   10   >