[GitHub] [spark] dongjoon-hyun commented on a change in pull request #29037: [SPARK-32224][CORE] Support pass 'spark.yarn.priority' through the SparkSubmit

dongjoon-hyun commented on a change in pull request #29037: URL: https://github.com/apache/spark/pull/29037#discussion_r451648303 ## File path: core/src/main/scala/org/apache/spark/deploy/SparkSubmitArguments.scala ## @@ -562,6 +570,7 @@ private[deploy] class

[GitHub] [spark] SparkQA removed a comment on pull request #29036: [WIP][SPARK-XXXXX][SQL] CliSuite flakiness fix via differentiating cli driver bootup timeout and query execution timeout

SparkQA removed a comment on pull request #29036: URL: https://github.com/apache/spark/pull/29036#issuecomment-655442012 **[Test build #125347 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125347/testReport)** for PR 29036 at commit

[GitHub] [spark] SparkQA commented on pull request #29036: [WIP][SPARK-XXXXX][SQL] CliSuite flakiness fix via differentiating cli driver bootup timeout and query execution timeout

SparkQA commented on pull request #29036: URL: https://github.com/apache/spark/pull/29036#issuecomment-655602920 **[Test build #125347 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125347/testReport)** for PR 29036 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28953: [SPARK-32013][SQL] Support query execution before/after reading/writing DataFrame over JDBC

AmplabJenkins removed a comment on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-655602102 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] viirya commented on pull request #28993: [SPARK-32168][SQL] Fix hidden partitioning correctness bug in SQL overwrite

viirya commented on pull request #28993: URL: https://github.com/apache/spark/pull/28993#issuecomment-655602322 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins commented on pull request #28953: [SPARK-32013][SQL] Support query execution before/after reading/writing DataFrame over JDBC

AmplabJenkins commented on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-655602102 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29026: [SPARK-28067][SPARK-32018] Fix decimal overflow issues

AmplabJenkins removed a comment on pull request #29026: URL: https://github.com/apache/spark/pull/29026#issuecomment-655601588 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28993: [SPARK-32168][SQL] Fix hidden partitioning correctness bug in SQL overwrite

AmplabJenkins removed a comment on pull request #28993: URL: https://github.com/apache/spark/pull/28993#issuecomment-655601071 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] TJX2014 opened a new pull request #29043: [SPARK-32205][SQL] Writing timestamp to mysql should be datetime type

TJX2014 opened a new pull request #29043: URL: https://github.com/apache/spark/pull/29043 ### What changes were proposed in this pull request? 1. Change timestamp to mysql to datetime in `org.apache.spark.sql.jdbc.MySQLDialect#getJDBCType` 2. Add UT in

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29037: [SPARK-32224][CORE] Support pass 'spark.yarn.priority' through the SparkSubmit

AmplabJenkins removed a comment on pull request #29037: URL: https://github.com/apache/spark/pull/29037#issuecomment-655380183 Can one of the admins verify this patch? This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28993: [SPARK-32168][SQL] Fix hidden partitioning correctness bug in SQL overwrite

AmplabJenkins removed a comment on pull request #28993: URL: https://github.com/apache/spark/pull/28993#issuecomment-655601063 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29026: [SPARK-28067][SPARK-32018] Fix decimal overflow issues

AmplabJenkins commented on pull request #29026: URL: https://github.com/apache/spark/pull/29026#issuecomment-655601588 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] dongjoon-hyun commented on pull request #29037: [SPARK-32224][CORE] Support pass 'spark.yarn.priority' through the SparkSubmit

dongjoon-hyun commented on pull request #29037: URL: https://github.com/apache/spark/pull/29037#issuecomment-655601380 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28993: [SPARK-32168][SQL] Fix hidden partitioning correctness bug in SQL overwrite

AmplabJenkins commented on pull request #28993: URL: https://github.com/apache/spark/pull/28993#issuecomment-655601063 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28993: [SPARK-32168][SQL] Fix hidden partitioning correctness bug in SQL overwrite

SparkQA removed a comment on pull request #28993: URL: https://github.com/apache/spark/pull/28993#issuecomment-655545021 **[Test build #125369 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125369/testReport)** for PR 28993 at commit

[GitHub] [spark] SparkQA commented on pull request #28993: [SPARK-32168][SQL] Fix hidden partitioning correctness bug in SQL overwrite

SparkQA commented on pull request #28993: URL: https://github.com/apache/spark/pull/28993#issuecomment-655599880 **[Test build #125369 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125369/testReport)** for PR 28993 at commit

[GitHub] [spark] planga82 commented on pull request #28896: [SPARK-32025][SQL] Csv schema inference problems with different types in the same column

planga82 commented on pull request #28896: URL: https://github.com/apache/spark/pull/28896#issuecomment-655595401 Thanks @huaxingao If you can't do it for any reason tell me. This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28972: [SPARK-30794][CORE] Stage Level scheduling: Add ability to set off heap memory

AmplabJenkins removed a comment on pull request #28972: URL: https://github.com/apache/spark/pull/28972#issuecomment-655593013 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28972: [SPARK-30794][CORE] Stage Level scheduling: Add ability to set off heap memory

SparkQA commented on pull request #28972: URL: https://github.com/apache/spark/pull/28972#issuecomment-655593377 **[Test build #125380 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125380/testReport)** for PR 28972 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28972: [SPARK-30794][CORE] Stage Level scheduling: Add ability to set off heap memory

AmplabJenkins commented on pull request #28972: URL: https://github.com/apache/spark/pull/28972#issuecomment-655593013 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] cloud-fan commented on a change in pull request #27428: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

cloud-fan commented on a change in pull request #27428: URL: https://github.com/apache/spark/pull/27428#discussion_r451635926 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/RewriteDistinctAggregates.scala ## @@ -118,7 +118,75 @@ import

[GitHub] [spark] cloud-fan commented on a change in pull request #27428: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

cloud-fan commented on a change in pull request #27428: URL: https://github.com/apache/spark/pull/27428#discussion_r451635560 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/RewriteDistinctAggregates.scala ## @@ -118,7 +118,75 @@ import

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #28931: [SPARK-32103][YARN] Handle IPv6 host/port split in YarnRMClient

dongjoon-hyun commented on a change in pull request #28931: URL: https://github.com/apache/spark/pull/28931#discussion_r451635049 ## File path: core/src/test/scala/org/apache/spark/util/UtilsSuite.scala ## @@ -1309,6 +1309,97 @@ class UtilsSuite extends SparkFunSuite with

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #28931: [SPARK-32103][YARN] Handle IPv6 host/port split in YarnRMClient

dongjoon-hyun commented on a change in pull request #28931: URL: https://github.com/apache/spark/pull/28931#discussion_r451634654 ## File path: core/src/test/scala/org/apache/spark/util/UtilsSuite.scala ## @@ -1309,6 +1309,97 @@ class UtilsSuite extends SparkFunSuite with

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #28931: [SPARK-32103][YARN] Handle IPv6 host/port split in YarnRMClient

dongjoon-hyun commented on a change in pull request #28931: URL: https://github.com/apache/spark/pull/28931#discussion_r451633470 ## File path: core/src/test/scala/org/apache/spark/util/UtilsSuite.scala ## @@ -1309,6 +1309,97 @@ class UtilsSuite extends SparkFunSuite with

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #28931: [SPARK-32103][YARN] Handle IPv6 host/port split in YarnRMClient

dongjoon-hyun commented on a change in pull request #28931: URL: https://github.com/apache/spark/pull/28931#discussion_r451632013 ## File path: core/src/main/scala/org/apache/spark/util/Utils.scala ## @@ -1046,18 +1055,30 @@ private[spark] object Utils extends Logging {

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28931: [SPARK-32103][YARN] Handle IPv6 host/port split in YarnRMClient

AmplabJenkins removed a comment on pull request #28931: URL: https://github.com/apache/spark/pull/28931#issuecomment-655588411 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] cloud-fan commented on a change in pull request #27428: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

cloud-fan commented on a change in pull request #27428: URL: https://github.com/apache/spark/pull/27428#discussion_r451630462 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/RewriteDistinctAggregates.scala ## @@ -118,7 +118,75 @@ import

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #28931: [SPARK-32103][YARN] Handle IPv6 host/port split in YarnRMClient

dongjoon-hyun commented on a change in pull request #28931: URL: https://github.com/apache/spark/pull/28931#discussion_r451631122 ## File path: core/src/main/scala/org/apache/spark/util/Utils.scala ## @@ -1027,12 +1027,21 @@ private[spark] object Utils extends Logging { }

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29042: [SPARK-32231][R][INFRA] Use Hadoop 3 winutils in AppVeyor build

AmplabJenkins removed a comment on pull request #29042: URL: https://github.com/apache/spark/pull/29042#issuecomment-655588147 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #28931: [SPARK-32103][YARN] Handle IPv6 host/port split in YarnRMClient

AmplabJenkins commented on pull request #28931: URL: https://github.com/apache/spark/pull/28931#issuecomment-655588411 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29042: [SPARK-32231][R][INFRA] Use Hadoop 3 winutils in AppVeyor build

AmplabJenkins removed a comment on pull request #29042: URL: https://github.com/apache/spark/pull/29042#issuecomment-655588139 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] cloud-fan commented on a change in pull request #27428: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

cloud-fan commented on a change in pull request #27428: URL: https://github.com/apache/spark/pull/27428#discussion_r451629863 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/RewriteDistinctAggregates.scala ## @@ -118,7 +118,75 @@ import

[GitHub] [spark] SparkQA removed a comment on pull request #29042: [SPARK-32231][R][INFRA] Use Hadoop 3 winutils in AppVeyor build

SparkQA removed a comment on pull request #29042: URL: https://github.com/apache/spark/pull/29042#issuecomment-655574458 **[Test build #125378 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125378/testReport)** for PR 29042 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29042: [SPARK-32231][R][INFRA] Use Hadoop 3 winutils in AppVeyor build

AmplabJenkins commented on pull request #29042: URL: https://github.com/apache/spark/pull/29042#issuecomment-655588139 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29042: [SPARK-32231][R][INFRA] Use Hadoop 3 winutils in AppVeyor build

SparkQA commented on pull request #29042: URL: https://github.com/apache/spark/pull/29042#issuecomment-655587989 **[Test build #125378 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125378/testReport)** for PR 29042 at commit

[GitHub] [spark] SparkQA commented on pull request #28931: [SPARK-32103][YARN] Handle IPv6 host/port split in YarnRMClient

SparkQA commented on pull request #28931: URL: https://github.com/apache/spark/pull/28931#issuecomment-655587771 **[Test build #125379 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125379/testReport)** for PR 28931 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #25290: [SPARK-28551][SQL]Add a Checker Rule when CTAS SQL with LOCATION

AmplabJenkins removed a comment on pull request #25290: URL: https://github.com/apache/spark/pull/25290#issuecomment-655585475 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] dongjoon-hyun commented on pull request #28931: [SPARK-32103][YARN] Handle IPv6 host/port split in YarnRMClient

dongjoon-hyun commented on pull request #28931: URL: https://github.com/apache/spark/pull/28931#issuecomment-655585627 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] dongjoon-hyun commented on pull request #28931: [SPARK-32103][YARN] Handle IPv6 host/port split in YarnRMClient

dongjoon-hyun commented on pull request #28931: URL: https://github.com/apache/spark/pull/28931#issuecomment-655585975 cc @dbtsai This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins removed a comment on pull request #25290: [SPARK-28551][SQL]Add a Checker Rule when CTAS SQL with LOCATION

AmplabJenkins removed a comment on pull request #25290: URL: https://github.com/apache/spark/pull/25290#issuecomment-655585461 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #25290: [SPARK-28551][SQL]Add a Checker Rule when CTAS SQL with LOCATION

AmplabJenkins commented on pull request #25290: URL: https://github.com/apache/spark/pull/25290#issuecomment-655585461 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] cloud-fan commented on a change in pull request #27428: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

cloud-fan commented on a change in pull request #27428: URL: https://github.com/apache/spark/pull/27428#discussion_r451624190 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/RewriteDistinctAggregates.scala ## @@ -118,7 +118,75 @@ import

[GitHub] [spark] gaborgsomogyi commented on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

gaborgsomogyi commented on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655581970 I'm also suffering from flaky executions, hope this round will pass. This is an automated message from

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

gaborgsomogyi commented on a change in pull request #28975: URL: https://github.com/apache/spark/pull/28975#discussion_r451617910 ## File path: sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamingJoinSuite.scala ## @@ -996,4 +997,47 @@ class

[GitHub] [spark] SparkQA removed a comment on pull request #25290: [SPARK-28551][SQL]Add a Checker Rule when CTAS SQL with LOCATION

SparkQA removed a comment on pull request #25290: URL: https://github.com/apache/spark/pull/25290#issuecomment-655340974 **[Test build #125326 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125326/testReport)** for PR 25290 at commit

[GitHub] [spark] huaxingao commented on pull request #28896: [SPARK-32025][SQL] Csv schema inference problems with different types in the same column

huaxingao commented on pull request #28896: URL: https://github.com/apache/spark/pull/28896#issuecomment-655580604 @gatorsmile I will take a look. This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] SparkQA commented on pull request #25290: [SPARK-28551][SQL]Add a Checker Rule when CTAS SQL with LOCATION

SparkQA commented on pull request #25290: URL: https://github.com/apache/spark/pull/25290#issuecomment-655580603 **[Test build #125326 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125326/testReport)** for PR 25290 at commit

[GitHub] [spark] HyukjinKwon edited a comment on pull request #29017: [WIP][SPARK-XXX][TESTS] Disable SBT unidoc generation testing in Jenkins

HyukjinKwon edited a comment on pull request #29017: URL: https://github.com/apache/spark/pull/29017#issuecomment-655579337 I will probably share some contexts later into dev mailing list once we have a clear picture on what we want. Currently we're checking the feasibility of Github

[GitHub] [spark] HyukjinKwon commented on pull request #29017: [WIP][SPARK-XXX][TESTS] Disable SBT unidoc generation testing in Jenkins

HyukjinKwon commented on pull request #29017: URL: https://github.com/apache/spark/pull/29017#issuecomment-655579337 I will probably share some contexts later. Currently we're checking the feasibility of Github Actions commercial plan. Separately, I'm personally working on the Github

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28931: [SPARK-32103][YARN] Handle IPv6 host/port split in YarnRMClient

AmplabJenkins removed a comment on pull request #28931: URL: https://github.com/apache/spark/pull/28931#issuecomment-655574978 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28931: [SPARK-32103][YARN] Handle IPv6 host/port split in YarnRMClient

AmplabJenkins removed a comment on pull request #28931: URL: https://github.com/apache/spark/pull/28931#issuecomment-655574967 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] dongjoon-hyun commented on pull request #29042: [SPARK-32231][R][INFRA] Use Hadoop 3 winutils in AppVeyor build

dongjoon-hyun commented on pull request #29042: URL: https://github.com/apache/spark/pull/29042#issuecomment-655575196 cc @steveloughran , too. This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] AmplabJenkins commented on pull request #28931: [SPARK-32103][YARN] Handle IPv6 host/port split in YarnRMClient

AmplabJenkins commented on pull request #28931: URL: https://github.com/apache/spark/pull/28931#issuecomment-655574967 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29042: [SPARK-32231][R][INFRA] Use Hadoop 3 winutils in AppVeyor build

AmplabJenkins removed a comment on pull request #29042: URL: https://github.com/apache/spark/pull/29042#issuecomment-655570764 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] dongjoon-hyun edited a comment on pull request #29042: [SPARK-32231][R][INFRA] Use Hadoop 3 winutils in AppVeyor build

dongjoon-hyun edited a comment on pull request #29042: URL: https://github.com/apache/spark/pull/29042#issuecomment-655574534 Thank you, @HyukjinKwon ! Let's see. This is an automated message from the Apache Git Service. To

[GitHub] [spark] dongjoon-hyun commented on pull request #29042: [SPARK-32231][R][INFRA] Use Hadoop 3 winutils in AppVeyor build

dongjoon-hyun commented on pull request #29042: URL: https://github.com/apache/spark/pull/29042#issuecomment-655574534 Thank you, @HyukjinKwon ! This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] SparkQA commented on pull request #29042: [SPARK-32231][R][INFRA] Use Hadoop 3 winutils in AppVeyor build

SparkQA commented on pull request #29042: URL: https://github.com/apache/spark/pull/29042#issuecomment-655574458 **[Test build #125378 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125378/testReport)** for PR 29042 at commit

[GitHub] [spark] HyukjinKwon commented on pull request #29038: [MINOR][INFRA][R] Show the installed packages in R in a prettier way

HyukjinKwon commented on pull request #29038: URL: https://github.com/apache/spark/pull/29038#issuecomment-655571497 Thanks @dongjoon-hyun. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins commented on pull request #29042: [SPARK-32231][R][INFRA] Use Hadoop 3 winutils in AppVeyor build

AmplabJenkins commented on pull request #29042: URL: https://github.com/apache/spark/pull/29042#issuecomment-655570764 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] TJX2014 commented on pull request #28882: [SPARK-31751][SQL]Serde property `path` overwrites hive table property location

TJX2014 commented on pull request #28882: URL: https://github.com/apache/spark/pull/28882#issuecomment-655570609 Seems we should consider `CREATE TABLE t USING json LOCATION ...` This is an automated message from the Apache

[GitHub] [spark] HyukjinKwon commented on pull request #29042: [SPARK-32231][R][INFRA] Use Hadoop 3 winutils in AppVeyor build

HyukjinKwon commented on pull request #29042: URL: https://github.com/apache/spark/pull/29042#issuecomment-655570523 cc @dongjoon-hyun FYI This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] HyukjinKwon commented on a change in pull request #29040: [SPARK-32230][R][INFRA] Use Hadoop 2.7 profile in AppVeyor SparkR build

HyukjinKwon commented on a change in pull request #29040: URL: https://github.com/apache/spark/pull/29040#discussion_r451608379 ## File path: appveyor.yml ## @@ -49,7 +49,7 @@ build_script: # '-Djna.nosys=true' is required to avoid kernel32.dll load failure. # See

[GitHub] [spark] HyukjinKwon opened a new pull request #29042: [SPARK-32231][R][INFRA] Use Hadoop 3 winutils in AppVeyor build

HyukjinKwon opened a new pull request #29042: URL: https://github.com/apache/spark/pull/29042 ### What changes were proposed in this pull request? This PR proposes to use Hadoop 3 winutils to make AppVeyor builds pass. Currently it's being failed as below

[GitHub] [spark] dongjoon-hyun commented on pull request #29030: [SPARK-32093][BUILD] Add hadoop-ozone-filesystem jar to ozone profile.

dongjoon-hyun commented on pull request #29030: URL: https://github.com/apache/spark/pull/29030#issuecomment-655568755 Gentle ping, @bharatviswa504 . This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] HyukjinKwon commented on a change in pull request #29040: [SPARK-32230][R][INFRA] Use Hadoop 2.7 profile in AppVeyor SparkR build

HyukjinKwon commented on a change in pull request #29040: URL: https://github.com/apache/spark/pull/29040#discussion_r451605178 ## File path: appveyor.yml ## @@ -49,7 +49,7 @@ build_script: # '-Djna.nosys=true' is required to avoid kernel32.dll load failure. # See

[GitHub] [spark] dongjoon-hyun closed pull request #29038: [MINOR][INFRA][R] Show the installed packages in R in a prettier way

dongjoon-hyun closed pull request #29038: URL: https://github.com/apache/spark/pull/29038 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28931: [SPARK-32103][YARN] Handle IPv6 host/port split in YarnRMClient

AmplabJenkins removed a comment on pull request #28931: URL: https://github.com/apache/spark/pull/28931#issuecomment-655566387 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29039: [WIP][SPARK-XXXXX] HiveSessionImplSuite flakiness fix via mocking instances earlier than initializing HiveSessionImpl

AmplabJenkins removed a comment on pull request #29039: URL: https://github.com/apache/spark/pull/29039#issuecomment-655565547 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #28931: [SPARK-32103][YARN] Handle IPv6 host/port split in YarnRMClient

AmplabJenkins commented on pull request #28931: URL: https://github.com/apache/spark/pull/28931#issuecomment-655566387 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29039: [WIP][SPARK-XXXXX] HiveSessionImplSuite flakiness fix via mocking instances earlier than initializing HiveSessionImpl

AmplabJenkins removed a comment on pull request #29039: URL: https://github.com/apache/spark/pull/29039#issuecomment-655565534 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29039: [WIP][SPARK-XXXXX] HiveSessionImplSuite flakiness fix via mocking instances earlier than initializing HiveSessionImpl

AmplabJenkins commented on pull request #29039: URL: https://github.com/apache/spark/pull/29039#issuecomment-655565534 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #29040: [SPARK-32230][R][INFRA] Use Hadoop 2.7 profile in AppVeyor SparkR build

dongjoon-hyun commented on a change in pull request #29040: URL: https://github.com/apache/spark/pull/29040#discussion_r451600551 ## File path: appveyor.yml ## @@ -49,7 +49,7 @@ build_script: # '-Djna.nosys=true' is required to avoid kernel32.dll load failure. # See

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #29040: [SPARK-32230][R][INFRA] Use Hadoop 2.7 profile in AppVeyor SparkR build

dongjoon-hyun commented on a change in pull request #29040: URL: https://github.com/apache/spark/pull/29040#discussion_r451600551 ## File path: appveyor.yml ## @@ -49,7 +49,7 @@ build_script: # '-Djna.nosys=true' is required to avoid kernel32.dll load failure. # See

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #29040: [SPARK-32230][R][INFRA] Use Hadoop 2.7 profile in AppVeyor SparkR build

dongjoon-hyun commented on a change in pull request #29040: URL: https://github.com/apache/spark/pull/29040#discussion_r451600551 ## File path: appveyor.yml ## @@ -49,7 +49,7 @@ build_script: # '-Djna.nosys=true' is required to avoid kernel32.dll load failure. # See

[GitHub] [spark] SparkQA removed a comment on pull request #29039: [WIP][SPARK-XXXXX] HiveSessionImplSuite flakiness fix via mocking instances earlier than initializing HiveSessionImpl

SparkQA removed a comment on pull request #29039: URL: https://github.com/apache/spark/pull/29039#issuecomment-655496732 **[Test build #125361 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125361/testReport)** for PR 29039 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

AmplabJenkins removed a comment on pull request #27366: URL: https://github.com/apache/spark/pull/27366#issuecomment-655562265 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #29039: [WIP][SPARK-XXXXX] HiveSessionImplSuite flakiness fix via mocking instances earlier than initializing HiveSessionImpl

SparkQA commented on pull request #29039: URL: https://github.com/apache/spark/pull/29039#issuecomment-655562756 **[Test build #125361 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125361/testReport)** for PR 29039 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

AmplabJenkins commented on pull request #27366: URL: https://github.com/apache/spark/pull/27366#issuecomment-655562265 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] dongjoon-hyun commented on pull request #29040: [SPARK-32230][R][INFRA] Use Hadoop 2.7 profile in AppVeyor SparkR build

dongjoon-hyun commented on pull request #29040: URL: https://github.com/apache/spark/pull/29040#issuecomment-68435 Oh. Thanks. This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins commented on pull request #29019: [2.4][SPARK-32167][SQL] Fix GetArrayStructFields to respect inner field's nullability together

AmplabJenkins commented on pull request #29019: URL: https://github.com/apache/spark/pull/29019#issuecomment-67924 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29019: [2.4][SPARK-32167][SQL] Fix GetArrayStructFields to respect inner field's nullability together

AmplabJenkins removed a comment on pull request #29019: URL: https://github.com/apache/spark/pull/29019#issuecomment-67924 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #29019: [2.4][SPARK-32167][SQL] Fix GetArrayStructFields to respect inner field's nullability together

SparkQA commented on pull request #29019: URL: https://github.com/apache/spark/pull/29019#issuecomment-67391 **[Test build #125376 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125376/testReport)** for PR 29019 at commit

[GitHub] [spark] SparkQA commented on pull request #29039: [WIP][SPARK-XXXXX] HiveSessionImplSuite flakiness fix via mocking instances earlier than initializing HiveSessionImpl

SparkQA commented on pull request #29039: URL: https://github.com/apache/spark/pull/29039#issuecomment-67321 **[Test build #125375 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125375/testReport)** for PR 29039 at commit

[GitHub] [spark] HyukjinKwon commented on pull request #29019: [2.4][SPARK-32167][SQL] Fix GetArrayStructFields to respect inner field's nullability together

HyukjinKwon commented on pull request #29019: URL: https://github.com/apache/spark/pull/29019#issuecomment-66539 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] HeartSaVioR edited a comment on pull request #29017: [WIP][SPARK-XXX][TESTS] Disable SBT unidoc generation testing in Jenkins

HeartSaVioR edited a comment on pull request #29017: URL: https://github.com/apache/spark/pull/29017#issuecomment-655544712 I hope we do the migration iteratively - we all know it became a huge pain to see the green light of the build (rarely possible according to the Jenkins PRB build

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29019: [2.4][SPARK-32167][SQL] Fix GetArrayStructFields to respect inner field's nullability together

AmplabJenkins removed a comment on pull request #29019: URL: https://github.com/apache/spark/pull/29019#issuecomment-65169 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #29019: [2.4][SPARK-32167][SQL] Fix GetArrayStructFields to respect inner field's nullability together

AmplabJenkins commented on pull request #29019: URL: https://github.com/apache/spark/pull/29019#issuecomment-65163 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #29019: [2.4][SPARK-32167][SQL] Fix GetArrayStructFields to respect inner field's nullability together

SparkQA removed a comment on pull request #29019: URL: https://github.com/apache/spark/pull/29019#issuecomment-655521983 **[Test build #125366 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125366/testReport)** for PR 29019 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29019: [2.4][SPARK-32167][SQL] Fix GetArrayStructFields to respect inner field's nullability together

AmplabJenkins removed a comment on pull request #29019: URL: https://github.com/apache/spark/pull/29019#issuecomment-65163 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #29019: [2.4][SPARK-32167][SQL] Fix GetArrayStructFields to respect inner field's nullability together

SparkQA commented on pull request #29019: URL: https://github.com/apache/spark/pull/29019#issuecomment-64712 **[Test build #125366 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125366/testReport)** for PR 29019 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

AmplabJenkins removed a comment on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-63754 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29039: [WIP][SPARK-XXXXX] HiveSessionImplSuite flakiness fix via mocking instances earlier than initializing HiveSessionImpl

AmplabJenkins commented on pull request #29039: URL: https://github.com/apache/spark/pull/29039#issuecomment-63695 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

AmplabJenkins removed a comment on pull request #27366: URL: https://github.com/apache/spark/pull/27366#issuecomment-63753 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29039: [WIP][SPARK-XXXXX] HiveSessionImplSuite flakiness fix via mocking instances earlier than initializing HiveSessionImpl

AmplabJenkins removed a comment on pull request #29039: URL: https://github.com/apache/spark/pull/29039#issuecomment-63695 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

AmplabJenkins commented on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-63754 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

SparkQA commented on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-63489 **[Test build #125373 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125373/testReport)** for PR 28998 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

AmplabJenkins commented on pull request #27366: URL: https://github.com/apache/spark/pull/27366#issuecomment-63753 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] HeartSaVioR commented on pull request #29039: [WIP][SPARK-XXXXX] HiveSessionImplSuite flakiness fix via mocking instances earlier than initializing HiveSessionImpl

HeartSaVioR commented on pull request #29039: URL: https://github.com/apache/spark/pull/29039#issuecomment-62898 retest this, please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] MaxGekk commented on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

MaxGekk commented on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-61306 jenkins, retest this, please This is an automated message from the Apache Git Service. To respond to the

<    3   4   5   6   7   8   9   10   11   12   >