[GitHub] [spark] cloud-fan commented on a change in pull request #30089: [SPARK-33137][SQL] Support ALTER TABLE in JDBC v2 Table Catalog: update type and nullability of columns (Postgres dialect)

2020-10-22 Thread GitBox
cloud-fan commented on a change in pull request #30089: URL: https://github.com/apache/spark/pull/30089#discussion_r510640367 ## File path: external/docker-integration-tests/src/test/scala/org/apache/spark/sql/jdbc/v2/V2JDBCTest.scala ## @@ -73,6 +73,53 @@ trait V2JDBCTest

[GitHub] [spark] dongjoon-hyun commented on pull request #30137: [SPARK-33226][BUILD] Upgrade to SBT 1.4.1

2020-10-22 Thread GitBox
dongjoon-hyun commented on pull request #30137: URL: https://github.com/apache/spark/pull/30137#issuecomment-714932231 Thank you so much, @HyukjinKwon and @viirya . :) This is an automated message from the Apache Git

[GitHub] [spark] cloud-fan commented on a change in pull request #30089: [SPARK-33137][SQL] Support ALTER TABLE in JDBC v2 Table Catalog: update type and nullability of columns (Postgres dialect)

2020-10-22 Thread GitBox
cloud-fan commented on a change in pull request #30089: URL: https://github.com/apache/spark/pull/30089#discussion_r510639062 ## File path: external/docker-integration-tests/src/test/scala/org/apache/spark/sql/jdbc/v2/V2JDBCTest.scala ## @@ -73,6 +73,53 @@ trait V2JDBCTest

[GitHub] [spark] viirya closed pull request #30137: [SPARK-33226][BUILD] Upgrade to SBT 1.4.1

2020-10-22 Thread GitBox
viirya closed pull request #30137: URL: https://github.com/apache/spark/pull/30137 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [spark] viirya commented on pull request #30137: [SPARK-33226][BUILD] Upgrade to SBT 1.4.1

2020-10-22 Thread GitBox
viirya commented on pull request #30137: URL: https://github.com/apache/spark/pull/30137#issuecomment-714930303 Thanks! Merging to master. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] SparkQA commented on pull request #30133: [SPARK-33104][BUILD][test-hadoop2.7] Exclude 'org.apache.hadoop:hadoop-yarn-server-resourcemanager:jar:tests'

2020-10-22 Thread GitBox
SparkQA commented on pull request #30133: URL: https://github.com/apache/spark/pull/30133#issuecomment-714930266 **[Test build #130191 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130191/testReport)** for PR 30133 at commit

[GitHub] [spark] cloud-fan commented on pull request #30045: [SPARK-32991][SQL] Use conf in shared state as the original configuraion for RESET

2020-10-22 Thread GitBox
cloud-fan commented on pull request #30045: URL: https://github.com/apache/spark/pull/30045#issuecomment-714930133 GA passed, merging to master, thanks! This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] cloud-fan closed pull request #30045: [SPARK-32991][SQL] Use conf in shared state as the original configuraion for RESET

2020-10-22 Thread GitBox
cloud-fan closed pull request #30045: URL: https://github.com/apache/spark/pull/30045 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [spark] HyukjinKwon commented on pull request #30133: [SPARK-33104][BUILD][test-hadoop2.7] Exclude 'org.apache.hadoop:hadoop-yarn-server-resourcemanager:jar:tests'

2020-10-22 Thread GitBox
HyukjinKwon commented on pull request #30133: URL: https://github.com/apache/spark/pull/30133#issuecomment-714929777 The GitHub Actions build looked legitimate. I only excluded this explicitly with Hadoop 2 which should be more correct. Jenkins build looks just flaky. I already have

[GitHub] [spark] cloud-fan commented on a change in pull request #30108: [SPARK-33197][SQL] Make changes to spark.sql.analyzer.maxIterations take effect at runtime

2020-10-22 Thread GitBox
cloud-fan commented on a change in pull request #30108: URL: https://github.com/apache/spark/pull/30108#discussion_r510628863 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/analysis/AnalysisSuite.scala ## @@ -926,4 +926,45 @@ class AnalysisSuite

[GitHub] [spark] Ngone51 commented on a change in pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

2020-10-22 Thread GitBox
Ngone51 commented on a change in pull request #30062: URL: https://github.com/apache/spark/pull/30062#discussion_r510626481 ## File path: common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/RemoteBlockPushResolver.java ## @@ -0,0 +1,915 @@ +/* + * Licensed

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29800: [SPARK-32934][SQL] Improve the performance for NTH_VALUE and reactor the OffsetWindowFunction

2020-10-22 Thread GitBox
AmplabJenkins removed a comment on pull request #29800: URL: https://github.com/apache/spark/pull/29800#issuecomment-714919691 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on pull request #29800: [SPARK-32934][SQL] Improve the performance for NTH_VALUE and reactor the OffsetWindowFunction

2020-10-22 Thread GitBox
SparkQA removed a comment on pull request #29800: URL: https://github.com/apache/spark/pull/29800#issuecomment-714871892 **[Test build #130186 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130186/testReport)** for PR 29800 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29800: [SPARK-32934][SQL] Improve the performance for NTH_VALUE and reactor the OffsetWindowFunction

2020-10-22 Thread GitBox
AmplabJenkins removed a comment on pull request #29800: URL: https://github.com/apache/spark/pull/29800#issuecomment-714919685 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] Ngone51 commented on pull request #29817: [SPARK-32850][CORE][K8S] Simplify the RPC message flow of decommission

2020-10-22 Thread GitBox
Ngone51 commented on pull request #29817: URL: https://github.com/apache/spark/pull/29817#issuecomment-714922479 thanks all!! This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29800: [SPARK-32934][SQL] Improve the performance for NTH_VALUE and reactor the OffsetWindowFunction

2020-10-22 Thread GitBox
AmplabJenkins commented on pull request #29800: URL: https://github.com/apache/spark/pull/29800#issuecomment-714919685 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29800: [SPARK-32934][SQL] Improve the performance for NTH_VALUE and reactor the OffsetWindowFunction

2020-10-22 Thread GitBox
SparkQA commented on pull request #29800: URL: https://github.com/apache/spark/pull/29800#issuecomment-714919382 **[Test build #130186 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130186/testReport)** for PR 29800 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #30137: [SPARK-33226][BUILD] Upgrade to SBT 1.4.1

2020-10-22 Thread GitBox
AmplabJenkins commented on pull request #30137: URL: https://github.com/apache/spark/pull/30137#issuecomment-714914807 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30137: [SPARK-33226][BUILD] Upgrade to SBT 1.4.1

2020-10-22 Thread GitBox
AmplabJenkins removed a comment on pull request #30137: URL: https://github.com/apache/spark/pull/30137#issuecomment-714914807 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #29087: [SPARK-28227][SQL] Support TRANSFORM with aggregation

2020-10-22 Thread GitBox
SparkQA commented on pull request #29087: URL: https://github.com/apache/spark/pull/29087#issuecomment-714914622 **[Test build #130190 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130190/testReport)** for PR 29087 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #30137: [SPARK-33226][BUILD] Upgrade to SBT 1.4.1

2020-10-22 Thread GitBox
SparkQA removed a comment on pull request #30137: URL: https://github.com/apache/spark/pull/30137#issuecomment-714871855 **[Test build #130185 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130185/testReport)** for PR 30137 at commit

[GitHub] [spark] SparkQA commented on pull request #30137: [SPARK-33226][BUILD] Upgrade to SBT 1.4.1

2020-10-22 Thread GitBox
SparkQA commented on pull request #30137: URL: https://github.com/apache/spark/pull/30137#issuecomment-714914115 **[Test build #130185 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130185/testReport)** for PR 30137 at commit

[GitHub] [spark] cloud-fan commented on a change in pull request #30079: [SPARK-33174][SQL] Migrate DROP TABLE to use UnresolvedTableOrView to resolve the identifier

2020-10-22 Thread GitBox
cloud-fan commented on a change in pull request #30079: URL: https://github.com/apache/spark/pull/30079#discussion_r510594110 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/DataSourceV2Strategy.scala ## @@ -228,8 +228,11 @@ class

[GitHub] [spark] cloud-fan commented on a change in pull request #30079: [SPARK-33174][SQL] Migrate DROP TABLE to use UnresolvedTableOrView to resolve the identifier

2020-10-22 Thread GitBox
cloud-fan commented on a change in pull request #30079: URL: https://github.com/apache/spark/pull/30079#discussion_r510593591 ## File path: sql/core/src/test/scala/org/apache/spark/sql/connector/TestV2SessionCatalogBase.scala ## @@ -74,8 +82,11 @@ private[connector] trait

[GitHub] [spark] HyukjinKwon closed pull request #29817: [SPARK-32850][CORE][K8S] Simplify the RPC message flow of decommission

2020-10-22 Thread GitBox
HyukjinKwon closed pull request #29817: URL: https://github.com/apache/spark/pull/29817 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] HyukjinKwon commented on pull request #29817: [SPARK-32850][CORE][K8S] Simplify the RPC message flow of decommission

2020-10-22 Thread GitBox
HyukjinKwon commented on pull request #29817: URL: https://github.com/apache/spark/pull/29817#issuecomment-714911468 Merged to master. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] cloud-fan commented on a change in pull request #30079: [SPARK-33174][SQL] Migrate DROP TABLE to use UnresolvedTableOrView to resolve the identifier

2020-10-22 Thread GitBox
cloud-fan commented on a change in pull request #30079: URL: https://github.com/apache/spark/pull/30079#discussion_r510592895 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/DataSourceV2Strategy.scala ## @@ -228,8 +228,11 @@ class

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30136: [MINOR][DOCS][TESTS] Fix PLAN_CHANGE_LOG_LEVEL document

2020-10-22 Thread GitBox
AmplabJenkins removed a comment on pull request #30136: URL: https://github.com/apache/spark/pull/30136#issuecomment-714908882 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #30136: [MINOR][DOCS][TESTS] Fix PLAN_CHANGE_LOG_LEVEL document

2020-10-22 Thread GitBox
AmplabJenkins commented on pull request #30136: URL: https://github.com/apache/spark/pull/30136#issuecomment-714908877 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30136: [MINOR][DOCS][TESTS] Fix PLAN_CHANGE_LOG_LEVEL document

2020-10-22 Thread GitBox
AmplabJenkins removed a comment on pull request #30136: URL: https://github.com/apache/spark/pull/30136#issuecomment-714908877 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #30136: [MINOR][DOCS][TESTS] Fix PLAN_CHANGE_LOG_LEVEL document

2020-10-22 Thread GitBox
SparkQA removed a comment on pull request #30136: URL: https://github.com/apache/spark/pull/30136#issuecomment-714841757 **[Test build #130183 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130183/testReport)** for PR 30136 at commit

[GitHub] [spark] SparkQA commented on pull request #30136: [MINOR][DOCS][TESTS] Fix PLAN_CHANGE_LOG_LEVEL document

2020-10-22 Thread GitBox
SparkQA commented on pull request #30136: URL: https://github.com/apache/spark/pull/30136#issuecomment-714908479 **[Test build #130183 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130183/testReport)** for PR 30136 at commit

[GitHub] [spark] otterc commented on a change in pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

2020-10-22 Thread GitBox
otterc commented on a change in pull request #30062: URL: https://github.com/apache/spark/pull/30062#discussion_r510590175 ## File path: common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/RemoteBlockPushResolver.java ## @@ -0,0 +1,915 @@ +/* + * Licensed to

[GitHub] [spark] AmplabJenkins commented on pull request #30079: [SPARK-33174][SQL] Migrate DROP TABLE to use UnresolvedTableOrView to resolve the identifier

2020-10-22 Thread GitBox
AmplabJenkins commented on pull request #30079: URL: https://github.com/apache/spark/pull/30079#issuecomment-714905105 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30079: [SPARK-33174][SQL] Migrate DROP TABLE to use UnresolvedTableOrView to resolve the identifier

2020-10-22 Thread GitBox
SparkQA commented on pull request #30079: URL: https://github.com/apache/spark/pull/30079#issuecomment-714905092 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34791/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30079: [SPARK-33174][SQL] Migrate DROP TABLE to use UnresolvedTableOrView to resolve the identifier

2020-10-22 Thread GitBox
AmplabJenkins removed a comment on pull request #30079: URL: https://github.com/apache/spark/pull/30079#issuecomment-714905105 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] HyukjinKwon closed pull request #30136: [MINOR][DOCS][TESTS] Fix PLAN_CHANGE_LOG_LEVEL document

2020-10-22 Thread GitBox
HyukjinKwon closed pull request #30136: URL: https://github.com/apache/spark/pull/30136 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] HyukjinKwon commented on pull request #30136: [MINOR][DOCS][TESTS] Fix PLAN_CHANGE_LOG_LEVEL document

2020-10-22 Thread GitBox
HyukjinKwon commented on pull request #30136: URL: https://github.com/apache/spark/pull/30136#issuecomment-714904693 Merged to master. Seems GitHub Actions build passed. This is an automated message from the Apache Git

[GitHub] [spark] cloud-fan commented on a change in pull request #30079: [SPARK-33174][SQL] Migrate DROP TABLE to use UnresolvedTableOrView to resolve the identifier

2020-10-22 Thread GitBox
cloud-fan commented on a change in pull request #30079: URL: https://github.com/apache/spark/pull/30079#discussion_r510587663 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/v2ResolutionPlans.scala ## @@ -81,7 +81,7 @@ case class

[GitHub] [spark] cloud-fan commented on a change in pull request #30079: [SPARK-33174][SQL] Migrate DROP TABLE to use UnresolvedTableOrView to resolve the identifier

2020-10-22 Thread GitBox
cloud-fan commented on a change in pull request #30079: URL: https://github.com/apache/spark/pull/30079#discussion_r510587530 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/ResolveNoopDropTable.scala ## @@ -0,0 +1,40 @@ +/* + * Licensed to

[GitHub] [spark] HyukjinKwon commented on pull request #29874: [SPARK-32998][BUILD] Add ability to override default remote repos with internal one

2020-10-22 Thread GitBox
HyukjinKwon commented on pull request #29874: URL: https://github.com/apache/spark/pull/29874#issuecomment-714903561 Ah, right. That makes sense. This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] HyukjinKwon edited a comment on pull request #29874: [SPARK-32998][BUILD] Add ability to override default remote repos with internal one

2020-10-22 Thread GitBox
HyukjinKwon edited a comment on pull request #29874: URL: https://github.com/apache/spark/pull/29874#issuecomment-714843015 > Building spark internally ... > Do we need to change `pom.xml` and `project/SparkBuild.scala`? > I tested master internally just now and didn't need to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30079: [SPARK-33174][SQL] Migrate DROP TABLE to use UnresolvedTableOrView to resolve the identifier

2020-10-22 Thread GitBox
AmplabJenkins removed a comment on pull request #30079: URL: https://github.com/apache/spark/pull/30079#issuecomment-714900584 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30079: [SPARK-33174][SQL] Migrate DROP TABLE to use UnresolvedTableOrView to resolve the identifier

2020-10-22 Thread GitBox
AmplabJenkins commented on pull request #30079: URL: https://github.com/apache/spark/pull/30079#issuecomment-714900584 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30079: [SPARK-33174][SQL] Migrate DROP TABLE to use UnresolvedTableOrView to resolve the identifier

2020-10-22 Thread GitBox
SparkQA commented on pull request #30079: URL: https://github.com/apache/spark/pull/30079#issuecomment-714900559 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34790/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30136: [MINOR][DOCS][TESTS] Fix PLAN_CHANGE_LOG_LEVEL document

2020-10-22 Thread GitBox
AmplabJenkins removed a comment on pull request #30136: URL: https://github.com/apache/spark/pull/30136#issuecomment-714897629 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #30136: [MINOR][DOCS][TESTS] Fix PLAN_CHANGE_LOG_LEVEL document

2020-10-22 Thread GitBox
SparkQA commented on pull request #30136: URL: https://github.com/apache/spark/pull/30136#issuecomment-714897617 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34789/

[GitHub] [spark] AmplabJenkins commented on pull request #30136: [MINOR][DOCS][TESTS] Fix PLAN_CHANGE_LOG_LEVEL document

2020-10-22 Thread GitBox
AmplabJenkins commented on pull request #30136: URL: https://github.com/apache/spark/pull/30136#issuecomment-714897629 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30079: [SPARK-33174][SQL] Migrate DROP TABLE to use UnresolvedTableOrView to resolve the identifier

2020-10-22 Thread GitBox
SparkQA commented on pull request #30079: URL: https://github.com/apache/spark/pull/30079#issuecomment-714896504 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34791/

[GitHub] [spark] SparkQA commented on pull request #30079: [SPARK-33174][SQL] Migrate DROP TABLE to use UnresolvedTableOrView to resolve the identifier

2020-10-22 Thread GitBox
SparkQA commented on pull request #30079: URL: https://github.com/apache/spark/pull/30079#issuecomment-714894445 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34790/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30079: [SPARK-33174][SQL] Migrate DROP TABLE to use UnresolvedTableOrView to resolve the identifier

2020-10-22 Thread GitBox
AmplabJenkins removed a comment on pull request #30079: URL: https://github.com/apache/spark/pull/30079#issuecomment-714893009 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #30079: [SPARK-33174][SQL] Migrate DROP TABLE to use UnresolvedTableOrView to resolve the identifier

2020-10-22 Thread GitBox
AmplabJenkins commented on pull request #30079: URL: https://github.com/apache/spark/pull/30079#issuecomment-714893004 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30079: [SPARK-33174][SQL] Migrate DROP TABLE to use UnresolvedTableOrView to resolve the identifier

2020-10-22 Thread GitBox
AmplabJenkins removed a comment on pull request #30079: URL: https://github.com/apache/spark/pull/30079#issuecomment-714893004 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #30079: [SPARK-33174][SQL] Migrate DROP TABLE to use UnresolvedTableOrView to resolve the identifier

2020-10-22 Thread GitBox
SparkQA removed a comment on pull request #30079: URL: https://github.com/apache/spark/pull/30079#issuecomment-714883002 **[Test build #130188 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130188/testReport)** for PR 30079 at commit

[GitHub] [spark] SparkQA commented on pull request #30079: [SPARK-33174][SQL] Migrate DROP TABLE to use UnresolvedTableOrView to resolve the identifier

2020-10-22 Thread GitBox
SparkQA commented on pull request #30079: URL: https://github.com/apache/spark/pull/30079#issuecomment-714892836 **[Test build #130188 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130188/testReport)** for PR 30079 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29800: [SPARK-32934][SQL] Improve the performance for NTH_VALUE and reactor the OffsetWindowFunction

2020-10-22 Thread GitBox
AmplabJenkins removed a comment on pull request #29800: URL: https://github.com/apache/spark/pull/29800#issuecomment-714891642 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #29800: [SPARK-32934][SQL] Improve the performance for NTH_VALUE and reactor the OffsetWindowFunction

2020-10-22 Thread GitBox
SparkQA commented on pull request #29800: URL: https://github.com/apache/spark/pull/29800#issuecomment-714891633 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34788/

[GitHub] [spark] AmplabJenkins commented on pull request #29800: [SPARK-32934][SQL] Improve the performance for NTH_VALUE and reactor the OffsetWindowFunction

2020-10-22 Thread GitBox
AmplabJenkins commented on pull request #29800: URL: https://github.com/apache/spark/pull/29800#issuecomment-714891642 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] otterc commented on a change in pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

2020-10-22 Thread GitBox
otterc commented on a change in pull request #30062: URL: https://github.com/apache/spark/pull/30062#discussion_r510577811 ## File path: common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/RemoteBlockPushResolver.java ## @@ -0,0 +1,915 @@ +/* + * Licensed to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30137: [SPARK-33226][BUILD] Upgrade to SBT 1.4.1

2020-10-22 Thread GitBox
AmplabJenkins removed a comment on pull request #30137: URL: https://github.com/apache/spark/pull/30137#issuecomment-714890699 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30137: [SPARK-33226][BUILD] Upgrade to SBT 1.4.1

2020-10-22 Thread GitBox
AmplabJenkins commented on pull request #30137: URL: https://github.com/apache/spark/pull/30137#issuecomment-714890699 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30137: [SPARK-33226][BUILD] Upgrade to SBT 1.4.1

2020-10-22 Thread GitBox
SparkQA commented on pull request #30137: URL: https://github.com/apache/spark/pull/30137#issuecomment-714890693 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34787/

[GitHub] [spark] SparkQA commented on pull request #30136: [MINOR][DOCS][TESTS] Fix PLAN_CHANGE_LOG_LEVEL document

2020-10-22 Thread GitBox
SparkQA commented on pull request #30136: URL: https://github.com/apache/spark/pull/30136#issuecomment-714888579 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34789/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30045: [SPARK-32991][SQL] Use conf in shared state as the original configuraion for RESET

2020-10-22 Thread GitBox
AmplabJenkins removed a comment on pull request #30045: URL: https://github.com/apache/spark/pull/30045#issuecomment-714885452 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] Ngone51 commented on a change in pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

2020-10-22 Thread GitBox
Ngone51 commented on a change in pull request #30062: URL: https://github.com/apache/spark/pull/30062#discussion_r510574311 ## File path: common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/RemoteBlockPushResolver.java ## @@ -0,0 +1,915 @@ +/* + * Licensed

[GitHub] [spark] SparkQA commented on pull request #30045: [SPARK-32991][SQL] Use conf in shared state as the original configuraion for RESET

2020-10-22 Thread GitBox
SparkQA commented on pull request #30045: URL: https://github.com/apache/spark/pull/30045#issuecomment-714885443 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34786/

[GitHub] [spark] AmplabJenkins commented on pull request #30045: [SPARK-32991][SQL] Use conf in shared state as the original configuraion for RESET

2020-10-22 Thread GitBox
AmplabJenkins commented on pull request #30045: URL: https://github.com/apache/spark/pull/30045#issuecomment-714885452 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29800: [SPARK-32934][SQL] Improve the performance for NTH_VALUE and reactor the OffsetWindowFunction

2020-10-22 Thread GitBox
SparkQA commented on pull request #29800: URL: https://github.com/apache/spark/pull/29800#issuecomment-714885099 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34788/

[GitHub] [spark] SparkQA commented on pull request #30079: [SPARK-33174][SQL] Migrate DROP TABLE to use UnresolvedTableOrView to resolve the identifier

2020-10-22 Thread GitBox
SparkQA commented on pull request #30079: URL: https://github.com/apache/spark/pull/30079#issuecomment-714885211 **[Test build #130189 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130189/testReport)** for PR 30079 at commit

[GitHub] [spark] SparkQA commented on pull request #30137: [SPARK-33226][BUILD] Upgrade to SBT 1.4.1

2020-10-22 Thread GitBox
SparkQA commented on pull request #30137: URL: https://github.com/apache/spark/pull/30137#issuecomment-714884580 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34787/

[GitHub] [spark] SparkQA commented on pull request #30079: [SPARK-33174][SQL] Migrate DROP TABLE to use UnresolvedTableOrView to resolve the identifier

2020-10-22 Thread GitBox
SparkQA commented on pull request #30079: URL: https://github.com/apache/spark/pull/30079#issuecomment-714883002 **[Test build #130188 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130188/testReport)** for PR 30079 at commit

[GitHub] [spark] HeartSaVioR commented on pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

2020-10-22 Thread GitBox
HeartSaVioR commented on pull request #26935: URL: https://github.com/apache/spark/pull/26935#issuecomment-714882025 @viirya Kindly reminder. This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] otterc commented on a change in pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

2020-10-22 Thread GitBox
otterc commented on a change in pull request #30062: URL: https://github.com/apache/spark/pull/30062#discussion_r510570187 ## File path: common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/RemoteBlockPushResolver.java ## @@ -0,0 +1,915 @@ +/* + * Licensed to

[GitHub] [spark] viirya commented on pull request #30136: [MINOR][DOCS][TESTS] Fix PLAN_CHANGE_LOG_LEVEL document

2020-10-22 Thread GitBox
viirya commented on pull request #30136: URL: https://github.com/apache/spark/pull/30136#issuecomment-714880753 Thanks @dongjoon-hyun @maropu This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

2020-10-22 Thread GitBox
AmplabJenkins removed a comment on pull request #30062: URL: https://github.com/apache/spark/pull/30062#issuecomment-714877548 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

2020-10-22 Thread GitBox
AmplabJenkins commented on pull request #30062: URL: https://github.com/apache/spark/pull/30062#issuecomment-714878001 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

2020-10-22 Thread GitBox
AmplabJenkins commented on pull request #30062: URL: https://github.com/apache/spark/pull/30062#issuecomment-714877548 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

2020-10-22 Thread GitBox
SparkQA commented on pull request #30062: URL: https://github.com/apache/spark/pull/30062#issuecomment-714877345 **[Test build #130181 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130181/testReport)** for PR 30062 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

2020-10-22 Thread GitBox
SparkQA removed a comment on pull request #30062: URL: https://github.com/apache/spark/pull/30062#issuecomment-714831899 **[Test build #130181 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130181/testReport)** for PR 30062 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

2020-10-22 Thread GitBox
SparkQA removed a comment on pull request #30062: URL: https://github.com/apache/spark/pull/30062#issuecomment-714835991 **[Test build #130182 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130182/testReport)** for PR 30062 at commit

[GitHub] [spark] SparkQA commented on pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

2020-10-22 Thread GitBox
SparkQA commented on pull request #30062: URL: https://github.com/apache/spark/pull/30062#issuecomment-714876910 **[Test build #130182 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130182/testReport)** for PR 30062 at commit

[GitHub] [spark] SparkQA commented on pull request #30045: [SPARK-32991][SQL] Use conf in shared state as the original configuraion for RESET

2020-10-22 Thread GitBox
SparkQA commented on pull request #30045: URL: https://github.com/apache/spark/pull/30045#issuecomment-714876806 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34786/

[GitHub] [spark] SparkQA commented on pull request #30136: [MINOR][DOCS][TESTS] Fix PLAN_CHANGE_LOG_LEVEL document

2020-10-22 Thread GitBox
SparkQA commented on pull request #30136: URL: https://github.com/apache/spark/pull/30136#issuecomment-714876036 **[Test build #130187 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130187/testReport)** for PR 30136 at commit

[GitHub] [spark] viirya commented on pull request #30136: [MINOR][DOCS] Fix PLAN_CHANGE_LOG_LEVEL document

2020-10-22 Thread GitBox
viirya commented on pull request #30136: URL: https://github.com/apache/spark/pull/30136#issuecomment-714875572 > Oh, please change the following test case, @viirya . > > ```scala > ---

[GitHub] [spark] SparkQA commented on pull request #30137: [SPARK-33226][BUILD] Upgrade to SBT 1.4.1

2020-10-22 Thread GitBox
SparkQA commented on pull request #30137: URL: https://github.com/apache/spark/pull/30137#issuecomment-714871855 **[Test build #130185 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130185/testReport)** for PR 30137 at commit

[GitHub] [spark] SparkQA commented on pull request #29800: [SPARK-32934][SQL] Improve the performance for NTH_VALUE and reactor the OffsetWindowFunction

2020-10-22 Thread GitBox
SparkQA commented on pull request #29800: URL: https://github.com/apache/spark/pull/29800#issuecomment-714871892 **[Test build #130186 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130186/testReport)** for PR 29800 at commit

[GitHub] [spark] beliefer commented on pull request #29800: [SPARK-32934][SQL] Improve the performance for NTH_VALUE and reactor the OffsetWindowFunction

2020-10-22 Thread GitBox
beliefer commented on pull request #29800: URL: https://github.com/apache/spark/pull/29800#issuecomment-714871076 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] sarutak commented on pull request #30119: [SPARK-33204 ][UI]The 'Event Timeline' area cannot be opened when a spark application has some failed jobs.

2020-10-22 Thread GitBox
sarutak commented on pull request #30119: URL: https://github.com/apache/spark/pull/30119#issuecomment-714871114 @akiyamaneko How about using `StringEscapeUtils.escapeEcmaScript`? This is an automated message from the Apache

[GitHub] [spark] dongjoon-hyun opened a new pull request #30137: [SPARK-XXX][BUILD] Upgrade to SBT 1.4.1

2020-10-22 Thread GitBox
dongjoon-hyun opened a new pull request #30137: URL: https://github.com/apache/spark/pull/30137 ### What changes were proposed in this pull request? ### Why are the changes needed? ### Does this PR introduce _any_ user-facing change? ###

[GitHub] [spark] Ngone51 commented on a change in pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

2020-10-22 Thread GitBox
Ngone51 commented on a change in pull request #30062: URL: https://github.com/apache/spark/pull/30062#discussion_r510559294 ## File path: common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/RemoteBlockPushResolver.java ## @@ -0,0 +1,915 @@ +/* + * Licensed

[GitHub] [spark] SparkQA commented on pull request #30045: [SPARK-32991][SQL] Use conf in shared state as the original configuraion for RESET

2020-10-22 Thread GitBox
SparkQA commented on pull request #30045: URL: https://github.com/apache/spark/pull/30045#issuecomment-714865098 **[Test build #130184 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130184/testReport)** for PR 30045 at commit

[GitHub] [spark] yaooqinn commented on pull request #30045: [SPARK-32991][SQL] Use conf in shared state as the original configuraion for RESET

2020-10-22 Thread GitBox
yaooqinn commented on pull request #30045: URL: https://github.com/apache/spark/pull/30045#issuecomment-714864181 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30136: [MINOR][DOCS] Fix PLAN_CHANGE_LOG_LEVEL document

2020-10-22 Thread GitBox
AmplabJenkins removed a comment on pull request #30136: URL: https://github.com/apache/spark/pull/30136#issuecomment-714862102 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30136: [MINOR][DOCS] Fix PLAN_CHANGE_LOG_LEVEL document

2020-10-22 Thread GitBox
AmplabJenkins commented on pull request #30136: URL: https://github.com/apache/spark/pull/30136#issuecomment-714862102 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30136: [MINOR][DOCS] Fix PLAN_CHANGE_LOG_LEVEL document

2020-10-22 Thread GitBox
SparkQA commented on pull request #30136: URL: https://github.com/apache/spark/pull/30136#issuecomment-714862088 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34785/

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #30131: [WIP][SPARK-33220][CORE]Use `scheduleWithFixedDelay` to avoid repeated unnecessary scheduling for a short time

2020-10-22 Thread GitBox
AngersZh commented on a change in pull request #30131: URL: https://github.com/apache/spark/pull/30131#discussion_r510551032 ## File path: core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala ## @@ -134,7 +134,7 @@ class

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #30131: [WIP][SPARK-33220][CORE]Use `scheduleWithFixedDelay` to avoid repeated unnecessary scheduling for a short time

2020-10-22 Thread GitBox
AngersZh commented on a change in pull request #30131: URL: https://github.com/apache/spark/pull/30131#discussion_r51007 ## File path: core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala ## @@ -134,7 +134,7 @@ class

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

2020-10-22 Thread GitBox
AmplabJenkins removed a comment on pull request #30062: URL: https://github.com/apache/spark/pull/30062#issuecomment-714856427 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

2020-10-22 Thread GitBox
SparkQA commented on pull request #30062: URL: https://github.com/apache/spark/pull/30062#issuecomment-714856404 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34784/

[GitHub] [spark] AmplabJenkins commented on pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

2020-10-22 Thread GitBox
AmplabJenkins commented on pull request #30062: URL: https://github.com/apache/spark/pull/30062#issuecomment-714856427 This is an automated message from the Apache Git Service. To respond to the message, please log on to

  1   2   3   4   5   6   7   8   >