[GitHub] [spark] cloud-fan commented on a change in pull request #29307: [SPARK-32083][SQL] AQE coalesce should at least return one partition

2020-07-30 Thread GitBox
cloud-fan commented on a change in pull request #29307: URL: https://github.com/apache/spark/pull/29307#discussion_r463396354 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/OptimizeLocalShuffleReader.scala ## @@ -140,9 +140,9 @@ object

[GitHub] [spark] cloud-fan commented on a change in pull request #29307: [SPARK-32083][SQL] AQE coalesce should at least return one partition

2020-07-30 Thread GitBox
cloud-fan commented on a change in pull request #29307: URL: https://github.com/apache/spark/pull/29307#discussion_r463396209 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/OptimizeLocalShuffleReader.scala ## @@ -140,9 +140,9 @@ object

[GitHub] [spark] cloud-fan commented on a change in pull request #29291: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

2020-07-30 Thread GitBox
cloud-fan commented on a change in pull request #29291: URL: https://github.com/apache/spark/pull/29291#discussion_r463395906 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/RewriteDistinctAggregates.scala ## @@ -207,13 +257,30 @@ object

[GitHub] [spark] cloud-fan commented on a change in pull request #29291: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

2020-07-30 Thread GitBox
cloud-fan commented on a change in pull request #29291: URL: https://github.com/apache/spark/pull/29291#discussion_r463395762 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/RewriteDistinctAggregates.scala ## @@ -207,13 +257,30 @@ object

[GitHub] [spark] c21 commented on a change in pull request #29277: [SPARK-32421][SQL] Add code-gen for shuffled hash join

2020-07-30 Thread GitBox
c21 commented on a change in pull request #29277: URL: https://github.com/apache/spark/pull/29277#discussion_r463395132 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/WholeStageCodegenExec.scala ## @@ -903,6 +904,10 @@ case class CollapseCodegenStages(

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28617: [SPARK-31694][SQL] Add SupportsPartitions Catalog APIs on DataSourceV2

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #28617: URL: https://github.com/apache/spark/pull/28617#issuecomment-666903402 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on pull request #29304: [SPARK-32494][SQL] Null Aware Anti Join Optimize Support Multi-Column

2020-07-30 Thread GitBox
SparkQA commented on pull request #29304: URL: https://github.com/apache/spark/pull/29304#issuecomment-666903705 **[Test build #126838 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126838/testReport)** for PR 29304 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28617: [SPARK-31694][SQL] Add SupportsPartitions Catalog APIs on DataSourceV2

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #28617: URL: https://github.com/apache/spark/pull/28617#issuecomment-666903391 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29314: [FOLLOWUP][SPARK-32175] Remove flaky test added in SPARK-32175

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #29314: URL: https://github.com/apache/spark/pull/29314#issuecomment-666855992 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29314: [FOLLOWUP][SPARK-32175] Remove flaky test added in SPARK-32175

2020-07-30 Thread GitBox
AmplabJenkins commented on pull request #29314: URL: https://github.com/apache/spark/pull/29314#issuecomment-666903491 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28617: [SPARK-31694][SQL] Add SupportsPartitions Catalog APIs on DataSourceV2

2020-07-30 Thread GitBox
AmplabJenkins commented on pull request #28617: URL: https://github.com/apache/spark/pull/28617#issuecomment-666903391 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28617: [SPARK-31694][SQL] Add SupportsPartitions Catalog APIs on DataSourceV2

2020-07-30 Thread GitBox
SparkQA removed a comment on pull request #28617: URL: https://github.com/apache/spark/pull/28617#issuecomment-666751883 **[Test build #126821 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126821/testReport)** for PR 28617 at commit

[GitHub] [spark] SparkQA commented on pull request #28617: [SPARK-31694][SQL] Add SupportsPartitions Catalog APIs on DataSourceV2

2020-07-30 Thread GitBox
SparkQA commented on pull request #28617: URL: https://github.com/apache/spark/pull/28617#issuecomment-666902218 **[Test build #126821 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126821/testReport)** for PR 28617 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29291: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #29291: URL: https://github.com/apache/spark/pull/29291#issuecomment-666901356 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27507: [SPARK-24884][SQL] Support regexp function regexp_extract_all

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #27507: URL: https://github.com/apache/spark/pull/27507#issuecomment-666901357 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #27507: [SPARK-24884][SQL] Support regexp function regexp_extract_all

2020-07-30 Thread GitBox
AmplabJenkins commented on pull request #27507: URL: https://github.com/apache/spark/pull/27507#issuecomment-666901357 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29291: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

2020-07-30 Thread GitBox
AmplabJenkins commented on pull request #29291: URL: https://github.com/apache/spark/pull/29291#issuecomment-666901356 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28618: [SPARK-31801][API][SHUFFLE] Register map output metadata

2020-07-30 Thread GitBox
SparkQA commented on pull request #28618: URL: https://github.com/apache/spark/pull/28618#issuecomment-666901027 **[Test build #126836 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126836/testReport)** for PR 28618 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29085: [SPARK-32106][SQL]Implement SparkScriptTransformationExec in sql/core

2020-07-30 Thread GitBox
AmplabJenkins commented on pull request #29085: URL: https://github.com/apache/spark/pull/29085#issuecomment-666900887 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29085: [SPARK-32106][SQL]Implement SparkScriptTransformationExec in sql/core

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #29085: URL: https://github.com/apache/spark/pull/29085#issuecomment-666900887 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] beliefer commented on pull request #29291: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

2020-07-30 Thread GitBox
beliefer commented on pull request #29291: URL: https://github.com/apache/spark/pull/29291#issuecomment-666900743 > can you rebase/merge with the master branch to get the github action fix? The jenkin is quite unstable now and we may need to rely on github actions OK

[GitHub] [spark] HyukjinKwon commented on pull request #29225: [SPARK-32287][TESTS] Flaky Test: ExecutorAllocationManagerSuite.add executors default profile

2020-07-30 Thread GitBox
HyukjinKwon commented on pull request #29225: URL: https://github.com/apache/spark/pull/29225#issuecomment-666900157 I saw this again: ``` [info] - add executors default profile *** FAILED *** (38 milliseconds) [info] 4 did not equal 2

[GitHub] [spark] SparkQA removed a comment on pull request #29085: [SPARK-32106][SQL]Implement SparkScriptTransformationExec in sql/core

2020-07-30 Thread GitBox
SparkQA removed a comment on pull request #29085: URL: https://github.com/apache/spark/pull/29085#issuecomment-57483 **[Test build #126818 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126818/testReport)** for PR 29085 at commit

[GitHub] [spark] SparkQA commented on pull request #29085: [SPARK-32106][SQL]Implement SparkScriptTransformationExec in sql/core

2020-07-30 Thread GitBox
SparkQA commented on pull request #29085: URL: https://github.com/apache/spark/pull/29085#issuecomment-666899443 **[Test build #126818 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126818/testReport)** for PR 29085 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28617: [SPARK-31694][SQL] Add SupportsPartitions Catalog APIs on DataSourceV2

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #28617: URL: https://github.com/apache/spark/pull/28617#issuecomment-666899043 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28781: [SPARK-31953][SS] Add Spark Structured Streaming History Server Support

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #28781: URL: https://github.com/apache/spark/pull/28781#issuecomment-666898975 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28617: [SPARK-31694][SQL] Add SupportsPartitions Catalog APIs on DataSourceV2

2020-07-30 Thread GitBox
AmplabJenkins commented on pull request #28617: URL: https://github.com/apache/spark/pull/28617#issuecomment-666899043 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] HyukjinKwon commented on pull request #29067: [SPARK-32274][SQL] Make SQL cache serialization pluggable

2020-07-30 Thread GitBox
HyukjinKwon commented on pull request #29067: URL: https://github.com/apache/spark/pull/29067#issuecomment-666898969 Looks getting closer to go to me too. This is an automated message from the Apache Git Service. To respond

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #29312: [SPARK-32503][CORE][TESTS] Add Scala 2.13 `core` and related module test in GitHub Action

2020-07-30 Thread GitBox
dongjoon-hyun commented on a change in pull request #29312: URL: https://github.com/apache/spark/pull/29312#discussion_r463390540 ## File path: .github/workflows/master.yml ## @@ -271,3 +271,29 @@ jobs: mkdir -p ~/.m2 ./build/mvn $MAVEN_CLI_OPTS -DskipTests

[GitHub] [spark] AmplabJenkins commented on pull request #28781: [SPARK-31953][SS] Add Spark Structured Streaming History Server Support

2020-07-30 Thread GitBox
AmplabJenkins commented on pull request #28781: URL: https://github.com/apache/spark/pull/28781#issuecomment-666898975 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] uncleGen removed a comment on pull request #28781: [SPARK-31953][SS] Add Spark Structured Streaming History Server Support

2020-07-30 Thread GitBox
uncleGen removed a comment on pull request #28781: URL: https://github.com/apache/spark/pull/28781#issuecomment-666875388 retest this please. This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] uncleGen commented on pull request #28781: [SPARK-31953][SS] Add Spark Structured Streaming History Server Support

2020-07-30 Thread GitBox
uncleGen commented on pull request #28781: URL: https://github.com/apache/spark/pull/28781#issuecomment-666898656 retest this please. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #29312: [SPARK-32503][CORE][TESTS] Add Scala 2.13 `core` and related module test in GitHub Action

2020-07-30 Thread GitBox
dongjoon-hyun commented on a change in pull request #29312: URL: https://github.com/apache/spark/pull/29312#discussion_r463389867 ## File path: .github/workflows/master.yml ## @@ -271,3 +271,29 @@ jobs: mkdir -p ~/.m2 ./build/mvn $MAVEN_CLI_OPTS -DskipTests

[GitHub] [spark] HyukjinKwon commented on pull request #29289: [SPARK-32482][SS][TESTS] Eliminate deprecated poll(long) API calls to avoid infinite wait in tests

2020-07-30 Thread GitBox
HyukjinKwon commented on pull request #29289: URL: https://github.com/apache/spark/pull/29289#issuecomment-666897674 Looks Jenkins is out of the order. GitHub Actions build passed so should be good to merge and go ahead.

[GitHub] [spark] SparkQA commented on pull request #28902: [SPARK-31801][API][SHUFFLE][TESTS] Tests for registering map output metadata

2020-07-30 Thread GitBox
SparkQA commented on pull request #28902: URL: https://github.com/apache/spark/pull/28902#issuecomment-666896452 **[Test build #126835 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126835/testReport)** for PR 28902 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29277: [SPARK-32421][SQL] Add code-gen for shuffled hash join

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #29277: URL: https://github.com/apache/spark/pull/29277#issuecomment-666896275 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29277: [SPARK-32421][SQL] Add code-gen for shuffled hash join

2020-07-30 Thread GitBox
AmplabJenkins commented on pull request #29277: URL: https://github.com/apache/spark/pull/29277#issuecomment-666896275 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] viirya commented on a change in pull request #29307: [SPARK-32083][SQL] AQE coalesce should at least return one partition

2020-07-30 Thread GitBox
viirya commented on a change in pull request #29307: URL: https://github.com/apache/spark/pull/29307#discussion_r463388360 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/OptimizeLocalShuffleReader.scala ## @@ -140,9 +140,9 @@ object

[GitHub] [spark] SparkQA removed a comment on pull request #29277: [SPARK-32421][SQL] Add code-gen for shuffled hash join

2020-07-30 Thread GitBox
SparkQA removed a comment on pull request #29277: URL: https://github.com/apache/spark/pull/29277#issuecomment-57482 **[Test build #126813 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126813/testReport)** for PR 29277 at commit

[GitHub] [spark] SparkQA commented on pull request #29277: [SPARK-32421][SQL] Add code-gen for shuffled hash join

2020-07-30 Thread GitBox
SparkQA commented on pull request #29277: URL: https://github.com/apache/spark/pull/29277#issuecomment-666894848 **[Test build #126813 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126813/testReport)** for PR 29277 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28617: [SPARK-31694][SQL] Add SupportsPartitions Catalog APIs on DataSourceV2

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #28617: URL: https://github.com/apache/spark/pull/28617#issuecomment-666894172 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28617: [SPARK-31694][SQL] Add SupportsPartitions Catalog APIs on DataSourceV2

2020-07-30 Thread GitBox
AmplabJenkins commented on pull request #28617: URL: https://github.com/apache/spark/pull/28617#issuecomment-666894172 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] viirya commented on a change in pull request #29277: [SPARK-32421][SQL] Add code-gen for shuffled hash join

2020-07-30 Thread GitBox
viirya commented on a change in pull request #29277: URL: https://github.com/apache/spark/pull/29277#discussion_r463386852 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/WholeStageCodegenExec.scala ## @@ -903,6 +904,10 @@ case class

[GitHub] [spark] cloud-fan commented on pull request #29291: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

2020-07-30 Thread GitBox
cloud-fan commented on pull request #29291: URL: https://github.com/apache/spark/pull/29291#issuecomment-666892983 can you rebase/merge with the master branch to get the github action fix? The jenkin is quite unstable now and we may need to rely on github actions

[GitHub] [spark] cloud-fan commented on a change in pull request #27507: [SPARK-24884][SQL] Support regexp function regexp_extract_all

2020-07-30 Thread GitBox
cloud-fan commented on a change in pull request #27507: URL: https://github.com/apache/spark/pull/27507#discussion_r463385548 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/RegexpExpressionsSuite.scala ## @@ -322,6 +322,48 @@ class

[GitHub] [spark] moomindani edited a comment on pull request #27690: [SPARK-21514][SQL] Added a new option to use non-blobstore storage when writing into blobstore storage

2020-07-30 Thread GitBox
moomindani edited a comment on pull request #27690: URL: https://github.com/apache/spark/pull/27690#issuecomment-666876575 @maropu I have tested the early version of this patch in EMR cluster. I will test the latest version in actual cluster.

[GitHub] [spark] cloud-fan commented on a change in pull request #29307: [SPARK-32083][SQL] AQE coalesce should at least return one partition

2020-07-30 Thread GitBox
cloud-fan commented on a change in pull request #29307: URL: https://github.com/apache/spark/pull/29307#discussion_r463384641 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/exchange/ShuffleExchangeExec.scala ## @@ -83,7 +83,12 @@ trait

[GitHub] [spark] AmplabJenkins commented on pull request #29304: [SPARK-32494][SQL] Null Aware Anti Join Optimize Support Multi-Column

2020-07-30 Thread GitBox
AmplabJenkins commented on pull request #29304: URL: https://github.com/apache/spark/pull/29304#issuecomment-666889831 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29304: [SPARK-32494][SQL] Null Aware Anti Join Optimize Support Multi-Column

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #29304: URL: https://github.com/apache/spark/pull/29304#issuecomment-666889831 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] cloud-fan commented on pull request #29277: [SPARK-32421][SQL] Add code-gen for shuffled hash join

2020-07-30 Thread GitBox
cloud-fan commented on pull request #29277: URL: https://github.com/apache/spark/pull/29277#issuecomment-666889710 Regarding the comment from @viirya, I've one last comment: https://github.com/apache/spark/pull/29277#discussion_r463382990 Otherwise, I think it's good to go.

[GitHub] [spark] HyukjinKwon commented on a change in pull request #29067: [SPARK-32274][SQL] Make SQL cache serialization pluggable

2020-07-30 Thread GitBox
HyukjinKwon commented on a change in pull request #29067: URL: https://github.com/apache/spark/pull/29067#discussion_r463383396 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/columnar/ColumnStats.scala ## @@ -32,7 +32,7 @@ private[columnar] class

[GitHub] [spark] cloud-fan commented on a change in pull request #29277: [SPARK-32421][SQL] Add code-gen for shuffled hash join

2020-07-30 Thread GitBox
cloud-fan commented on a change in pull request #29277: URL: https://github.com/apache/spark/pull/29277#discussion_r463382990 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/WholeStageCodegenExec.scala ## @@ -903,6 +904,10 @@ case class

[GitHub] [spark] HyukjinKwon commented on pull request #29067: [SPARK-32274][SQL] Make SQL cache serialization pluggable

2020-07-30 Thread GitBox
HyukjinKwon commented on pull request #29067: URL: https://github.com/apache/spark/pull/29067#issuecomment-666889187 https://github.com/apache/spark/pull/29067#issuecomment-666462746, @revans2, there was a bit of unexpected test failures in GitHub Actions, and they are fixed now. The

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29303: [SPARK-32492][SQL] Fulfill missing column meta information for thriftserver client tools

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #29303: URL: https://github.com/apache/spark/pull/29303#issuecomment-666885517 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27507: [SPARK-24884][SQL] Support regexp function regexp_extract_all

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #27507: URL: https://github.com/apache/spark/pull/27507#issuecomment-666885572 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #27507: [SPARK-24884][SQL] Support regexp function regexp_extract_all

2020-07-30 Thread GitBox
AmplabJenkins commented on pull request #27507: URL: https://github.com/apache/spark/pull/27507#issuecomment-666885572 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29303: [SPARK-32492][SQL] Fulfill missing column meta information for thriftserver client tools

2020-07-30 Thread GitBox
AmplabJenkins commented on pull request #29303: URL: https://github.com/apache/spark/pull/29303#issuecomment-666885517 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] yaooqinn commented on pull request #29303: [SPARK-32492][SQL] Fulfill missing column meta information for thriftserver client tools

2020-07-30 Thread GitBox
yaooqinn commented on pull request #29303: URL: https://github.com/apache/spark/pull/29303#issuecomment-666884004 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29289: [SPARK-32482][SS][TESTS] Eliminate deprecated poll(long) API calls to avoid infinite wait in tests

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #29289: URL: https://github.com/apache/spark/pull/29289#issuecomment-666883248 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29146: [SPARK-32257][SQL] Reports explicit errors for invalid usage of SET/RESET command

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #29146: URL: https://github.com/apache/spark/pull/29146#issuecomment-666883260 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29146: [SPARK-32257][SQL] Reports explicit errors for invalid usage of SET/RESET command

2020-07-30 Thread GitBox
AmplabJenkins commented on pull request #29146: URL: https://github.com/apache/spark/pull/29146#issuecomment-666883260 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29289: [SPARK-32482][SS][TESTS] Eliminate deprecated poll(long) API calls to avoid infinite wait in tests

2020-07-30 Thread GitBox
AmplabJenkins commented on pull request #29289: URL: https://github.com/apache/spark/pull/29289#issuecomment-666883248 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] maropu commented on a change in pull request #29146: [SPARK-32257][SQL] Reports explicit errors for invalid usage of SET/RESET command

2020-07-30 Thread GitBox
maropu commented on a change in pull request #29146: URL: https://github.com/apache/spark/pull/29146#discussion_r463377564 ## File path: sql/core/src/test/scala/org/apache/spark/sql/SQLQuerySuite.scala ## @@ -962,8 +962,8 @@ class SQLQuerySuite extends QueryTest with

[GitHub] [spark] maropu commented on pull request #29146: [SPARK-32257][SQL] Reports explicit errors for invalid usage of SET/RESET command

2020-07-30 Thread GitBox
maropu commented on pull request #29146: URL: https://github.com/apache/spark/pull/29146#issuecomment-666882445 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] HeartSaVioR commented on pull request #29289: [SPARK-32482][SS][TESTS] Eliminate deprecated poll(long) API calls to avoid infinite wait in tests

2020-07-30 Thread GitBox
HeartSaVioR commented on pull request #29289: URL: https://github.com/apache/spark/pull/29289#issuecomment-666881087 retest this, please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29179: [WIP][SPARK-32381][CORE][SQL] Explore allowing parallel listing & non-location sensitive listing in core

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #29179: URL: https://github.com/apache/spark/pull/29179#issuecomment-666878825 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] HyukjinKwon commented on pull request #29272: [SPARK-32468][SS][TESTS] Fix timeout config issue in Kafka connector tests

2020-07-30 Thread GitBox
HyukjinKwon commented on pull request #29272: URL: https://github.com/apache/spark/pull/29272#issuecomment-666878829 @gaborgsomogyi can you sync with the master and rebase? then the GitHub Actions build should pass. Jenkins seems down for some reasons.

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29279: [SPARK-31418][CORE][FOLLOW-UP][MINOR] Fix log messages to print stage id instead of the object name

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #29279: URL: https://github.com/apache/spark/pull/29279#issuecomment-666878772 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29279: [SPARK-31418][CORE][FOLLOW-UP][MINOR] Fix log messages to print stage id instead of the object name

2020-07-30 Thread GitBox
AmplabJenkins commented on pull request #29279: URL: https://github.com/apache/spark/pull/29279#issuecomment-666878772 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29179: [WIP][SPARK-32381][CORE][SQL] Explore allowing parallel listing & non-location sensitive listing in core

2020-07-30 Thread GitBox
AmplabJenkins commented on pull request #29179: URL: https://github.com/apache/spark/pull/29179#issuecomment-666878825 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28902: [SPARK-31801][API][SHUFFLE][TESTS] Tests for registering map output metadata

2020-07-30 Thread GitBox
SparkQA commented on pull request #28902: URL: https://github.com/apache/spark/pull/28902#issuecomment-666878201 **[Test build #126834 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126834/testReport)** for PR 28902 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29067: [SPARK-32274][SQL] Make SQL cache serialization pluggable

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #29067: URL: https://github.com/apache/spark/pull/29067#issuecomment-666878070 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29067: [SPARK-32274][SQL] Make SQL cache serialization pluggable

2020-07-30 Thread GitBox
AmplabJenkins commented on pull request #29067: URL: https://github.com/apache/spark/pull/29067#issuecomment-666878061 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] HyukjinKwon commented on pull request #29279: [SPARK-31418][CORE][FOLLOW-UP][MINOR] Fix log messages to print stage id instead of the object name

2020-07-30 Thread GitBox
HyukjinKwon commented on pull request #29279: URL: https://github.com/apache/spark/pull/29279#issuecomment-666877973 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] HyukjinKwon commented on pull request #29299: [SPARK-32490][BUILD] Upgrade netty-all to 4.1.51.Final

2020-07-30 Thread GitBox
HyukjinKwon commented on pull request #29299: URL: https://github.com/apache/spark/pull/29299#issuecomment-666877501 @LuciferYang, can you sync and rebase? then the tests should pass in GitHub Actions. This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29303: [SPARK-32492][SQL] Fulfill missing column meta information for thriftserver client tools

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #29303: URL: https://github.com/apache/spark/pull/29303#issuecomment-666876471 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28781: [SPARK-31953][SS] Add Spark Structured Streaming History Server Support

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #28781: URL: https://github.com/apache/spark/pull/28781#issuecomment-666876537 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29297: [SPARK-32406][SQL][FOLLOWUP] Make RESET fail against static and core configs

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #29297: URL: https://github.com/apache/spark/pull/29297#issuecomment-666876549 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #29067: [SPARK-32274][SQL] Make SQL cache serialization pluggable

2020-07-30 Thread GitBox
SparkQA removed a comment on pull request #29067: URL: https://github.com/apache/spark/pull/29067#issuecomment-97587 **[Test build #126819 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126819/testReport)** for PR 29067 at commit

[GitHub] [spark] moomindani commented on pull request #27690: [SPARK-21514][SQL] Added a new option to use non-blobstore storage when writing into blobstore storage

2020-07-30 Thread GitBox
moomindani commented on pull request #27690: URL: https://github.com/apache/spark/pull/27690#issuecomment-666876575 @maropu I have tested the early version of this patch in EMR cluster. I did not have tested the latest version because EMR does not support Spark 3.0 yet. Can it be a

[GitHub] [spark] SparkQA commented on pull request #29067: [SPARK-32274][SQL] Make SQL cache serialization pluggable

2020-07-30 Thread GitBox
SparkQA commented on pull request #29067: URL: https://github.com/apache/spark/pull/29067#issuecomment-666876433 **[Test build #126819 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126819/testReport)** for PR 29067 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29303: [SPARK-32492][SQL] Fulfill missing column meta information for thriftserver client tools

2020-07-30 Thread GitBox
AmplabJenkins commented on pull request #29303: URL: https://github.com/apache/spark/pull/29303#issuecomment-666876471 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28781: [SPARK-31953][SS] Add Spark Structured Streaming History Server Support

2020-07-30 Thread GitBox
AmplabJenkins commented on pull request #28781: URL: https://github.com/apache/spark/pull/28781#issuecomment-666876537 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29297: [SPARK-32406][SQL][FOLLOWUP] Make RESET fail against static and core configs

2020-07-30 Thread GitBox
AmplabJenkins commented on pull request #29297: URL: https://github.com/apache/spark/pull/29297#issuecomment-666876549 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29310: [SPARK-32332][SQL][3.0] Support columnar exchanges

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #29310: URL: https://github.com/apache/spark/pull/29310#issuecomment-666876416 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29310: [SPARK-32332][SQL][3.0] Support columnar exchanges

2020-07-30 Thread GitBox
AmplabJenkins commented on pull request #29310: URL: https://github.com/apache/spark/pull/29310#issuecomment-666876416 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] uncleGen commented on pull request #28781: [SPARK-31953][SS] Add Spark Structured Streaming History Server Support

2020-07-30 Thread GitBox
uncleGen commented on pull request #28781: URL: https://github.com/apache/spark/pull/28781#issuecomment-666875388 retest this please. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29310: [SPARK-32332][SQL][3.0] Support columnar exchanges

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #29310: URL: https://github.com/apache/spark/pull/29310#issuecomment-55238 Can one of the admins verify this patch? This is an automated message from the Apache Git

[GitHub] [spark] HyukjinKwon commented on pull request #29310: [SPARK-32332][SQL][3.0] Support columnar exchanges

2020-07-30 Thread GitBox
HyukjinKwon commented on pull request #29310: URL: https://github.com/apache/spark/pull/29310#issuecomment-666874611 ok to test This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29291: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #29291: URL: https://github.com/apache/spark/pull/29291#issuecomment-666874098 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29291: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

2020-07-30 Thread GitBox
AmplabJenkins commented on pull request #29291: URL: https://github.com/apache/spark/pull/29291#issuecomment-666874098 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] manuzhang commented on a change in pull request #29307: [SPARK-32083][SQL] AQE coalesce should at least return one partition

2020-07-30 Thread GitBox
manuzhang commented on a change in pull request #29307: URL: https://github.com/apache/spark/pull/29307#discussion_r463369565 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/exchange/ShuffleExchangeExec.scala ## @@ -83,7 +83,12 @@ trait

[GitHub] [spark] beliefer commented on pull request #29291: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

2020-07-30 Thread GitBox
beliefer commented on pull request #29291: URL: https://github.com/apache/spark/pull/29291#issuecomment-666872737 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29272: [SPARK-32468][SS][TESTS] Fix timeout config issue in Kafka connector tests

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #29272: URL: https://github.com/apache/spark/pull/29272#issuecomment-666871930 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29299: [SPARK-32490][BUILD] Upgrade netty-all to 4.1.51.Final

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #29299: URL: https://github.com/apache/spark/pull/29299#issuecomment-666871892 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29299: [SPARK-32490][BUILD] Upgrade netty-all to 4.1.51.Final

2020-07-30 Thread GitBox
AmplabJenkins commented on pull request #29299: URL: https://github.com/apache/spark/pull/29299#issuecomment-666871892 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29272: [SPARK-32468][SS][TESTS] Fix timeout config issue in Kafka connector tests

2020-07-30 Thread GitBox
AmplabJenkins commented on pull request #29272: URL: https://github.com/apache/spark/pull/29272#issuecomment-666871930 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] yaooqinn commented on pull request #29303: [SPARK-32492][SQL] Fulfill missing column meta information for thriftserver client tools

2020-07-30 Thread GitBox
yaooqinn commented on pull request #29303: URL: https://github.com/apache/spark/pull/29303#issuecomment-666871499 I see, thanks, @HyukjinKwon. This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] HyukjinKwon commented on pull request #29303: [SPARK-32492][SQL] Fulfill missing column meta information for thriftserver client tools

2020-07-30 Thread GitBox
HyukjinKwon commented on pull request #29303: URL: https://github.com/apache/spark/pull/29303#issuecomment-666871141 @yaooqinn FYI to make the GitHub Actions tests pass, you might have to rebase. This is an automated

[GitHub] [spark] sarutak commented on pull request #29314: [FOLLOWUP][SPARK-32175] Remove flaky test added in SPARK-32175

2020-07-30 Thread GitBox
sarutak commented on pull request #29314: URL: https://github.com/apache/spark/pull/29314#issuecomment-666870698 Merged into `master` and `branch-3.0`. This is an automated message from the Apache Git Service. To respond to

<    1   2   3   4   5   6   7   8   >