[GitHub] [spark] dongjoon-hyun commented on a change in pull request #28761: [SPARK-25557][SQL] Nested column predicate pushdown for ORC

2020-08-07 Thread GitBox
dongjoon-hyun commented on a change in pull request #28761: URL: https://github.com/apache/spark/pull/28761#discussion_r466838962 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/orc/OrcFiltersBase.scala ## @@ -37,12 +40,45 @@ trait

[GitHub] [spark] cloud-fan commented on a change in pull request #29349: [SPARK-32528][SQL][TEST] The analyze method should make sure the plan is analyzed

2020-08-07 Thread GitBox
cloud-fan commented on a change in pull request #29349: URL: https://github.com/apache/spark/pull/29349#discussion_r466839267 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/FilterPushdownSuite.scala ## @@ -1149,75 +1149,60 @@ class

[GitHub] [spark] SparkQA removed a comment on pull request #29074: [SPARK-32282][SQL] Improve EnsureRquirement.reorderJoinKeys to handle more scenarios such as PartitioningCollection

2020-08-07 Thread GitBox
SparkQA removed a comment on pull request #29074: URL: https://github.com/apache/spark/pull/29074#issuecomment-670277622 **[Test build #127164 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127164/testReport)** for PR 29074 at commit

[GitHub] [spark] SparkQA commented on pull request #29074: [SPARK-32282][SQL] Improve EnsureRquirement.reorderJoinKeys to handle more scenarios such as PartitioningCollection

2020-08-07 Thread GitBox
SparkQA commented on pull request #29074: URL: https://github.com/apache/spark/pull/29074#issuecomment-670361513 **[Test build #127164 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127164/testReport)** for PR 29074 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29031: [SPARK-32216][SQL] Remove redundant ProjectExec

2020-08-07 Thread GitBox
AmplabJenkins removed a comment on pull request #29031: URL: https://github.com/apache/spark/pull/29031#issuecomment-670351444 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29369: [SPARK-32540][SQL] Eliminate the filter clause in aggregate

2020-08-07 Thread GitBox
AmplabJenkins removed a comment on pull request #29369: URL: https://github.com/apache/spark/pull/29369#issuecomment-670352976 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on pull request #29369: [SPARK-32540][SQL] Eliminate the filter clause in aggregate

2020-08-07 Thread GitBox
SparkQA removed a comment on pull request #29369: URL: https://github.com/apache/spark/pull/29369#issuecomment-670350664 **[Test build #127181 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127181/testReport)** for PR 29369 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29369: [SPARK-32540][SQL] Eliminate the filter clause in aggregate

2020-08-07 Thread GitBox
AmplabJenkins removed a comment on pull request #29369: URL: https://github.com/apache/spark/pull/29369#issuecomment-670352972 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29378: [SPARK-30069][CORE][YARN] Clean up non-shuffle disk block manager files following executor exists on YARN

2020-08-07 Thread GitBox
AmplabJenkins removed a comment on pull request #29378: URL: https://github.com/apache/spark/pull/29378#issuecomment-670358976 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] LuciferYang commented on pull request #29370: [SPARK-32526][SQL]Pass DataSourceV2AnalysisBaseSuite and TreeNodeSuite related test cases in scala 2.13

2020-08-07 Thread GitBox
LuciferYang commented on pull request #29370: URL: https://github.com/apache/spark/pull/29370#issuecomment-670359133 The main change of Address [beb3928](https://github.com/apache/spark/pull/29370/commits/beb3928397a81b2dd65d885b4e40e6e3c65376a3) is call `toMap` method of `Metadata#hash`

[GitHub] [spark] AmplabJenkins commented on pull request #29378: [SPARK-30069][CORE][YARN] Clean up non-shuffle disk block manager files following executor exists on YARN

2020-08-07 Thread GitBox
AmplabJenkins commented on pull request #29378: URL: https://github.com/apache/spark/pull/29378#issuecomment-670358976 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28761: [SPARK-25557][SQL] Nested column predicate pushdown for ORC

2020-08-07 Thread GitBox
SparkQA commented on pull request #28761: URL: https://github.com/apache/spark/pull/28761#issuecomment-670364668 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] SparkQA commented on pull request #29359: [SPARK-32537][SQL][TEST] Add a CTEHintSuite for test coverage

2020-08-07 Thread GitBox
SparkQA commented on pull request #29359: URL: https://github.com/apache/spark/pull/29359#issuecomment-670364665 **[Test build #127176 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127176/testReport)** for PR 29359 at commit

[GitHub] [spark] SparkQA commented on pull request #29339: [Spark-32512][SQL] add alter table add/drop partition command for datasourcev2

2020-08-07 Thread GitBox
SparkQA commented on pull request #29339: URL: https://github.com/apache/spark/pull/29339#issuecomment-670364666 **[Test build #127174 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127174/testReport)** for PR 29339 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29369: [SPARK-32540][SQL] Eliminate the filter clause in aggregate

2020-08-07 Thread GitBox
AmplabJenkins commented on pull request #29369: URL: https://github.com/apache/spark/pull/29369#issuecomment-670364691 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29366: [SPARK-32550][SQL] Make SpecificInternalRow constructors faster by using while loops instead of maps

2020-08-07 Thread GitBox
SparkQA commented on pull request #29366: URL: https://github.com/apache/spark/pull/29366#issuecomment-670364670 **[Test build #127171 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127171/testReport)** for PR 29366 at commit

[GitHub] [spark] SparkQA commented on pull request #29376: [SPARK-32560][SQL]Improve exception message at InsertIntoHiveTable.processInsert

2020-08-07 Thread GitBox
SparkQA commented on pull request #29376: URL: https://github.com/apache/spark/pull/29376#issuecomment-670364673 **[Test build #127175 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127175/testReport)** for PR 29376 at commit

[GitHub] [spark] SparkQA commented on pull request #29369: [SPARK-32540][SQL] Eliminate the filter clause in aggregate

2020-08-07 Thread GitBox
SparkQA commented on pull request #29369: URL: https://github.com/apache/spark/pull/29369#issuecomment-670364669 **[Test build #127184 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127184/testReport)** for PR 29369 at commit

[GitHub] [spark] SparkQA commented on pull request #29372: [SPARK-32555][SQL] Add unique ID on query execution

2020-08-07 Thread GitBox
SparkQA commented on pull request #29372: URL: https://github.com/apache/spark/pull/29372#issuecomment-670364671 **[Test build #127172 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127172/testReport)** for PR 29372 at commit

[GitHub] [spark] LantaoJin commented on pull request #29378: [SPARK-30069][CORE][YARN] Clean up non-shuffle disk block manager files following executor exists on YARN

2020-08-07 Thread GitBox
LantaoJin commented on pull request #29378: URL: https://github.com/apache/spark/pull/29378#issuecomment-670367139 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] SparkQA commented on pull request #29370: [SPARK-32526][SQL]Pass DataSourceV2AnalysisBaseSuite and TreeNodeSuite related test cases in scala 2.13

2020-08-07 Thread GitBox
SparkQA commented on pull request #29370: URL: https://github.com/apache/spark/pull/29370#issuecomment-670380804 **[Test build #127188 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127188/testReport)** for PR 29370 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29360: [SPARK-32542][SQL]Add a Batch in Optimizer to improve performance in multidimensional analysis

2020-08-07 Thread GitBox
SparkQA removed a comment on pull request #29360: URL: https://github.com/apache/spark/pull/29360#issuecomment-670384159 **[Test build #127189 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127189/testReport)** for PR 29360 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29360: [SPARK-32542][SQL]Add a Batch in Optimizer to improve performance in multidimensional analysis

2020-08-07 Thread GitBox
AmplabJenkins removed a comment on pull request #29360: URL: https://github.com/apache/spark/pull/29360#issuecomment-670384881 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29360: [SPARK-32542][SQL]Add a Batch in Optimizer to improve performance in multidimensional analysis

2020-08-07 Thread GitBox
AmplabJenkins removed a comment on pull request #29360: URL: https://github.com/apache/spark/pull/29360#issuecomment-670384890 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] dongjoon-hyun commented on pull request #28761: [SPARK-25557][SQL] Nested column predicate pushdown for ORC

2020-08-07 Thread GitBox
dongjoon-hyun commented on pull request #28761: URL: https://github.com/apache/spark/pull/28761#issuecomment-670345645 Yes, @viirya . For that one, let's do later in another PR. This is an automated message from the Apache

[GitHub] [spark] cloud-fan commented on a change in pull request #29349: [SPARK-32528][SQL][TEST] The analyze method should make sure the plan is analyzed

2020-08-07 Thread GitBox
cloud-fan commented on a change in pull request #29349: URL: https://github.com/apache/spark/pull/29349#discussion_r466840447 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/PullupCorrelatedPredicatesSuite.scala ## @@ -91,9 +91,8 @@ class

[GitHub] [spark] cloud-fan commented on a change in pull request #29349: [SPARK-32528][SQL][TEST] The analyze method should make sure the plan is analyzed

2020-08-07 Thread GitBox
cloud-fan commented on a change in pull request #29349: URL: https://github.com/apache/spark/pull/29349#discussion_r466840696 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/SimplifyCastsSuite.scala ## @@ -42,7 +42,8 @@ class

[GitHub] [spark] viirya commented on a change in pull request #29349: [SPARK-32528][SQL][TEST] The analyze method should make sure the plan is analyzed

2020-08-07 Thread GitBox
viirya commented on a change in pull request #29349: URL: https://github.com/apache/spark/pull/29349#discussion_r466845295 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/BinaryComparisonSimplificationSuite.scala ## @@ -119,9 +119,7 @@ class

[GitHub] [spark] SparkQA commented on pull request #29031: [SPARK-32216][SQL] Remove redundant ProjectExec

2020-08-07 Thread GitBox
SparkQA commented on pull request #29031: URL: https://github.com/apache/spark/pull/29031#issuecomment-670350252 **[Test build #127163 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127163/testReport)** for PR 29031 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29360: [SPARK-32542][SQL]Add a Batch in Optimizer to improve performance in multidimensional analysis

2020-08-07 Thread GitBox
SparkQA removed a comment on pull request #29360: URL: https://github.com/apache/spark/pull/29360#issuecomment-670338755 **[Test build #127178 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127178/testReport)** for PR 29360 at commit

[GitHub] [spark] SparkQA commented on pull request #28761: [SPARK-25557][SQL] Nested column predicate pushdown for ORC

2020-08-07 Thread GitBox
SparkQA commented on pull request #28761: URL: https://github.com/apache/spark/pull/28761#issuecomment-670350676 **[Test build #127182 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127182/testReport)** for PR 28761 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29031: [SPARK-32216][SQL] Remove redundant ProjectExec

2020-08-07 Thread GitBox
SparkQA removed a comment on pull request #29031: URL: https://github.com/apache/spark/pull/29031#issuecomment-670275716 **[Test build #127163 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127163/testReport)** for PR 29031 at commit

[GitHub] [spark] SparkQA commented on pull request #29369: [SPARK-32540][SQL] Eliminate the filter clause in aggregate

2020-08-07 Thread GitBox
SparkQA commented on pull request #29369: URL: https://github.com/apache/spark/pull/29369#issuecomment-670350664 **[Test build #127181 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127181/testReport)** for PR 29369 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29360: [SPARK-32542][SQL]Add a Batch in Optimizer to improve performance in multidimensional analysis

2020-08-07 Thread GitBox
AmplabJenkins removed a comment on pull request #29360: URL: https://github.com/apache/spark/pull/29360#issuecomment-670350289 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #29360: [SPARK-32542][SQL]Add a Batch in Optimizer to improve performance in multidimensional analysis

2020-08-07 Thread GitBox
SparkQA commented on pull request #29360: URL: https://github.com/apache/spark/pull/29360#issuecomment-670350139 **[Test build #127178 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127178/testReport)** for PR 29360 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29360: [SPARK-32542][SQL]Add a Batch in Optimizer to improve performance in multidimensional analysis

2020-08-07 Thread GitBox
AmplabJenkins commented on pull request #29360: URL: https://github.com/apache/spark/pull/29360#issuecomment-670350289 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29359: [SPARK-32537][SQL][TEST] Add a CTEHintSuite for test coverage

2020-08-07 Thread GitBox
SparkQA commented on pull request #29359: URL: https://github.com/apache/spark/pull/29359#issuecomment-670368548 **[Test build #127187 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127187/testReport)** for PR 29359 at commit

[GitHub] [spark] SparkQA commented on pull request #29369: [SPARK-32540][SQL] Eliminate the filter clause in aggregate

2020-08-07 Thread GitBox
SparkQA commented on pull request #29369: URL: https://github.com/apache/spark/pull/29369#issuecomment-670368515 **[Test build #127186 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127186/testReport)** for PR 29369 at commit

[GitHub] [spark] SparkQA commented on pull request #29378: [SPARK-30069][CORE][YARN] Clean up non-shuffle disk block manager files following executor exists on YARN

2020-08-07 Thread GitBox
SparkQA commented on pull request #29378: URL: https://github.com/apache/spark/pull/29378#issuecomment-670368482 **[Test build #127185 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127185/testReport)** for PR 29378 at commit

[GitHub] [spark] SparkQA commented on pull request #29360: [SPARK-32542][SQL]Add a Batch in Optimizer to improve performance in multidimensional analysis

2020-08-07 Thread GitBox
SparkQA commented on pull request #29360: URL: https://github.com/apache/spark/pull/29360#issuecomment-670384862 **[Test build #127189 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127189/testReport)** for PR 29360 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29360: [SPARK-32542][SQL]Add a Batch in Optimizer to improve performance in multidimensional analysis

2020-08-07 Thread GitBox
AmplabJenkins commented on pull request #29360: URL: https://github.com/apache/spark/pull/29360#issuecomment-670384881 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] ScrapCodes closed pull request #29371: [SPARK-32556][INFRA][2.4] Fix release script to URL encode the user provided passwords.

2020-08-07 Thread GitBox
ScrapCodes closed pull request #29371: URL: https://github.com/apache/spark/pull/29371 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [spark] SparkQA commented on pull request #29369: [SPARK-32540][SQL] Eliminate the filter clause in aggregate

2020-08-07 Thread GitBox
SparkQA commented on pull request #29369: URL: https://github.com/apache/spark/pull/29369#issuecomment-670352950 **[Test build #127181 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127181/testReport)** for PR 29369 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29369: [SPARK-32540][SQL] Eliminate the filter clause in aggregate

2020-08-07 Thread GitBox
AmplabJenkins commented on pull request #29369: URL: https://github.com/apache/spark/pull/29369#issuecomment-670352972 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29378: [SPARK-30069][CORE][YARN] Clean up non-shuffle disk block manager files following executor exists on YARN

2020-08-07 Thread GitBox
SparkQA commented on pull request #29378: URL: https://github.com/apache/spark/pull/29378#issuecomment-670358613 **[Test build #127183 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127183/testReport)** for PR 29378 at commit

[GitHub] [spark] LuciferYang edited a comment on pull request #29370: [SPARK-32526][SQL]Pass DataSourceV2AnalysisBaseSuite and TreeNodeSuite related test cases in scala 2.13

2020-08-07 Thread GitBox
LuciferYang edited a comment on pull request #29370: URL: https://github.com/apache/spark/pull/29370#issuecomment-670359133 The main change of Address [beb3928](https://github.com/apache/spark/pull/29370/commits/beb3928397a81b2dd65d885b4e40e6e3c65376a3) is call `toMap` method of

[GitHub] [spark] cloud-fan closed pull request #29349: [SPARK-32528][SQL][TEST] The analyze method should make sure the plan is analyzed

2020-08-07 Thread GitBox
cloud-fan closed pull request #29349: URL: https://github.com/apache/spark/pull/29349 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [spark] cloud-fan commented on pull request #29349: [SPARK-32528][SQL][TEST] The analyze method should make sure the plan is analyzed

2020-08-07 Thread GitBox
cloud-fan commented on pull request #29349: URL: https://github.com/apache/spark/pull/29349#issuecomment-670376676 thanks for review, merging to master! This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] viirya commented on a change in pull request #29349: [SPARK-32528][SQL][TEST] The analyze method should make sure the plan is analyzed

2020-08-07 Thread GitBox
viirya commented on a change in pull request #29349: URL: https://github.com/apache/spark/pull/29349#discussion_r466839916 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/dsl/package.scala ## @@ -418,8 +418,11 @@ package object dsl { def

[GitHub] [spark] cloud-fan commented on a change in pull request #29349: [SPARK-32528][SQL][TEST] The analyze method should make sure the plan is analyzed

2020-08-07 Thread GitBox
cloud-fan commented on a change in pull request #29349: URL: https://github.com/apache/spark/pull/29349#discussion_r466840338 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/JoinReorderSuite.scala ## @@ -307,9 +307,9 @@ class JoinReorderSuite

[GitHub] [spark] cloud-fan commented on a change in pull request #29349: [SPARK-32528][SQL][TEST] The analyze method should make sure the plan is analyzed

2020-08-07 Thread GitBox
cloud-fan commented on a change in pull request #29349: URL: https://github.com/apache/spark/pull/29349#discussion_r466839986 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/BinaryComparisonSimplificationSuite.scala ## @@ -119,9 +119,7 @@

[GitHub] [spark] cloud-fan commented on a change in pull request #29349: [SPARK-32528][SQL][TEST] The analyze method should make sure the plan is analyzed

2020-08-07 Thread GitBox
cloud-fan commented on a change in pull request #29349: URL: https://github.com/apache/spark/pull/29349#discussion_r466840097 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/FilterPushdownSuite.scala ## @@ -1149,75 +1149,60 @@ class

[GitHub] [spark] viirya commented on a change in pull request #28761: [SPARK-25557][SQL] Nested column predicate pushdown for ORC

2020-08-07 Thread GitBox
viirya commented on a change in pull request #28761: URL: https://github.com/apache/spark/pull/28761#discussion_r466843235 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/orc/OrcFiltersBase.scala ## @@ -37,12 +40,45 @@ trait OrcFiltersBase {

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29369: [SPARK-32540][SQL] Eliminate the filter clause in aggregate

2020-08-07 Thread GitBox
AmplabJenkins removed a comment on pull request #29369: URL: https://github.com/apache/spark/pull/29369#issuecomment-670351028 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29360: [SPARK-32542][SQL]Add a Batch in Optimizer to improve performance in multidimensional analysis

2020-08-07 Thread GitBox
AmplabJenkins removed a comment on pull request #29360: URL: https://github.com/apache/spark/pull/29360#issuecomment-670350295 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28761: [SPARK-25557][SQL] Nested column predicate pushdown for ORC

2020-08-07 Thread GitBox
AmplabJenkins removed a comment on pull request #28761: URL: https://github.com/apache/spark/pull/28761#issuecomment-670351122 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29369: [SPARK-32540][SQL] Eliminate the filter clause in aggregate

2020-08-07 Thread GitBox
AmplabJenkins commented on pull request #29369: URL: https://github.com/apache/spark/pull/29369#issuecomment-670351028 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28761: [SPARK-25557][SQL] Nested column predicate pushdown for ORC

2020-08-07 Thread GitBox
AmplabJenkins commented on pull request #28761: URL: https://github.com/apache/spark/pull/28761#issuecomment-670351122 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29031: [SPARK-32216][SQL] Remove redundant ProjectExec

2020-08-07 Thread GitBox
AmplabJenkins commented on pull request #29031: URL: https://github.com/apache/spark/pull/29031#issuecomment-670351444 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29369: [SPARK-32540][SQL] Eliminate the filter clause in aggregate

2020-08-07 Thread GitBox
AmplabJenkins removed a comment on pull request #29369: URL: https://github.com/apache/spark/pull/29369#issuecomment-670362649 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] LuciferYang edited a comment on pull request #29370: [SPARK-32526][SQL]Pass DataSourceV2AnalysisBaseSuite and TreeNodeSuite related test cases in scala 2.13

2020-08-07 Thread GitBox
LuciferYang edited a comment on pull request #29370: URL: https://github.com/apache/spark/pull/29370#issuecomment-670359133 The main change of Address [beb3928](https://github.com/apache/spark/pull/29370/commits/beb3928397a81b2dd65d885b4e40e6e3c65376a3) is call `toMap` method of

[GitHub] [spark] SparkQA commented on pull request #29369: [SPARK-32540][SQL] Eliminate the filter clause in aggregate

2020-08-07 Thread GitBox
SparkQA commented on pull request #29369: URL: https://github.com/apache/spark/pull/29369#issuecomment-670362167 **[Test build #127184 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127184/testReport)** for PR 29369 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29369: [SPARK-32540][SQL] Eliminate the filter clause in aggregate

2020-08-07 Thread GitBox
AmplabJenkins commented on pull request #29369: URL: https://github.com/apache/spark/pull/29369#issuecomment-670362649 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29359: [SPARK-32537][SQL][TEST] Add a CTEHintSuite for test coverage

2020-08-07 Thread GitBox
AmplabJenkins commented on pull request #29359: URL: https://github.com/apache/spark/pull/29359#issuecomment-670369069 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29378: [SPARK-30069][CORE][YARN] Clean up non-shuffle disk block manager files following executor exists on YARN

2020-08-07 Thread GitBox
AmplabJenkins commented on pull request #29378: URL: https://github.com/apache/spark/pull/29378#issuecomment-670369083 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29359: [SPARK-32537][SQL][TEST] Add a CTEHintSuite for test coverage

2020-08-07 Thread GitBox
AmplabJenkins removed a comment on pull request #29359: URL: https://github.com/apache/spark/pull/29359#issuecomment-670369069 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29378: [SPARK-30069][CORE][YARN] Clean up non-shuffle disk block manager files following executor exists on YARN

2020-08-07 Thread GitBox
AmplabJenkins removed a comment on pull request #29378: URL: https://github.com/apache/spark/pull/29378#issuecomment-670369083 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29370: [SPARK-32526][SQL]Pass DataSourceV2AnalysisBaseSuite and TreeNodeSuite related test cases in scala 2.13

2020-08-07 Thread GitBox
AmplabJenkins removed a comment on pull request #29370: URL: https://github.com/apache/spark/pull/29370#issuecomment-670381323 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29360: [SPARK-32542][SQL]Add a Batch in Optimizer to improve performance in multidimensional analysis

2020-08-07 Thread GitBox
AmplabJenkins removed a comment on pull request #29360: URL: https://github.com/apache/spark/pull/29360#issuecomment-670381299 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29370: [SPARK-32526][SQL]Pass DataSourceV2AnalysisBaseSuite and TreeNodeSuite related test cases in scala 2.13

2020-08-07 Thread GitBox
AmplabJenkins commented on pull request #29370: URL: https://github.com/apache/spark/pull/29370#issuecomment-670381323 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29360: [SPARK-32542][SQL]Add a Batch in Optimizer to improve performance in multidimensional analysis

2020-08-07 Thread GitBox
AmplabJenkins commented on pull request #29360: URL: https://github.com/apache/spark/pull/29360#issuecomment-670381299 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] LuciferYang commented on pull request #29370: [SPARK-32526][SQL]Pass DataSourceV2AnalysisBaseSuite and TreeNodeSuite related test cases in scala 2.13

2020-08-07 Thread GitBox
LuciferYang commented on pull request #29370: URL: https://github.com/apache/spark/pull/29370#issuecomment-670381199 The main change of Address [eeeb28a](https://github.com/apache/spark/pull/29370/commits/eeeb28a15b9047f16049f0f1cecf97dbf6ab3562) impl `contact` method of `ExpressionSet`

[GitHub] [spark] WangGuangxin commented on pull request #29375: [SPARK-32559][SQL]Fix the trim logic in UTF8String.toInt/toLong did't handle non-ASCII characters correctly

2020-08-07 Thread GitBox
WangGuangxin commented on pull request #29375: URL: https://github.com/apache/spark/pull/29375#issuecomment-670381219 > @WangGuangxin can you open a backport PR for 3.0? sure This is an automated message from the

[GitHub] [spark] cloud-fan commented on pull request #29339: [Spark-32512][SQL] add alter table add/drop partition command for datasourcev2

2020-08-07 Thread GitBox
cloud-fan commented on pull request #29339: URL: https://github.com/apache/spark/pull/29339#issuecomment-670387131 I think the API is validated now, let's go back to review #28617. This is an automated message from the

[GitHub] [spark] ScrapCodes commented on pull request #29368: [SPARK-32554][K8S][DOCS] Update the k8s document according to the current development status

2020-08-07 Thread GitBox
ScrapCodes commented on pull request #29368: URL: https://github.com/apache/spark/pull/29368#issuecomment-670346087 I had say, it should be discussed, we would like to hear from the users. Do we have enough confidence, for example if it is already in use at some company X at a production

[GitHub] [spark] SparkQA commented on pull request #29360: [SPARK-32542][SQL]Add a Batch in Optimizer to improve performance in multidimensional analysis

2020-08-07 Thread GitBox
SparkQA commented on pull request #29360: URL: https://github.com/apache/spark/pull/29360#issuecomment-670384159 **[Test build #127189 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127189/testReport)** for PR 29360 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29074: [SPARK-32282][SQL] Improve EnsureRquirement.reorderJoinKeys to handle more scenarios such as PartitioningCollection

2020-08-07 Thread GitBox
AmplabJenkins removed a comment on pull request #29074: URL: https://github.com/apache/spark/pull/29074#issuecomment-670363348 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29074: [SPARK-32282][SQL] Improve EnsureRquirement.reorderJoinKeys to handle more scenarios such as PartitioningCollection

2020-08-07 Thread GitBox
AmplabJenkins commented on pull request #29074: URL: https://github.com/apache/spark/pull/29074#issuecomment-670363348 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #29382: [WIP][SPARK-32540][SQL] Eliminate filter clause test

2020-08-07 Thread GitBox
SparkQA removed a comment on pull request #29382: URL: https://github.com/apache/spark/pull/29382#issuecomment-670291428 **[Test build #127167 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127167/testReport)** for PR 29382 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29378: [SPARK-30069][CORE][YARN] Clean up non-shuffle disk block manager files following executor exists on YARN

2020-08-07 Thread GitBox
AmplabJenkins commented on pull request #29378: URL: https://github.com/apache/spark/pull/29378#issuecomment-670364745 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29339: [Spark-32512][SQL] add alter table add/drop partition command for datasourcev2

2020-08-07 Thread GitBox
AmplabJenkins removed a comment on pull request #29339: URL: https://github.com/apache/spark/pull/29339#issuecomment-670365106 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29366: [SPARK-32550][SQL] Make SpecificInternalRow constructors faster by using while loops instead of maps

2020-08-07 Thread GitBox
AmplabJenkins removed a comment on pull request #29366: URL: https://github.com/apache/spark/pull/29366#issuecomment-670365130 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #29339: [Spark-32512][SQL] add alter table add/drop partition command for datasourcev2

2020-08-07 Thread GitBox
SparkQA removed a comment on pull request #29339: URL: https://github.com/apache/spark/pull/29339#issuecomment-670303402 **[Test build #127174 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127174/testReport)** for PR 29339 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29366: [SPARK-32550][SQL] Make SpecificInternalRow constructors faster by using while loops instead of maps

2020-08-07 Thread GitBox
SparkQA removed a comment on pull request #29366: URL: https://github.com/apache/spark/pull/29366#issuecomment-670297510 **[Test build #127171 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127171/testReport)** for PR 29366 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29382: [WIP][SPARK-32540][SQL] Eliminate filter clause test

2020-08-07 Thread GitBox
AmplabJenkins commented on pull request #29382: URL: https://github.com/apache/spark/pull/29382#issuecomment-670365331 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29376: [SPARK-32560][SQL]Improve exception message at InsertIntoHiveTable.processInsert

2020-08-07 Thread GitBox
AmplabJenkins removed a comment on pull request #29376: URL: https://github.com/apache/spark/pull/29376#issuecomment-670365364 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] LantaoJin commented on pull request #29359: [SPARK-32537][SQL][TEST] Add a CTEHintSuite for test coverage

2020-08-07 Thread GitBox
LantaoJin commented on pull request #29359: URL: https://github.com/apache/spark/pull/29359#issuecomment-670367525 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins commented on pull request #29370: [SPARK-32526][SQL]Pass DataSourceV2AnalysisBaseSuite and TreeNodeSuite related test cases in scala 2.13

2020-08-07 Thread GitBox
AmplabJenkins commented on pull request #29370: URL: https://github.com/apache/spark/pull/29370#issuecomment-670365030 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29366: [SPARK-32550][SQL] Make SpecificInternalRow constructors faster by using while loops instead of maps

2020-08-07 Thread GitBox
AmplabJenkins commented on pull request #29366: URL: https://github.com/apache/spark/pull/29366#issuecomment-670365130 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #29378: [SPARK-30069][CORE][YARN] Clean up non-shuffle disk block manager files following executor exists on YARN

2020-08-07 Thread GitBox
SparkQA removed a comment on pull request #29378: URL: https://github.com/apache/spark/pull/29378#issuecomment-670358613 **[Test build #127183 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127183/testReport)** for PR 29378 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29372: [SPARK-32555][SQL] Add unique ID on query execution

2020-08-07 Thread GitBox
AmplabJenkins commented on pull request #29372: URL: https://github.com/apache/spark/pull/29372#issuecomment-670365470 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29376: [SPARK-32560][SQL]Improve exception message at InsertIntoHiveTable.processInsert

2020-08-07 Thread GitBox
AmplabJenkins commented on pull request #29376: URL: https://github.com/apache/spark/pull/29376#issuecomment-670365364 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29359: [SPARK-32537][SQL][TEST] Add a CTEHintSuite for test coverage

2020-08-07 Thread GitBox
AmplabJenkins commented on pull request #29359: URL: https://github.com/apache/spark/pull/29359#issuecomment-670364861 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29378: [SPARK-30069][CORE][YARN] Clean up non-shuffle disk block manager files following executor exists on YARN

2020-08-07 Thread GitBox
AmplabJenkins removed a comment on pull request #29378: URL: https://github.com/apache/spark/pull/29378#issuecomment-670364745 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #28761: [SPARK-25557][SQL] Nested column predicate pushdown for ORC

2020-08-07 Thread GitBox
SparkQA removed a comment on pull request #28761: URL: https://github.com/apache/spark/pull/28761#issuecomment-670340959 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28761: [SPARK-25557][SQL] Nested column predicate pushdown for ORC

2020-08-07 Thread GitBox
AmplabJenkins commented on pull request #28761: URL: https://github.com/apache/spark/pull/28761#issuecomment-670364864 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29382: [WIP][SPARK-32540][SQL] Eliminate filter clause test

2020-08-07 Thread GitBox
AmplabJenkins removed a comment on pull request #29382: URL: https://github.com/apache/spark/pull/29382#issuecomment-670365331 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29339: [Spark-32512][SQL] add alter table add/drop partition command for datasourcev2

2020-08-07 Thread GitBox
AmplabJenkins commented on pull request #29339: URL: https://github.com/apache/spark/pull/29339#issuecomment-670365106 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29372: [SPARK-32555][SQL] Add unique ID on query execution

2020-08-07 Thread GitBox
AmplabJenkins removed a comment on pull request #29372: URL: https://github.com/apache/spark/pull/29372#issuecomment-670365470 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #29376: [SPARK-32560][SQL]Improve exception message at InsertIntoHiveTable.processInsert

2020-08-07 Thread GitBox
SparkQA removed a comment on pull request #29376: URL: https://github.com/apache/spark/pull/29376#issuecomment-670320987 **[Test build #127175 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127175/testReport)** for PR 29376 at commit

  1   2   3   4   5   >