[GitHub] [spark] viirya commented on pull request #29107: [SPARK-32308][SQL] Move by-name resolution logic of unionByName from API code to analysis phase

2020-07-22 Thread GitBox
viirya commented on pull request #29107: URL: https://github.com/apache/spark/pull/29107#issuecomment-662285441 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] yaooqinn commented on pull request #29183: [SPARK-21117][SQL][FOLLOWUP] Define prettyName for WidthBucket

2020-07-22 Thread GitBox
yaooqinn commented on pull request #29183: URL: https://github.com/apache/spark/pull/29183#issuecomment-662285297 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] yaooqinn opened a new pull request #29184: [MINOR][SQL] Fix warning message for ThriftCLIService.GetCrossReference and GetPrimaryKeys

2020-07-22 Thread GitBox
yaooqinn opened a new pull request #29184: URL: https://github.com/apache/spark/pull/29184 ### What changes were proposed in this pull request? This PR fixes the warning message for ThriftCLIService.GetCrossReference and GetPrimaryKeys ### Why are the changes

[GitHub] [spark] yaooqinn commented on pull request #29184: [MINOR][SQL] Fix warning message for ThriftCLIService.GetCrossReference and GetPrimaryKeys

2020-07-22 Thread GitBox
yaooqinn commented on pull request #29184: URL: https://github.com/apache/spark/pull/29184#issuecomment-662285046 cc @cloud-fan @maropu @wangyum thanks. This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29021: [SPARK-32201][SQL] More general skew join pattern matching

2020-07-22 Thread GitBox
AmplabJenkins removed a comment on pull request #29021: URL: https://github.com/apache/spark/pull/29021#issuecomment-662283002 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29021: [SPARK-32201][SQL] More general skew join pattern matching

2020-07-22 Thread GitBox
AmplabJenkins removed a comment on pull request #29021: URL: https://github.com/apache/spark/pull/29021#issuecomment-662282992 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AngersZhuuuu commented on pull request #29085: [SPARK-32106][SQL]Implement SparkScriptTransformationExec in sql/core

2020-07-22 Thread GitBox
AngersZh commented on pull request #29085: URL: https://github.com/apache/spark/pull/29085#issuecomment-662283426 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29182: [SPARK-32003][CORE][2.4] When external shuffle service is used, unregister outputs for executor on fetch failure after executor

2020-07-22 Thread GitBox
AmplabJenkins removed a comment on pull request #29182: URL: https://github.com/apache/spark/pull/29182#issuecomment-662282926 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29032: [SPARK-32217] Plumb whether a worker would also be decommissioned along with executor

2020-07-22 Thread GitBox
AmplabJenkins removed a comment on pull request #29032: URL: https://github.com/apache/spark/pull/29032#issuecomment-662282707 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29183: [SPARK-21117][SQL][FOLLOWUP] Define prettyName for WidthBucket

2020-07-22 Thread GitBox
AmplabJenkins removed a comment on pull request #29183: URL: https://github.com/apache/spark/pull/29183#issuecomment-662282302 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort plans

2020-07-22 Thread GitBox
AmplabJenkins removed a comment on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-662282432 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29145: [SPARK-32346][SQL] Support filters pushdown in Avro datasource

2020-07-22 Thread GitBox
AmplabJenkins removed a comment on pull request #29145: URL: https://github.com/apache/spark/pull/29145#issuecomment-662282290 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29159: [SPARK-32310][ML][PySpark][3.0] ML params default value parity

2020-07-22 Thread GitBox
AmplabJenkins removed a comment on pull request #29159: URL: https://github.com/apache/spark/pull/29159#issuecomment-662282335 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29032: [SPARK-32217] Plumb whether a worker would also be decommissioned along with executor

2020-07-22 Thread GitBox
AmplabJenkins removed a comment on pull request #29032: URL: https://github.com/apache/spark/pull/29032#issuecomment-662282701 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29021: [SPARK-32201][SQL] More general skew join pattern matching

2020-07-22 Thread GitBox
AmplabJenkins commented on pull request #29021: URL: https://github.com/apache/spark/pull/29021#issuecomment-662282992 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29153: [SPARK-32310][ML][PySpark] ML params default value parity in feature and tuning

2020-07-22 Thread GitBox
AmplabJenkins removed a comment on pull request #29153: URL: https://github.com/apache/spark/pull/29153#issuecomment-662282237 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29085: [SPARK-32106][SQL]Implement SparkScriptTransformationExec in sql/core

2020-07-22 Thread GitBox
AmplabJenkins removed a comment on pull request #29085: URL: https://github.com/apache/spark/pull/29085#issuecomment-662282306 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29182: [SPARK-32003][CORE][2.4] When external shuffle service is used, unregister outputs for executor on fetch failure after executor

2020-07-22 Thread GitBox
AmplabJenkins removed a comment on pull request #29182: URL: https://github.com/apache/spark/pull/29182#issuecomment-662282919 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29107: [SPARK-32308][SQL] Move by-name resolution logic of unionByName from API code to analysis phase

2020-07-22 Thread GitBox
AmplabJenkins removed a comment on pull request #29107: URL: https://github.com/apache/spark/pull/29107#issuecomment-662282455 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29014: [SPARK-32199][SPARK-32198] Reduce job failures during decommissioning

2020-07-22 Thread GitBox
AmplabJenkins removed a comment on pull request #29014: URL: https://github.com/apache/spark/pull/29014#issuecomment-662282584 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on pull request #29159: [SPARK-32310][ML][PySpark][3.0] ML params default value parity

2020-07-22 Thread GitBox
SparkQA removed a comment on pull request #29159: URL: https://github.com/apache/spark/pull/29159#issuecomment-662265763 **[Test build #126304 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126304/testReport)** for PR 29159 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort plans

2020-07-22 Thread GitBox
SparkQA removed a comment on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-662240866 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29183: [SPARK-21117][SQL][FOLLOWUP] Define prettyName for WidthBucket

2020-07-22 Thread GitBox
AmplabJenkins removed a comment on pull request #29183: URL: https://github.com/apache/spark/pull/29183#issuecomment-662282292 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29085: [SPARK-32106][SQL]Implement SparkScriptTransformationExec in sql/core

2020-07-22 Thread GitBox
AmplabJenkins removed a comment on pull request #29085: URL: https://github.com/apache/spark/pull/29085#issuecomment-662282255 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29145: [SPARK-32346][SQL] Support filters pushdown in Avro datasource

2020-07-22 Thread GitBox
AmplabJenkins removed a comment on pull request #29145: URL: https://github.com/apache/spark/pull/29145#issuecomment-662282286 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29153: [SPARK-32310][ML][PySpark] ML params default value parity in feature and tuning

2020-07-22 Thread GitBox
AmplabJenkins removed a comment on pull request #29153: URL: https://github.com/apache/spark/pull/29153#issuecomment-662282224 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29032: [SPARK-32217] Plumb whether a worker would also be decommissioned along with executor

2020-07-22 Thread GitBox
AmplabJenkins commented on pull request #29032: URL: https://github.com/apache/spark/pull/29032#issuecomment-662282701 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort plans

2020-07-22 Thread GitBox
AmplabJenkins removed a comment on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-662282323 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #29153: [SPARK-32310][ML][PySpark] ML params default value parity in feature and tuning

2020-07-22 Thread GitBox
SparkQA removed a comment on pull request #29153: URL: https://github.com/apache/spark/pull/29153#issuecomment-662271131 **[Test build #126307 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126307/testReport)** for PR 29153 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29032: [SPARK-32217] Plumb whether a worker would also be decommissioned along with executor

2020-07-22 Thread GitBox
SparkQA removed a comment on pull request #29032: URL: https://github.com/apache/spark/pull/29032#issuecomment-662253416 **[Test build #126301 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126301/testReport)** for PR 29032 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29182: [SPARK-32003][CORE][2.4] When external shuffle service is used, unregister outputs for executor on fetch failure after executor is lo

2020-07-22 Thread GitBox
SparkQA removed a comment on pull request #29182: URL: https://github.com/apache/spark/pull/29182#issuecomment-662246904 **[Test build #126299 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126299/testReport)** for PR 29182 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29159: [SPARK-32310][ML][PySpark][3.0] ML params default value parity

2020-07-22 Thread GitBox
AmplabJenkins removed a comment on pull request #29159: URL: https://github.com/apache/spark/pull/29159#issuecomment-662282326 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #29021: [SPARK-32201][SQL] More general skew join pattern matching

2020-07-22 Thread GitBox
SparkQA removed a comment on pull request #29021: URL: https://github.com/apache/spark/pull/29021#issuecomment-662196164 **[Test build #126291 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126291/testReport)** for PR 29021 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29182: [SPARK-32003][CORE][2.4] When external shuffle service is used, unregister outputs for executor on fetch failure after executor is lost

2020-07-22 Thread GitBox
AmplabJenkins commented on pull request #29182: URL: https://github.com/apache/spark/pull/29182#issuecomment-662282919 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29014: [SPARK-32199][SPARK-32198] Reduce job failures during decommissioning

2020-07-22 Thread GitBox
AmplabJenkins removed a comment on pull request #29014: URL: https://github.com/apache/spark/pull/29014#issuecomment-662282378 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #29145: [SPARK-32346][SQL] Support filters pushdown in Avro datasource

2020-07-22 Thread GitBox
SparkQA removed a comment on pull request #29145: URL: https://github.com/apache/spark/pull/29145#issuecomment-662260599 **[Test build #126303 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126303/testReport)** for PR 29145 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29107: [SPARK-32308][SQL] Move by-name resolution logic of unionByName from API code to analysis phase

2020-07-22 Thread GitBox
AmplabJenkins removed a comment on pull request #29107: URL: https://github.com/apache/spark/pull/29107#issuecomment-662282448 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #29085: [SPARK-32106][SQL]Implement SparkScriptTransformationExec in sql/core

2020-07-22 Thread GitBox
SparkQA removed a comment on pull request #29085: URL: https://github.com/apache/spark/pull/29085#issuecomment-662249043 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #29183: [SPARK-21117][SQL][FOLLOWUP] Define prettyName for WidthBucket

2020-07-22 Thread GitBox
SparkQA removed a comment on pull request #29183: URL: https://github.com/apache/spark/pull/29183#issuecomment-662268446 **[Test build #126306 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126306/testReport)** for PR 29183 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29107: [SPARK-32308][SQL] Move by-name resolution logic of unionByName from API code to analysis phase

2020-07-22 Thread GitBox
SparkQA removed a comment on pull request #29107: URL: https://github.com/apache/spark/pull/29107#issuecomment-662231827 **[Test build #126294 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126294/testReport)** for PR 29107 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29014: [SPARK-32199][SPARK-32198] Reduce job failures during decommissioning

2020-07-22 Thread GitBox
SparkQA removed a comment on pull request #29014: URL: https://github.com/apache/spark/pull/29014#issuecomment-662237102 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29014: [SPARK-32199][SPARK-32198] Reduce job failures during decommissioning

2020-07-22 Thread GitBox
AmplabJenkins commented on pull request #29014: URL: https://github.com/apache/spark/pull/29014#issuecomment-662282579 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29183: [SPARK-21117][SQL][FOLLOWUP] Define prettyName for WidthBucket

2020-07-22 Thread GitBox
AmplabJenkins commented on pull request #29183: URL: https://github.com/apache/spark/pull/29183#issuecomment-662282292 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29014: [SPARK-32199][SPARK-32198] Reduce job failures during decommissioning

2020-07-22 Thread GitBox
AmplabJenkins commented on pull request #29014: URL: https://github.com/apache/spark/pull/29014#issuecomment-662282378 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort plans

2020-07-22 Thread GitBox
AmplabJenkins commented on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-662282323 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort plans

2020-07-22 Thread GitBox
AmplabJenkins commented on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-662282424 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29021: [SPARK-32201][SQL] More general skew join pattern matching

2020-07-22 Thread GitBox
SparkQA commented on pull request #29021: URL: https://github.com/apache/spark/pull/29021#issuecomment-662282134 **[Test build #126291 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126291/testReport)** for PR 29021 at commit

[GitHub] [spark] SparkQA commented on pull request #29145: [SPARK-32346][SQL] Support filters pushdown in Avro datasource

2020-07-22 Thread GitBox
SparkQA commented on pull request #29145: URL: https://github.com/apache/spark/pull/29145#issuecomment-662282150 **[Test build #126303 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126303/testReport)** for PR 29145 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29159: [SPARK-32310][ML][PySpark][3.0] ML params default value parity

2020-07-22 Thread GitBox
AmplabJenkins commented on pull request #29159: URL: https://github.com/apache/spark/pull/29159#issuecomment-662282326 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29107: [SPARK-32308][SQL] Move by-name resolution logic of unionByName from API code to analysis phase

2020-07-22 Thread GitBox
AmplabJenkins commented on pull request #29107: URL: https://github.com/apache/spark/pull/29107#issuecomment-662282448 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29085: [SPARK-32106][SQL]Implement SparkScriptTransformationExec in sql/core

2020-07-22 Thread GitBox
AmplabJenkins commented on pull request #29085: URL: https://github.com/apache/spark/pull/29085#issuecomment-662282255 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29107: [SPARK-32308][SQL] Move by-name resolution logic of unionByName from API code to analysis phase

2020-07-22 Thread GitBox
SparkQA commented on pull request #29107: URL: https://github.com/apache/spark/pull/29107#issuecomment-662282155 **[Test build #126294 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126294/testReport)** for PR 29107 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29153: [SPARK-32310][ML][PySpark] ML params default value parity in feature and tuning

2020-07-22 Thread GitBox
AmplabJenkins commented on pull request #29153: URL: https://github.com/apache/spark/pull/29153#issuecomment-662282224 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29032: [SPARK-32217] Plumb whether a worker would also be decommissioned along with executor

2020-07-22 Thread GitBox
SparkQA commented on pull request #29032: URL: https://github.com/apache/spark/pull/29032#issuecomment-662282135 **[Test build #126301 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126301/testReport)** for PR 29032 at commit

[GitHub] [spark] SparkQA commented on pull request #29014: [SPARK-32199][SPARK-32198] Reduce job failures during decommissioning

2020-07-22 Thread GitBox
SparkQA commented on pull request #29014: URL: https://github.com/apache/spark/pull/29014#issuecomment-662282154 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] AmplabJenkins commented on pull request #29145: [SPARK-32346][SQL] Support filters pushdown in Avro datasource

2020-07-22 Thread GitBox
AmplabJenkins commented on pull request #29145: URL: https://github.com/apache/spark/pull/29145#issuecomment-662282286 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort plans

2020-07-22 Thread GitBox
SparkQA commented on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-662282153 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] SparkQA commented on pull request #29153: [SPARK-32310][ML][PySpark] ML params default value parity in feature and tuning

2020-07-22 Thread GitBox
SparkQA commented on pull request #29153: URL: https://github.com/apache/spark/pull/29153#issuecomment-662282136 **[Test build #126307 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126307/testReport)** for PR 29153 at commit

[GitHub] [spark] SparkQA commented on pull request #29159: [SPARK-32310][ML][PySpark][3.0] ML params default value parity

2020-07-22 Thread GitBox
SparkQA commented on pull request #29159: URL: https://github.com/apache/spark/pull/29159#issuecomment-662282140 **[Test build #126304 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126304/testReport)** for PR 29159 at commit

[GitHub] [spark] SparkQA commented on pull request #29183: [SPARK-21117][SQL][FOLLOWUP] Define prettyName for WidthBucket

2020-07-22 Thread GitBox
SparkQA commented on pull request #29183: URL: https://github.com/apache/spark/pull/29183#issuecomment-662282148 **[Test build #126306 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126306/testReport)** for PR 29183 at commit

[GitHub] [spark] SparkQA commented on pull request #29182: [SPARK-32003][CORE][2.4] When external shuffle service is used, unregister outputs for executor on fetch failure after executor is lost

2020-07-22 Thread GitBox
SparkQA commented on pull request #29182: URL: https://github.com/apache/spark/pull/29182#issuecomment-662282138 **[Test build #126299 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126299/testReport)** for PR 29182 at commit

[GitHub] [spark] SparkQA commented on pull request #29085: [SPARK-32106][SQL]Implement SparkScriptTransformationExec in sql/core

2020-07-22 Thread GitBox
SparkQA commented on pull request #29085: URL: https://github.com/apache/spark/pull/29085#issuecomment-662282152 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] maropu commented on a change in pull request #29094: [SPARK-24983][SQL] limit number of leaf expressions in a single project when collapse project to prevent driver oom

2020-07-22 Thread GitBox
maropu commented on a change in pull request #29094: URL: https://github.com/apache/spark/pull/29094#discussion_r458575888 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala ## @@ -697,16 +697,21 @@ object ColumnPruning extends

[GitHub] [spark] constzhou commented on a change in pull request #29094: [SPARK-24983][SQL] limit number of leaf expressions in a single project when collapse project to prevent driver oom

2020-07-22 Thread GitBox
constzhou commented on a change in pull request #29094: URL: https://github.com/apache/spark/pull/29094#discussion_r458572057 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala ## @@ -697,16 +697,21 @@ object ColumnPruning

[GitHub] [spark] LantaoJin commented on pull request #29062: [SPARK-32237][SQL] Resolve hint in CTE

2020-07-22 Thread GitBox
LantaoJin commented on pull request #29062: URL: https://github.com/apache/spark/pull/29062#issuecomment-662275382 PS: ```scala val plan = With( Project( Seq(UnresolvedAttribute("cte.a")), UnresolvedRelation(TableIdentifier("cte")) ),

[GitHub] [spark] gengliangwang commented on pull request #29176: [MINOR][SQL][TESTS] Create tables once in JDBC tests

2020-07-22 Thread GitBox
gengliangwang commented on pull request #29176: URL: https://github.com/apache/spark/pull/29176#issuecomment-662274153 @MaxGekk What is the test execution time before and after the changes? This is an automated message from

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29085: [SPARK-32106][SQL]Implement SparkScriptTransformationExec in sql/core

2020-07-22 Thread GitBox
AmplabJenkins removed a comment on pull request #29085: URL: https://github.com/apache/spark/pull/29085#issuecomment-662272599 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29085: [SPARK-32106][SQL]Implement SparkScriptTransformationExec in sql/core

2020-07-22 Thread GitBox
AmplabJenkins commented on pull request #29085: URL: https://github.com/apache/spark/pull/29085#issuecomment-662272599 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] LantaoJin commented on a change in pull request #29062: [SPARK-32237][SQL] Resolve hint in CTE

2020-07-22 Thread GitBox
LantaoJin commented on a change in pull request #29062: URL: https://github.com/apache/spark/pull/29062#discussion_r458529424 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala ## @@ -200,18 +200,18 @@ class Analyzer( val

[GitHub] [spark] SparkQA removed a comment on pull request #29085: [SPARK-32106][SQL]Implement SparkScriptTransformationExec in sql/core

2020-07-22 Thread GitBox
SparkQA removed a comment on pull request #29085: URL: https://github.com/apache/spark/pull/29085#issuecomment-662183975 **[Test build #126289 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126289/testReport)** for PR 29085 at commit

[GitHub] [spark] LantaoJin removed a comment on pull request #29062: [SPARK-32237][SQL] Resolve hint in CTE

2020-07-22 Thread GitBox
LantaoJin removed a comment on pull request #29062: URL: https://github.com/apache/spark/pull/29062#issuecomment-662233804 > I checked the order of analysis rules in branch-2.4. Substitution batch is after Hints too, like branch-3.0. Is there any change causing this issue? @viirya I

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29153: [SPARK-32310][ML][PySpark] ML params default value parity in feature and tuning

2020-07-22 Thread GitBox
AmplabJenkins removed a comment on pull request #29153: URL: https://github.com/apache/spark/pull/29153#issuecomment-662271571 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #29085: [SPARK-32106][SQL]Implement SparkScriptTransformationExec in sql/core

2020-07-22 Thread GitBox
SparkQA commented on pull request #29085: URL: https://github.com/apache/spark/pull/29085#issuecomment-662271398 **[Test build #126289 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126289/testReport)** for PR 29085 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29153: [SPARK-32310][ML][PySpark] ML params default value parity in feature and tuning

2020-07-22 Thread GitBox
AmplabJenkins commented on pull request #29153: URL: https://github.com/apache/spark/pull/29153#issuecomment-662271571 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29153: [SPARK-32310][ML][PySpark] ML params default value parity in feature and tuning

2020-07-22 Thread GitBox
SparkQA commented on pull request #29153: URL: https://github.com/apache/spark/pull/29153#issuecomment-662271131 **[Test build #126307 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126307/testReport)** for PR 29153 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29183: [SPARK-21117][SQL][FOLLOWUP] Define prettyName for WidthBucket

2020-07-22 Thread GitBox
AmplabJenkins commented on pull request #29183: URL: https://github.com/apache/spark/pull/29183#issuecomment-662268831 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29183: [SPARK-21117][SQL][FOLLOWUP] Define prettyName for WidthBucket

2020-07-22 Thread GitBox
AmplabJenkins removed a comment on pull request #29183: URL: https://github.com/apache/spark/pull/29183#issuecomment-662268831 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #29183: [SPARK-21117][SQL][FOLLOWUP] Define prettyName for WidthBucket

2020-07-22 Thread GitBox
SparkQA commented on pull request #29183: URL: https://github.com/apache/spark/pull/29183#issuecomment-662268446 **[Test build #126306 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126306/testReport)** for PR 29183 at commit

[GitHub] [spark] maropu commented on pull request #29183: [SPARK-21117][SQL][FOLLOWUP] Define prettyName for WidthBucket

2020-07-22 Thread GitBox
maropu commented on pull request #29183: URL: https://github.com/apache/spark/pull/29183#issuecomment-662267325 cc: @HyukjinKwon @gatorsmile This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] huaxingao commented on a change in pull request #29159: [SPARK-32310][ML][PySpark][3.0] ML params default value parity

2020-07-22 Thread GitBox
huaxingao commented on a change in pull request #29159: URL: https://github.com/apache/spark/pull/29159#discussion_r458561691 ## File path: mllib/src/test/scala/org/apache/spark/ml/util/DefaultReadWriteTest.scala ## @@ -64,7 +64,12 @@ trait DefaultReadWriteTest extends

[GitHub] [spark] maropu opened a new pull request #29183: [SPARK-21117][SQL][FOLLOWUP] Define prettyName for WidthBucket

2020-07-22 Thread GitBox
maropu opened a new pull request #29183: URL: https://github.com/apache/spark/pull/29183 ### What changes were proposed in this pull request? This PR is to define prettyName for `WidthBucket`. This comes from the @gatorsmile's suggestion:

[GitHub] [spark] AmplabJenkins commented on pull request #29159: [SPARK-32310][ML][PySpark][3.0] ML params default value parity

2020-07-22 Thread GitBox
AmplabJenkins commented on pull request #29159: URL: https://github.com/apache/spark/pull/29159#issuecomment-662266181 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] frankyin-factual commented on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort plans

2020-07-22 Thread GitBox
frankyin-factual commented on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-662266123 @dongjoon-hyun Thanks for reviewing this late. For the test cases, I think it might be better to group all the `Project->Filter->[any node can be pruned]` cases

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort plans

2020-07-22 Thread GitBox
AmplabJenkins removed a comment on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-662266294 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29159: [SPARK-32310][ML][PySpark][3.0] ML params default value parity

2020-07-22 Thread GitBox
AmplabJenkins removed a comment on pull request #29159: URL: https://github.com/apache/spark/pull/29159#issuecomment-662266181 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort plans

2020-07-22 Thread GitBox
AmplabJenkins commented on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-662266294 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29080: [SPARK-32271][ML] Add option for k-fold cross-validation to CrossValidator

2020-07-22 Thread GitBox
AmplabJenkins removed a comment on pull request #29080: URL: https://github.com/apache/spark/pull/29080#issuecomment-662265972 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #29080: [SPARK-32271][ML] Add option for k-fold cross-validation to CrossValidator

2020-07-22 Thread GitBox
SparkQA removed a comment on pull request #29080: URL: https://github.com/apache/spark/pull/29080#issuecomment-662242821 **[Test build #126297 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126297/testReport)** for PR 29080 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29080: [SPARK-32271][ML] Add option for k-fold cross-validation to CrossValidator

2020-07-22 Thread GitBox
AmplabJenkins commented on pull request #29080: URL: https://github.com/apache/spark/pull/29080#issuecomment-662265972 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29159: [SPARK-32310][ML][PySpark][3.0] ML params default value parity

2020-07-22 Thread GitBox
SparkQA commented on pull request #29159: URL: https://github.com/apache/spark/pull/29159#issuecomment-662265763 **[Test build #126304 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126304/testReport)** for PR 29159 at commit

[GitHub] [spark] SparkQA commented on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort plans

2020-07-22 Thread GitBox
SparkQA commented on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-662265862 **[Test build #126305 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126305/testReport)** for PR 28898 at commit

[GitHub] [spark] SparkQA commented on pull request #29080: [SPARK-32271][ML] Add option for k-fold cross-validation to CrossValidator

2020-07-22 Thread GitBox
SparkQA commented on pull request #29080: URL: https://github.com/apache/spark/pull/29080#issuecomment-662265755 **[Test build #126297 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126297/testReport)** for PR 29080 at commit

[GitHub] [spark] frankyin-factual commented on a change in pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort plans

2020-07-22 Thread GitBox
frankyin-factual commented on a change in pull request #28898: URL: https://github.com/apache/spark/pull/28898#discussion_r458559553 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/NestedColumnAliasing.scala ## @@ -39,6 +39,20 @@ object

[GitHub] [spark] dongjoon-hyun commented on pull request #28746: [SPARK-31922][CORE] logDebug "RpcEnv already stopped" error on LocalSparkCluster shutdown

2020-07-22 Thread GitBox
dongjoon-hyun commented on pull request #28746: URL: https://github.com/apache/spark/pull/28746#issuecomment-662265360 Also, @zsxwing and @jiangxb1987 . I skimmed the previous discussion and I believe @Ngone51 addressed all your concerns. If I missed something, please comment here. We can

[GitHub] [spark] dongjoon-hyun closed pull request #28746: [SPARK-31922][CORE] logDebug "RpcEnv already stopped" error on LocalSparkCluster shutdown

2020-07-22 Thread GitBox
dongjoon-hyun closed pull request #28746: URL: https://github.com/apache/spark/pull/28746 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] dongjoon-hyun commented on pull request #28746: [SPARK-31922][CORE] logDebug "RpcEnv already stopped" error on LocalSparkCluster shutdown

2020-07-22 Thread GitBox
dongjoon-hyun commented on pull request #28746: URL: https://github.com/apache/spark/pull/28746#issuecomment-662264160 Oops. Sorry, @Ngone51 . This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29181: [SPARK-32383][SQL] Preserve hash join (BHJ and SHJ) stream side ordering

2020-07-22 Thread GitBox
AmplabJenkins removed a comment on pull request #29181: URL: https://github.com/apache/spark/pull/29181#issuecomment-662262903 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29181: [SPARK-32383][SQL] Preserve hash join (BHJ and SHJ) stream side ordering

2020-07-22 Thread GitBox
AmplabJenkins commented on pull request #29181: URL: https://github.com/apache/spark/pull/29181#issuecomment-662262903 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #29181: [SPARK-32383][SQL] Preserve hash join (BHJ and SHJ) stream side ordering

2020-07-22 Thread GitBox
SparkQA removed a comment on pull request #29181: URL: https://github.com/apache/spark/pull/29181#issuecomment-662178292 **[Test build #126288 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126288/testReport)** for PR 29181 at commit

[GitHub] [spark] SparkQA commented on pull request #29181: [SPARK-32383][SQL] Preserve hash join (BHJ and SHJ) stream side ordering

2020-07-22 Thread GitBox
SparkQA commented on pull request #29181: URL: https://github.com/apache/spark/pull/29181#issuecomment-662262412 **[Test build #126288 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126288/testReport)** for PR 29181 at commit

<    5   6   7   8   9   10   11   >