[GitHub] [spark] SparkQA removed a comment on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

2020-01-15 Thread GitBox
SparkQA removed a comment on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-574972361 **[Test build #116810 has

[GitHub] [spark] AmplabJenkins commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-575029908 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-575029908 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-575029916 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-575029916 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

2020-01-15 Thread GitBox
SparkQA commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-575029403 **[Test build #116810 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27058: [SPARK-30395][SQL] When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27058: [SPARK-30395][SQL] When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows the use of the FILTER clause URL: https://github.com/apache/spark/pull/27058#issuecomment-575028449 Test

[GitHub] [spark] AmplabJenkins removed a comment on issue #27058: [SPARK-30395][SQL] When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27058: [SPARK-30395][SQL] When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows the use of the FILTER clause URL: https://github.com/apache/spark/pull/27058#issuecomment-575028437

[GitHub] [spark] AmplabJenkins removed a comment on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-575028175 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27058: [SPARK-30395][SQL] When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows the use

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27058: [SPARK-30395][SQL] When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows the use of the FILTER clause URL: https://github.com/apache/spark/pull/27058#issuecomment-575028449 Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-575028166 Merged build finished. Test FAILed. This

[GitHub] [spark] AmplabJenkins commented on issue #27058: [SPARK-30395][SQL] When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows the use

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27058: [SPARK-30395][SQL] When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows the use of the FILTER clause URL: https://github.com/apache/spark/pull/27058#issuecomment-575028437 Merged build

[GitHub] [spark] AmplabJenkins commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-575028166 Merged build finished. Test FAILed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-575028175 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away

2020-01-15 Thread GitBox
SparkQA commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-575028093 **[Test build #116821 has

[GitHub] [spark] SparkQA removed a comment on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away

2020-01-15 Thread GitBox
SparkQA removed a comment on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-575002718 **[Test build #116821 has

[GitHub] [spark] SparkQA commented on issue #27058: [SPARK-30395][SQL] When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows the use of th

2020-01-15 Thread GitBox
SparkQA commented on issue #27058: [SPARK-30395][SQL] When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows the use of the FILTER clause URL: https://github.com/apache/spark/pull/27058#issuecomment-575027955 **[Test build

[GitHub] [spark] imback82 commented on issue #27187: [SPARK-30497][SQL] migrate DESCRIBE TABLE to the new framework

2020-01-15 Thread GitBox
imback82 commented on issue #27187: [SPARK-30497][SQL] migrate DESCRIBE TABLE to the new framework URL: https://github.com/apache/spark/pull/27187#issuecomment-575027510 Thanks. I will start migrating more command to the new framework this week.

[GitHub] [spark] imback82 edited a comment on issue #27187: [SPARK-30497][SQL] migrate DESCRIBE TABLE to the new framework

2020-01-15 Thread GitBox
imback82 edited a comment on issue #27187: [SPARK-30497][SQL] migrate DESCRIBE TABLE to the new framework URL: https://github.com/apache/spark/pull/27187#issuecomment-575027510 Thanks. I will start migrating more commands to the new framework this week.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25827: [SPARK-29128][SQL] Split predicate code in OR expressions

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #25827: [SPARK-29128][SQL] Split predicate code in OR expressions URL: https://github.com/apache/spark/pull/25827#issuecomment-575026025 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #25827: [SPARK-29128][SQL] Split predicate code in OR expressions

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #25827: [SPARK-29128][SQL] Split predicate code in OR expressions URL: https://github.com/apache/spark/pull/25827#issuecomment-575026030 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25827: [SPARK-29128][SQL] Split predicate code in OR expressions

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #25827: [SPARK-29128][SQL] Split predicate code in OR expressions URL: https://github.com/apache/spark/pull/25827#issuecomment-575026025 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #25827: [SPARK-29128][SQL] Split predicate code in OR expressions

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #25827: [SPARK-29128][SQL] Split predicate code in OR expressions URL: https://github.com/apache/spark/pull/25827#issuecomment-575026030 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] fuwhu commented on a change in pull request #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions

2020-01-15 Thread GitBox
fuwhu commented on a change in pull request #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions URL: https://github.com/apache/spark/pull/26805#discussion_r367247006 ## File path:

[GitHub] [spark] SparkQA commented on issue #25827: [SPARK-29128][SQL] Split predicate code in OR expressions

2020-01-15 Thread GitBox
SparkQA commented on issue #25827: [SPARK-29128][SQL] Split predicate code in OR expressions URL: https://github.com/apache/spark/pull/25827#issuecomment-575025592 **[Test build #116824 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116824/testReport)**

[GitHub] [spark] kiszk commented on issue #25827: [SPARK-29128][SQL] Split predicate code in OR expressions

2020-01-15 Thread GitBox
kiszk commented on issue #25827: [SPARK-29128][SQL] Split predicate code in OR expressions URL: https://github.com/apache/spark/pull/25827#issuecomment-575025184 retest this please This is an automated message from the

[GitHub] [spark] dilipbiswal commented on a change in pull request #26759: [SPARK-28794][SQL][DOC] Documentation for Create table Command

2020-01-15 Thread GitBox
dilipbiswal commented on a change in pull request #26759: [SPARK-28794][SQL][DOC] Documentation for Create table Command URL: https://github.com/apache/spark/pull/26759#discussion_r367269598 ## File path: docs/sql-ref-syntax-ddl-create-table-hiveformat.md ## @@ -0,0

[GitHub] [spark] AmplabJenkins removed a comment on issue #27227: [SPARK-29290][CORE] Update to chill 0.9.5

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27227: [SPARK-29290][CORE] Update to chill 0.9.5 URL: https://github.com/apache/spark/pull/27227#issuecomment-575023664 Build finished. Test PASSed. This is an automated message from

[GitHub] [spark] dilipbiswal commented on a change in pull request #26759: [SPARK-28794][SQL][DOC] Documentation for Create table Command

2020-01-15 Thread GitBox
dilipbiswal commented on a change in pull request #26759: [SPARK-28794][SQL][DOC] Documentation for Create table Command URL: https://github.com/apache/spark/pull/26759#discussion_r367268754 ## File path: docs/sql-ref-syntax-ddl-create-table-datasource.md ## @@ -0,0 +1,97

[GitHub] [spark] AmplabJenkins commented on issue #27227: [SPARK-29290][CORE] Update to chill 0.9.5

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27227: [SPARK-29290][CORE] Update to chill 0.9.5 URL: https://github.com/apache/spark/pull/27227#issuecomment-575023671 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27227: [SPARK-29290][CORE] Update to chill 0.9.5

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27227: [SPARK-29290][CORE] Update to chill 0.9.5 URL: https://github.com/apache/spark/pull/27227#issuecomment-575023664 Build finished. Test PASSed. This is an automated message from the

[GitHub] [spark] AmplabJenkins removed a comment on issue #27227: [SPARK-29290][CORE] Update to chill 0.9.5

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27227: [SPARK-29290][CORE] Update to chill 0.9.5 URL: https://github.com/apache/spark/pull/27227#issuecomment-575023671 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #27227: [SPARK-29290][CORE] Update to chill 0.9.5

2020-01-15 Thread GitBox
SparkQA removed a comment on issue #27227: [SPARK-29290][CORE] Update to chill 0.9.5 URL: https://github.com/apache/spark/pull/27227#issuecomment-574977039 **[Test build #116811 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116811/testReport)** for PR

[GitHub] [spark] SparkQA commented on issue #27227: [SPARK-29290][CORE] Update to chill 0.9.5

2020-01-15 Thread GitBox
SparkQA commented on issue #27227: [SPARK-29290][CORE] Update to chill 0.9.5 URL: https://github.com/apache/spark/pull/27227#issuecomment-575022655 **[Test build #116811 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116811/testReport)** for PR 27227 at

[GitHub] [spark] dilipbiswal commented on a change in pull request #26759: [SPARK-28794][SQL][DOC] Documentation for Create table Command

2020-01-15 Thread GitBox
dilipbiswal commented on a change in pull request #26759: [SPARK-28794][SQL][DOC] Documentation for Create table Command URL: https://github.com/apache/spark/pull/26759#discussion_r367267170 ## File path: docs/sql-ref-syntax-ddl-create-table-datasource.md ## @@ -0,0 +1,97

[GitHub] [spark] AmplabJenkins commented on issue #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions URL: https://github.com/apache/spark/pull/26805#issuecomment-575020896 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions URL: https://github.com/apache/spark/pull/26805#issuecomment-575020896 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions URL: https://github.com/apache/spark/pull/26805#issuecomment-575020889 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions URL: https://github.com/apache/spark/pull/26805#issuecomment-575020889 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #27165: [SPARK-28264][PYTHON][SQL] Support type hints in pandas UDF and rename/move inconsistent pandas UDF types

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27165: [SPARK-28264][PYTHON][SQL] Support type hints in pandas UDF and rename/move inconsistent pandas UDF types URL: https://github.com/apache/spark/pull/27165#issuecomment-575019400 Test FAILed. Refer to this link for build results (access

[GitHub] [spark] SparkQA commented on issue #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions

2020-01-15 Thread GitBox
SparkQA commented on issue #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions URL: https://github.com/apache/spark/pull/26805#issuecomment-575020489 **[Test build #116823 has

[GitHub] [spark] cloud-fan closed pull request #27209: [SPARK-29450][SS][2.4] Measure the number of output rows for streaming aggregation with append mode

2020-01-15 Thread GitBox
cloud-fan closed pull request #27209: [SPARK-29450][SS][2.4] Measure the number of output rows for streaming aggregation with append mode URL: https://github.com/apache/spark/pull/27209 This is an automated message from the

[GitHub] [spark] cloud-fan commented on issue #27209: [SPARK-29450][SS][2.4] Measure the number of output rows for streaming aggregation with append mode

2020-01-15 Thread GitBox
cloud-fan commented on issue #27209: [SPARK-29450][SS][2.4] Measure the number of output rows for streaming aggregation with append mode URL: https://github.com/apache/spark/pull/27209#issuecomment-575020190 thanks, merging to 2.4!

[GitHub] [spark] AmplabJenkins removed a comment on issue #27165: [SPARK-28264][PYTHON][SQL] Support type hints in pandas UDF and rename/move inconsistent pandas UDF types

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27165: [SPARK-28264][PYTHON][SQL] Support type hints in pandas UDF and rename/move inconsistent pandas UDF types URL: https://github.com/apache/spark/pull/27165#issuecomment-575019391 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #27165: [SPARK-28264][PYTHON][SQL] Support type hints in pandas UDF and rename/move inconsistent pandas UDF types

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27165: [SPARK-28264][PYTHON][SQL] Support type hints in pandas UDF and rename/move inconsistent pandas UDF types URL: https://github.com/apache/spark/pull/27165#issuecomment-575019400 Test FAILed. Refer to this link for build results (access rights to

[GitHub] [spark] SparkQA removed a comment on issue #27165: [SPARK-28264][PYTHON][SQL] Support type hints in pandas UDF and rename/move inconsistent pandas UDF types

2020-01-15 Thread GitBox
SparkQA removed a comment on issue #27165: [SPARK-28264][PYTHON][SQL] Support type hints in pandas UDF and rename/move inconsistent pandas UDF types URL: https://github.com/apache/spark/pull/27165#issuecomment-574980876 **[Test build #116814 has

[GitHub] [spark] AmplabJenkins commented on issue #27165: [SPARK-28264][PYTHON][SQL] Support type hints in pandas UDF and rename/move inconsistent pandas UDF types

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27165: [SPARK-28264][PYTHON][SQL] Support type hints in pandas UDF and rename/move inconsistent pandas UDF types URL: https://github.com/apache/spark/pull/27165#issuecomment-575019391 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA commented on issue #27165: [SPARK-28264][PYTHON][SQL] Support type hints in pandas UDF and rename/move inconsistent pandas UDF types

2020-01-15 Thread GitBox
SparkQA commented on issue #27165: [SPARK-28264][PYTHON][SQL] Support type hints in pandas UDF and rename/move inconsistent pandas UDF types URL: https://github.com/apache/spark/pull/27165#issuecomment-575019064 **[Test build #116814 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27227: [SPARK-29290][CORE] Update to chill 0.9.5

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27227: [SPARK-29290][CORE] Update to chill 0.9.5 URL: https://github.com/apache/spark/pull/27227#issuecomment-575015480 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27227: [SPARK-29290][CORE] Update to chill 0.9.5

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27227: [SPARK-29290][CORE] Update to chill 0.9.5 URL: https://github.com/apache/spark/pull/27227#issuecomment-575015475 Merged build finished. Test FAILed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #27227: [SPARK-29290][CORE] Update to chill 0.9.5

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27227: [SPARK-29290][CORE] Update to chill 0.9.5 URL: https://github.com/apache/spark/pull/27227#issuecomment-575015475 Merged build finished. Test FAILed. This is an automated message from

[GitHub] [spark] SparkQA removed a comment on issue #27227: [SPARK-29290][CORE] Update to chill 0.9.5

2020-01-15 Thread GitBox
SparkQA removed a comment on issue #27227: [SPARK-29290][CORE] Update to chill 0.9.5 URL: https://github.com/apache/spark/pull/27227#issuecomment-574980880 **[Test build #116813 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116813/testReport)** for PR

[GitHub] [spark] SparkQA commented on issue #27227: [SPARK-29290][CORE] Update to chill 0.9.5

2020-01-15 Thread GitBox
SparkQA commented on issue #27227: [SPARK-29290][CORE] Update to chill 0.9.5 URL: https://github.com/apache/spark/pull/27227#issuecomment-575015232 **[Test build #116813 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116813/testReport)** for PR 27227 at

[GitHub] [spark] AmplabJenkins commented on issue #27227: [SPARK-29290][CORE] Update to chill 0.9.5

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27227: [SPARK-29290][CORE] Update to chill 0.9.5 URL: https://github.com/apache/spark/pull/27227#issuecomment-575015480 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] bmarcott edited a comment on issue #27207: [WIP][SPARK-18886][CORE] Make Locality wait time measure resource under utilization due to delay scheduling.

2020-01-15 Thread GitBox
bmarcott edited a comment on issue #27207: [WIP][SPARK-18886][CORE] Make Locality wait time measure resource under utilization due to delay scheduling. URL: https://github.com/apache/spark/pull/27207#issuecomment-575011886 @tgravescs Thanks for the comments. > so please update

[GitHub] [spark] kiszk commented on issue #23988: [SPARK-26509][SQL] Parquet DELTA_BYTE_ARRAY is not supported in Spark 2.x's Vectorized Reader

2020-01-15 Thread GitBox
kiszk commented on issue #23988: [SPARK-26509][SQL] Parquet DELTA_BYTE_ARRAY is not supported in Spark 2.x's Vectorized Reader URL: https://github.com/apache/spark/pull/23988#issuecomment-575012114 ping @nandorKollar This is

[GitHub] [spark] bmarcott commented on issue #27207: [WIP][SPARK-18886][CORE] Make Locality wait time measure resource under utilization due to delay scheduling.

2020-01-15 Thread GitBox
bmarcott commented on issue #27207: [WIP][SPARK-18886][CORE] Make Locality wait time measure resource under utilization due to delay scheduling. URL: https://github.com/apache/spark/pull/27207#issuecomment-575011886 @tgravescs Thanks for the comments. > so please update the

[GitHub] [spark] AmplabJenkins removed a comment on issue #27231: [SPARK-28478] [SQL] Remove redundant null checks

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27231: [SPARK-28478] [SQL] Remove redundant null checks URL: https://github.com/apache/spark/pull/27231#issuecomment-575011286 Can one of the admins verify this patch? This is an

[GitHub] [spark] AmplabJenkins commented on issue #27231: [SPARK-28478] [SQL] Remove redundant null checks

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27231: [SPARK-28478] [SQL] Remove redundant null checks URL: https://github.com/apache/spark/pull/27231#issuecomment-575011584 Can one of the admins verify this patch? This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #27231: [SPARK-28478] [SQL] Remove redundant null checks

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27231: [SPARK-28478] [SQL] Remove redundant null checks URL: https://github.com/apache/spark/pull/27231#issuecomment-575011286 Can one of the admins verify this patch? This is an automated

[GitHub] [spark] davidvrba opened a new pull request #27231: [SPARK-28478] [SQL] Remove redundant null checks

2020-01-15 Thread GitBox
davidvrba opened a new pull request #27231: [SPARK-28478] [SQL] Remove redundant null checks URL: https://github.com/apache/spark/pull/27231 ### What changes were proposed in this pull request? The purpose of this pr is to remove explicit null checks if they are not needed in order to

[GitHub] [spark] AmplabJenkins removed a comment on issue #27230: [SPARK-27868][CORE] Partially rollback previous change #09ed64d.

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27230: [SPARK-27868][CORE] Partially rollback previous change #09ed64d. URL: https://github.com/apache/spark/pull/27230#issuecomment-575006734 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #27230: [SPARK-27868][CORE] Partially rollback previous change #09ed64d.

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27230: [SPARK-27868][CORE] Partially rollback previous change #09ed64d. URL: https://github.com/apache/spark/pull/27230#issuecomment-575007102 Can one of the admins verify this patch? This

[GitHub] [spark] xCASx commented on issue #24732: [SPARK-27868][core] Better default value and documentation for socket server backlog.

2020-01-15 Thread GitBox
xCASx commented on issue #24732: [SPARK-27868][core] Better default value and documentation for socket server backlog. URL: https://github.com/apache/spark/pull/24732#issuecomment-575006840 Pull request has been sent. Not sure if this case requires a separate Jira ticket. Reused original

[GitHub] [spark] AmplabJenkins commented on issue #27230: [SPARK-27868][CORE] Partially rollback previous change #09ed64d.

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27230: [SPARK-27868][CORE] Partially rollback previous change #09ed64d. URL: https://github.com/apache/spark/pull/27230#issuecomment-575006734 Can one of the admins verify this patch? This

[GitHub] [spark] xCASx opened a new pull request #27230: [SPARK-27868][CORE] Partially rollback previous change #09ed64d.

2020-01-15 Thread GitBox
xCASx opened a new pull request #27230: [SPARK-27868][CORE] Partially rollback previous change #09ed64d. URL: https://github.com/apache/spark/pull/27230 The default value for backLog set back to -1, as any other value may break existing configuration by overriding Netty's default

[GitHub] [spark] AmplabJenkins removed a comment on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties URL: https://github.com/apache/spark/pull/27197#issuecomment-575005169 Test FAILed. Refer to this link for build results (access rights to

[GitHub] [spark] AmplabJenkins removed a comment on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties URL: https://github.com/apache/spark/pull/27197#issuecomment-575005165 Merged build finished. Test FAILed.

[GitHub] [spark] fuwhu commented on a change in pull request #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions

2020-01-15 Thread GitBox
fuwhu commented on a change in pull request #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions URL: https://github.com/apache/spark/pull/26805#discussion_r367247006 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties URL: https://github.com/apache/spark/pull/27197#issuecomment-575005165 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties

2020-01-15 Thread GitBox
SparkQA removed a comment on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties URL: https://github.com/apache/spark/pull/27197#issuecomment-574960835 **[Test build #116806 has

[GitHub] [spark] AmplabJenkins commented on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties URL: https://github.com/apache/spark/pull/27197#issuecomment-575005169 Test FAILed. Refer to this link for build results (access rights to CI

[GitHub] [spark] SparkQA commented on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties

2020-01-15 Thread GitBox
SparkQA commented on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties URL: https://github.com/apache/spark/pull/27197#issuecomment-575004931 **[Test build #116806 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27229: [SPARK-29708][SQL][BRANCH-2.4] Correct aggregated values when grouping sets are duplicated

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27229: [SPARK-29708][SQL][BRANCH-2.4] Correct aggregated values when grouping sets are duplicated URL: https://github.com/apache/spark/pull/27229#issuecomment-575003044 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27229: [SPARK-29708][SQL][BRANCH-2.4] Correct aggregated values when grouping sets are duplicated

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27229: [SPARK-29708][SQL][BRANCH-2.4] Correct aggregated values when grouping sets are duplicated URL: https://github.com/apache/spark/pull/27229#issuecomment-575003048 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] SparkQA commented on issue #27229: [SPARK-29708][SQL][BRANCH-2.4] Correct aggregated values when grouping sets are duplicated

2020-01-15 Thread GitBox
SparkQA commented on issue #27229: [SPARK-29708][SQL][BRANCH-2.4] Correct aggregated values when grouping sets are duplicated URL: https://github.com/apache/spark/pull/27229#issuecomment-575004668 **[Test build #116822 has

[GitHub] [spark] z47xu commented on issue #24421: [SPARK-12312][SQL]Support Kerberos login in JDBC connector

2020-01-15 Thread GitBox
z47xu commented on issue #24421: [SPARK-12312][SQL]Support Kerberos login in JDBC connector URL: https://github.com/apache/spark/pull/24421#issuecomment-575003039 > @vanzin may I ask to close this? I think it won't continue. > I'm planning to pick this up. What is your plan?

[GitHub] [spark] AmplabJenkins commented on issue #27229: [SPARK-29708][SQL][BRANCH-2.4] Correct aggregated values when grouping sets are duplicated

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27229: [SPARK-29708][SQL][BRANCH-2.4] Correct aggregated values when grouping sets are duplicated URL: https://github.com/apache/spark/pull/27229#issuecomment-575003048 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #27229: [SPARK-29708][SQL][BRANCH-2.4] Correct aggregated values when grouping sets are duplicated

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27229: [SPARK-29708][SQL][BRANCH-2.4] Correct aggregated values when grouping sets are duplicated URL: https://github.com/apache/spark/pull/27229#issuecomment-575003044 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away

2020-01-15 Thread GitBox
SparkQA commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-575002718 **[Test build #116821 has

[GitHub] [spark] maropu commented on issue #27229: [SPARK-29708][SQL][BRANCH-2.4] Correct aggregated values when grouping sets are duplicated

2020-01-15 Thread GitBox
maropu commented on issue #27229: [SPARK-29708][SQL][BRANCH-2.4] Correct aggregated values when grouping sets are duplicated URL: https://github.com/apache/spark/pull/27229#issuecomment-575002671 cc: @dongjoon-hyun This is

[GitHub] [spark] maropu opened a new pull request #27229: [SPARK-29708][SQL][BRANCH-2.4] Correct aggregated values when grouping sets are duplicated

2020-01-15 Thread GitBox
maropu opened a new pull request #27229: [SPARK-29708][SQL][BRANCH-2.4] Correct aggregated values when grouping sets are duplicated URL: https://github.com/apache/spark/pull/27229 ### What changes were proposed in this pull request? This pr intends to fix wrong aggregated

[GitHub] [spark] fuwhu commented on a change in pull request #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions

2020-01-15 Thread GitBox
fuwhu commented on a change in pull request #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions URL: https://github.com/apache/spark/pull/26805#discussion_r367247006 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-575001069 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-575001076 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] bmarcott commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away

2020-01-15 Thread GitBox
bmarcott commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-575001493 updated with a new sparkplan rule and added a test which makes sure a user's repartition with a different

[GitHub] [spark] AmplabJenkins commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-575001076 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] MaxGekk commented on issue #27218: [SPARK-30499][SQL] Remove SQL config spark.sql.execution.pandas.respectSessionTimeZone

2020-01-15 Thread GitBox
MaxGekk commented on issue #27218: [SPARK-30499][SQL] Remove SQL config spark.sql.execution.pandas.respectSessionTimeZone URL: https://github.com/apache/spark/pull/27218#issuecomment-575001185 @HyukjinKwon I checked that tests failed when I set timeZone to nil/none there

[GitHub] [spark] AmplabJenkins commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-575001069 Merged build finished. Test PASSed. This is an

[GitHub] [spark] fuwhu commented on a change in pull request #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions

2020-01-15 Thread GitBox
fuwhu commented on a change in pull request #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions URL: https://github.com/apache/spark/pull/26805#discussion_r367247006 ## File path:

[GitHub] [spark] SparkQA commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away

2020-01-15 Thread GitBox
SparkQA commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-575000581 **[Test build #116820 has

[GitHub] [spark] AmplabJenkins commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-574998912 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-574998912 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-574998918 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-574998918 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] cloud-fan commented on issue #26929: [SPARK-30289][SQL] DSv2's partitioning should not accept nested columns

2020-01-15 Thread GitBox
cloud-fan commented on issue #26929: [SPARK-30289][SQL] DSv2's partitioning should not accept nested columns URL: https://github.com/apache/spark/pull/26929#issuecomment-574998506 I think Spark should support all kinds of PARTITION BY expressions as long as it can be translated to v2

[GitHub] [spark] SparkQA commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

2020-01-15 Thread GitBox
SparkQA commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-574998541 **[Test build #116819 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27228: [SPARK-29565][FOLLOWUP] add setInputCol/setOutputCol in OHEModel

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27228: [SPARK-29565][FOLLOWUP] add setInputCol/setOutputCol in OHEModel URL: https://github.com/apache/spark/pull/27228#issuecomment-574997996 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27228: [SPARK-29565][FOLLOWUP] add setInputCol/setOutputCol in OHEModel

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27228: [SPARK-29565][FOLLOWUP] add setInputCol/setOutputCol in OHEModel URL: https://github.com/apache/spark/pull/27228#issuecomment-574998004 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #27228: [SPARK-29565][FOLLOWUP] add setInputCol/setOutputCol in OHEModel

2020-01-15 Thread GitBox
SparkQA removed a comment on issue #27228: [SPARK-29565][FOLLOWUP] add setInputCol/setOutputCol in OHEModel URL: https://github.com/apache/spark/pull/27228#issuecomment-574980877 **[Test build #116812 has

  1   2   3   4   5   6   7   8   9   10   >