[GitHub] [spark] AmplabJenkins commented on issue #27533: [SPARK-30783] Exclude hive-service-rpc

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27533: [SPARK-30783] Exclude hive-service-rpc URL: https://github.com/apache/spark/pull/27533#issuecomment-584449152 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27521: [SPARK-29462][SQL] The data type of "array()" should be array

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27521: [SPARK-29462][SQL] The data type of "array()" should be array URL: https://github.com/apache/spark/pull/27521#issuecomment-584449175 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27535: Add class document for PruneFileSourcePartitions and PruneHiveTablePartitions

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27535: Add class document for PruneFileSourcePartitions and PruneHiveTablePartitions URL: https://github.com/apache/spark/pull/27535#issuecomment-584449138 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #27521: [SPARK-29462][SQL] The data type of "array()" should be array

2020-02-10 Thread GitBox
SparkQA commented on issue #27521: [SPARK-29462][SQL] The data type of "array()" should be array URL: https://github.com/apache/spark/pull/27521#issuecomment-584448861 **[Test build #118195 has

[GitHub] [spark] SparkQA commented on issue #27535: Add class document for PruneFileSourcePartitions and PruneHiveTablePartitions

2020-02-10 Thread GitBox
SparkQA commented on issue #27535: Add class document for PruneFileSourcePartitions and PruneHiveTablePartitions URL: https://github.com/apache/spark/pull/27535#issuecomment-584448855 **[Test build #118194 has

[GitHub] [spark] SparkQA removed a comment on issue #27533: [SPARK-30783] Exclude hive-service-rpc

2020-02-10 Thread GitBox
SparkQA removed a comment on issue #27533: [SPARK-30783] Exclude hive-service-rpc URL: https://github.com/apache/spark/pull/27533#issuecomment-584399730 **[Test build #118186 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/118186/testReport)** for PR 27533

[GitHub] [spark] fuwhu commented on a change in pull request #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions

2020-02-10 Thread GitBox
fuwhu commented on a change in pull request #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions URL: https://github.com/apache/spark/pull/26805#discussion_r377418518 ## File path:

[GitHub] [spark] SparkQA commented on issue #27533: [SPARK-30783] Exclude hive-service-rpc

2020-02-10 Thread GitBox
SparkQA commented on issue #27533: [SPARK-30783] Exclude hive-service-rpc URL: https://github.com/apache/spark/pull/27533#issuecomment-584448733 **[Test build #118186 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/118186/testReport)** for PR 27533 at

[GitHub] [spark] fuwhu opened a new pull request #27535: Add class document for PruneFileSourcePartitions and PruneHiveTablePartitions

2020-02-10 Thread GitBox
fuwhu opened a new pull request #27535: Add class document for PruneFileSourcePartitions and PruneHiveTablePartitions URL: https://github.com/apache/spark/pull/27535 ### What changes were proposed in this pull request? Add class document for PruneFileSourcePartitions and

[GitHub] [spark] AmplabJenkins removed a comment on issue #27499: [SPARK-30590][SQL] Untyped select API cannot take typed column expression

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27499: [SPARK-30590][SQL] Untyped select API cannot take typed column expression URL: https://github.com/apache/spark/pull/27499#issuecomment-584447885 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27499: [SPARK-30590][SQL] Untyped select API cannot take typed column expression

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27499: [SPARK-30590][SQL] Untyped select API cannot take typed column expression URL: https://github.com/apache/spark/pull/27499#issuecomment-584447877 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #27499: [SPARK-30590][SQL] Untyped select API cannot take typed column expression

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27499: [SPARK-30590][SQL] Untyped select API cannot take typed column expression URL: https://github.com/apache/spark/pull/27499#issuecomment-584447877 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #27499: [SPARK-30590][SQL] Untyped select API cannot take typed column expression

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27499: [SPARK-30590][SQL] Untyped select API cannot take typed column expression URL: https://github.com/apache/spark/pull/27499#issuecomment-584447885 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #27499: [SPARK-30590][SQL] Untyped select API cannot take typed column expression

2020-02-10 Thread GitBox
SparkQA removed a comment on issue #27499: [SPARK-30590][SQL] Untyped select API cannot take typed column expression URL: https://github.com/apache/spark/pull/27499#issuecomment-584409775 **[Test build #118189 has

[GitHub] [spark] SparkQA commented on issue #27499: [SPARK-30590][SQL] Untyped select API cannot take typed column expression

2020-02-10 Thread GitBox
SparkQA commented on issue #27499: [SPARK-30590][SQL] Untyped select API cannot take typed column expression URL: https://github.com/apache/spark/pull/27499#issuecomment-584447693 **[Test build #118189 has

[GitHub] [spark] AmplabJenkins commented on issue #27534: [SPARK-30731][DOCS] Refine workflow for building docs

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27534: [SPARK-30731][DOCS] Refine workflow for building docs URL: https://github.com/apache/spark/pull/27534#issuecomment-584445333 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27534: [SPARK-30731][DOCS] Refine workflow for building docs

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27534: [SPARK-30731][DOCS] Refine workflow for building docs URL: https://github.com/apache/spark/pull/27534#issuecomment-584445329 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #27534: [SPARK-30731][DOCS] Refine workflow for building docs

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27534: [SPARK-30731][DOCS] Refine workflow for building docs URL: https://github.com/apache/spark/pull/27534#issuecomment-584445329 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #27534: [SPARK-30731][DOCS] Refine workflow for building docs

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27534: [SPARK-30731][DOCS] Refine workflow for building docs URL: https://github.com/apache/spark/pull/27534#issuecomment-584445333 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #27534: [SPARK-30731][DOCS] Refine workflow for building docs

2020-02-10 Thread GitBox
SparkQA removed a comment on issue #27534: [SPARK-30731][DOCS] Refine workflow for building docs URL: https://github.com/apache/spark/pull/27534#issuecomment-584402199 **[Test build #118187 has

[GitHub] [spark] SparkQA commented on issue #27534: [SPARK-30731][DOCS] Refine workflow for building docs

2020-02-10 Thread GitBox
SparkQA commented on issue #27534: [SPARK-30731][DOCS] Refine workflow for building docs URL: https://github.com/apache/spark/pull/27534#issuecomment-58965 **[Test build #118187 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/118187/testReport)** for

[GitHub] [spark] imback82 commented on issue #27532: [SPARK-30782][SQL] Column resolution doesn't respect current catalog/namespace for v2 tables.

2020-02-10 Thread GitBox
imback82 commented on issue #27532: [SPARK-30782][SQL] Column resolution doesn't respect current catalog/namespace for v2 tables. URL: https://github.com/apache/spark/pull/27532#issuecomment-584443079 cc @cloud-fan @brkyvz

[GitHub] [spark] AmplabJenkins removed a comment on issue #27531: Revert "[SPARK-30625][SQL] Support `escape` as third parameter of the `like` function

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27531: Revert "[SPARK-30625][SQL] Support `escape` as third parameter of the `like` function URL: https://github.com/apache/spark/pull/27531#issuecomment-584442295 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #27517: [WIP][SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27517: [WIP][SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/27517#issuecomment-584442310 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27517: [WIP][SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27517: [WIP][SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/27517#issuecomment-584442316 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27517: [WIP][SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27517: [WIP][SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/27517#issuecomment-584442310 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27531: Revert "[SPARK-30625][SQL] Support `escape` as third parameter of the `like` function

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27531: Revert "[SPARK-30625][SQL] Support `escape` as third parameter of the `like` function URL: https://github.com/apache/spark/pull/27531#issuecomment-584442286 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27517: [WIP][SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27517: [WIP][SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/27517#issuecomment-584442316 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #27531: Revert "[SPARK-30625][SQL] Support `escape` as third parameter of the `like` function

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27531: Revert "[SPARK-30625][SQL] Support `escape` as third parameter of the `like` function URL: https://github.com/apache/spark/pull/27531#issuecomment-584442286 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #27531: Revert "[SPARK-30625][SQL] Support `escape` as third parameter of the `like` function

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27531: Revert "[SPARK-30625][SQL] Support `escape` as third parameter of the `like` function URL: https://github.com/apache/spark/pull/27531#issuecomment-584442295 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #27531: Revert "[SPARK-30625][SQL] Support `escape` as third parameter of the `like` function

2020-02-10 Thread GitBox
SparkQA removed a comment on issue #27531: Revert "[SPARK-30625][SQL] Support `escape` as third parameter of the `like` function URL: https://github.com/apache/spark/pull/27531#issuecomment-584373510 **[Test build #118181 has

[GitHub] [spark] SparkQA commented on issue #27531: Revert "[SPARK-30625][SQL] Support `escape` as third parameter of the `like` function

2020-02-10 Thread GitBox
SparkQA commented on issue #27531: Revert "[SPARK-30625][SQL] Support `escape` as third parameter of the `like` function URL: https://github.com/apache/spark/pull/27531#issuecomment-584442109 **[Test build #118181 has

[GitHub] [spark] SparkQA removed a comment on issue #27517: [WIP][SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-02-10 Thread GitBox
SparkQA removed a comment on issue #27517: [WIP][SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/27517#issuecomment-584351108 **[Test build #118180 has

[GitHub] [spark] wangyum commented on issue #27492: [SPARK-30755][SQL][test-hive1.2] Support Hive 1.2.1's Serde after making built-in Hive to 2.3

2020-02-10 Thread GitBox
wangyum commented on issue #27492: [SPARK-30755][SQL][test-hive1.2] Support Hive 1.2.1's Serde after making built-in Hive to 2.3 URL: https://github.com/apache/spark/pull/27492#issuecomment-584442043 @yhuai It is because we use `hive-contrib-2.3.6.jar` and `hive-hcatalog-core-2.3.6.jar`:

[GitHub] [spark] SparkQA commented on issue #27517: [WIP][SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-02-10 Thread GitBox
SparkQA commented on issue #27517: [WIP][SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/27517#issuecomment-584441925 **[Test build #118180 has

[GitHub] [spark] wangyum commented on issue #27492: [SPARK-30755][SQL][test-hive1.2] Support Hive 1.2.1's Serde after making built-in Hive to 2.3

2020-02-10 Thread GitBox
wangyum commented on issue #27492: [SPARK-30755][SQL][test-hive1.2] Support Hive 1.2.1's Serde after making built-in Hive to 2.3 URL: https://github.com/apache/spark/pull/27492#issuecomment-584441553 @Ngone51 Yes. `SPARK-30755: Support Hive 1.2.1's Serde after making built-in Hive to 2.3`

[GitHub] [spark] AmplabJenkins removed a comment on issue #27530: [SPARK-30780][SQL] Empty LocalTableScan should use RDD without partitions

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27530: [SPARK-30780][SQL] Empty LocalTableScan should use RDD without partitions URL: https://github.com/apache/spark/pull/27530#issuecomment-584438964 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27530: [SPARK-30780][SQL] Empty LocalTableScan should use RDD without partitions

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27530: [SPARK-30780][SQL] Empty LocalTableScan should use RDD without partitions URL: https://github.com/apache/spark/pull/27530#issuecomment-584438958 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #27530: [SPARK-30780][SQL] Empty LocalTableScan should use RDD without partitions

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27530: [SPARK-30780][SQL] Empty LocalTableScan should use RDD without partitions URL: https://github.com/apache/spark/pull/27530#issuecomment-584438964 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27530: [SPARK-30780][SQL] Empty LocalTableScan should use RDD without partitions

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27530: [SPARK-30780][SQL] Empty LocalTableScan should use RDD without partitions URL: https://github.com/apache/spark/pull/27530#issuecomment-584438958 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #27530: [SPARK-30780][SQL] Empty LocalTableScan should use RDD without partitions

2020-02-10 Thread GitBox
SparkQA removed a comment on issue #27530: [SPARK-30780][SQL] Empty LocalTableScan should use RDD without partitions URL: https://github.com/apache/spark/pull/27530#issuecomment-584351097 **[Test build #118179 has

[GitHub] [spark] SparkQA commented on issue #27530: [SPARK-30780][SQL] Empty LocalTableScan should use RDD without partitions

2020-02-10 Thread GitBox
SparkQA commented on issue #27530: [SPARK-30780][SQL] Empty LocalTableScan should use RDD without partitions URL: https://github.com/apache/spark/pull/27530#issuecomment-584438763 **[Test build #118179 has

[GitHub] [spark] AmplabJenkins commented on issue #27030: [SPARK-30244][SQL] Emit pre/post events for "Partition" methods in ExternalCatalogWithListener

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27030: [SPARK-30244][SQL] Emit pre/post events for "Partition" methods in ExternalCatalogWithListener URL: https://github.com/apache/spark/pull/27030#issuecomment-584437019 Can one of the admins verify this patch?

[GitHub] [spark] dongjoon-hyun commented on issue #27529: [SPARK-30777][PYTHON][TESTS] Fix test failures for Pandas >= 1.0.0

2020-02-10 Thread GitBox
dongjoon-hyun commented on issue #27529: [SPARK-30777][PYTHON][TESTS] Fix test failures for Pandas >= 1.0.0 URL: https://github.com/apache/spark/pull/27529#issuecomment-584436212 Thank you, @BryanCutler and @HyukjinKwon !

[GitHub] [spark] AmplabJenkins removed a comment on issue #26929: [SPARK-30289][SQL] Partitioned by Nested Column for `InMemoryTable`

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #26929: [SPARK-30289][SQL] Partitioned by Nested Column for `InMemoryTable` URL: https://github.com/apache/spark/pull/26929#issuecomment-584435680 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27517: [WIP][SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27517: [WIP][SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/27517#issuecomment-584435644 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27517: [WIP][SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27517: [WIP][SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/27517#issuecomment-584435651 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #26929: [SPARK-30289][SQL] Partitioned by Nested Column for `InMemoryTable`

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #26929: [SPARK-30289][SQL] Partitioned by Nested Column for `InMemoryTable` URL: https://github.com/apache/spark/pull/26929#issuecomment-584435671 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26929: [SPARK-30289][SQL] Partitioned by Nested Column for `InMemoryTable`

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #26929: [SPARK-30289][SQL] Partitioned by Nested Column for `InMemoryTable` URL: https://github.com/apache/spark/pull/26929#issuecomment-584435671 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #27517: [WIP][SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27517: [WIP][SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/27517#issuecomment-584435644 Merged build finished. Test PASSed.

[GitHub] [spark] HyukjinKwon commented on issue #27529: [SPARK-30777][PYTHON][TESTS] Fix test failures for Pandas >= 1.0.0

2020-02-10 Thread GitBox
HyukjinKwon commented on issue #27529: [SPARK-30777][PYTHON][TESTS] Fix test failures for Pandas >= 1.0.0 URL: https://github.com/apache/spark/pull/27529#issuecomment-584435468 Merged to master and branch-3.0. Yeah, I think we should port back to branch-2.4 too .. but seems having a

[GitHub] [spark] AmplabJenkins commented on issue #27517: [WIP][SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27517: [WIP][SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/27517#issuecomment-584435651 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26929: [SPARK-30289][SQL] Partitioned by Nested Column for `InMemoryTable`

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #26929: [SPARK-30289][SQL] Partitioned by Nested Column for `InMemoryTable` URL: https://github.com/apache/spark/pull/26929#issuecomment-584435680 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #27517: [WIP][SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-02-10 Thread GitBox
SparkQA commented on issue #27517: [WIP][SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/27517#issuecomment-584435263 **[Test build #118192 has

[GitHub] [spark] SparkQA commented on issue #26929: [SPARK-30289][SQL] Partitioned by Nested Column for `InMemoryTable`

2020-02-10 Thread GitBox
SparkQA commented on issue #26929: [SPARK-30289][SQL] Partitioned by Nested Column for `InMemoryTable` URL: https://github.com/apache/spark/pull/26929#issuecomment-584435322 **[Test build #118193 has

[GitHub] [spark] HyukjinKwon closed pull request #27529: [SPARK-30777][PYTHON][TESTS] Fix test failures for Pandas >= 1.0.0

2020-02-10 Thread GitBox
HyukjinKwon closed pull request #27529: [SPARK-30777][PYTHON][TESTS] Fix test failures for Pandas >= 1.0.0 URL: https://github.com/apache/spark/pull/27529 This is an automated message from the Apache Git Service. To respond

[GitHub] [spark] AmplabJenkins removed a comment on issue #27522: [WIP][SPARK-30762] Add dtype=float32 support to vector_to_array UDF

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27522: [WIP][SPARK-30762] Add dtype=float32 support to vector_to_array UDF URL: https://github.com/apache/spark/pull/27522#issuecomment-584432643 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #23788: [SPARK-27176][SQL] Upgrade hadoop-3's built-in Hive maven dependencies to 2.3.4

2020-02-10 Thread GitBox
dongjoon-hyun commented on a change in pull request #23788: [SPARK-27176][SQL] Upgrade hadoop-3's built-in Hive maven dependencies to 2.3.4 URL: https://github.com/apache/spark/pull/23788#discussion_r377405036 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #23788: [SPARK-27176][SQL] Upgrade hadoop-3's built-in Hive maven dependencies to 2.3.4

2020-02-10 Thread GitBox
dongjoon-hyun commented on a change in pull request #23788: [SPARK-27176][SQL] Upgrade hadoop-3's built-in Hive maven dependencies to 2.3.4 URL: https://github.com/apache/spark/pull/23788#discussion_r377405072 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #23788: [SPARK-27176][SQL] Upgrade hadoop-3's built-in Hive maven dependencies to 2.3.4

2020-02-10 Thread GitBox
dongjoon-hyun commented on a change in pull request #23788: [SPARK-27176][SQL] Upgrade hadoop-3's built-in Hive maven dependencies to 2.3.4 URL: https://github.com/apache/spark/pull/23788#discussion_r377404964 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #27522: [WIP][SPARK-30762] Add dtype=float32 support to vector_to_array UDF

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27522: [WIP][SPARK-30762] Add dtype=float32 support to vector_to_array UDF URL: https://github.com/apache/spark/pull/27522#issuecomment-584432636 Merged build finished. Test FAILed.

[GitHub] [spark] dongjoon-hyun edited a comment on issue #23788: [SPARK-27176][SQL] Upgrade hadoop-3's built-in Hive maven dependencies to 2.3.4

2020-02-10 Thread GitBox
dongjoon-hyun edited a comment on issue #23788: [SPARK-27176][SQL] Upgrade hadoop-3's built-in Hive maven dependencies to 2.3.4 URL: https://github.com/apache/spark/pull/23788#issuecomment-584431781 Hi, @yhuai and @liancheng . This is the PR which switched from `orc:nohive` to

[GitHub] [spark] AmplabJenkins commented on issue #27522: [WIP][SPARK-30762] Add dtype=float32 support to vector_to_array UDF

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27522: [WIP][SPARK-30762] Add dtype=float32 support to vector_to_array UDF URL: https://github.com/apache/spark/pull/27522#issuecomment-584432636 Merged build finished. Test FAILed. This is

[GitHub] [spark] dongjoon-hyun edited a comment on issue #23788: [SPARK-27176][SQL] Upgrade hadoop-3's built-in Hive maven dependencies to 2.3.4

2020-02-10 Thread GitBox
dongjoon-hyun edited a comment on issue #23788: [SPARK-27176][SQL] Upgrade hadoop-3's built-in Hive maven dependencies to 2.3.4 URL: https://github.com/apache/spark/pull/23788#issuecomment-584431781 Hi, @yhuai and @liancheng . This is the PR which switched from `orc:nohive` to

[GitHub] [spark] AmplabJenkins commented on issue #27522: [WIP][SPARK-30762] Add dtype=float32 support to vector_to_array UDF

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27522: [WIP][SPARK-30762] Add dtype=float32 support to vector_to_array UDF URL: https://github.com/apache/spark/pull/27522#issuecomment-584432643 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] viirya commented on issue #27517: [WIP][SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-02-10 Thread GitBox
viirya commented on issue #27517: [WIP][SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/27517#issuecomment-584432517 retest this please This is an

[GitHub] [spark] SparkQA commented on issue #27522: [WIP][SPARK-30762] Add dtype=float32 support to vector_to_array UDF

2020-02-10 Thread GitBox
SparkQA commented on issue #27522: [WIP][SPARK-30762] Add dtype=float32 support to vector_to_array UDF URL: https://github.com/apache/spark/pull/27522#issuecomment-584432416 **[Test build #118190 has

[GitHub] [spark] SparkQA removed a comment on issue #27522: [WIP][SPARK-30762] Add dtype=float32 support to vector_to_array UDF

2020-02-10 Thread GitBox
SparkQA removed a comment on issue #27522: [WIP][SPARK-30762] Add dtype=float32 support to vector_to_array UDF URL: https://github.com/apache/spark/pull/27522#issuecomment-584416447 **[Test build #118190 has

[GitHub] [spark] dongjoon-hyun edited a comment on issue #23788: [SPARK-27176][SQL] Upgrade hadoop-3's built-in Hive maven dependencies to 2.3.4

2020-02-10 Thread GitBox
dongjoon-hyun edited a comment on issue #23788: [SPARK-27176][SQL] Upgrade hadoop-3's built-in Hive maven dependencies to 2.3.4 URL: https://github.com/apache/spark/pull/23788#issuecomment-584431781 Hi, @yhuai and @liancheng . This is the PR which switched from `orc:nohive` to

[GitHub] [spark] dongjoon-hyun commented on issue #23788: [SPARK-27176][SQL] Upgrade hadoop-3's built-in Hive maven dependencies to 2.3.4

2020-02-10 Thread GitBox
dongjoon-hyun commented on issue #23788: [SPARK-27176][SQL] Upgrade hadoop-3's built-in Hive maven dependencies to 2.3.4 URL: https://github.com/apache/spark/pull/23788#issuecomment-584431781 Hi, @yhuai and @liancheng . This is the PR which switched `orc:nohive` to `hive-storage-api`.

[GitHub] [spark] WeichenXu123 commented on a change in pull request #27522: [WIP][SPARK-30762] Add dtype=float32 support to vector_to_array UDF

2020-02-10 Thread GitBox
WeichenXu123 commented on a change in pull request #27522: [WIP][SPARK-30762] Add dtype=float32 support to vector_to_array UDF URL: https://github.com/apache/spark/pull/27522#discussion_r377403274 ## File path: mllib/src/main/scala/org/apache/spark/ml/functions.scala ##

[GitHub] [spark] dongjoon-hyun commented on issue #26619: [SPARK-29981][BUILD] Add hive-1.2/2.3 profiles

2020-02-10 Thread GitBox
dongjoon-hyun commented on issue #26619: [SPARK-29981][BUILD] Add hive-1.2/2.3 profiles URL: https://github.com/apache/spark/pull/26619#issuecomment-584430824 BTW, @yhuai . As I mentioned before to @liancheng , the transition from `orc-nohive` to `hive-storage-api` is not made by me. That

[GitHub] [spark] dongjoon-hyun commented on issue #26619: [SPARK-29981][BUILD] Add hive-1.2/2.3 profiles

2020-02-10 Thread GitBox
dongjoon-hyun commented on issue #26619: [SPARK-29981][BUILD] Add hive-1.2/2.3 profiles URL: https://github.com/apache/spark/pull/26619#issuecomment-584428614 Thank you, @yhuai . During weekend, I missed your comment here.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27532: [SPARK-30782][SQL] Column resolution doesn't respect current catalog/namespace for v2 tables.

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27532: [SPARK-30782][SQL] Column resolution doesn't respect current catalog/namespace for v2 tables. URL: https://github.com/apache/spark/pull/27532#issuecomment-584428501 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27532: [SPARK-30782][SQL] Column resolution doesn't respect current catalog/namespace for v2 tables.

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27532: [SPARK-30782][SQL] Column resolution doesn't respect current catalog/namespace for v2 tables. URL: https://github.com/apache/spark/pull/27532#issuecomment-584428509 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #27532: [SPARK-30782][SQL] Column resolution doesn't respect current catalog/namespace for v2 tables.

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27532: [SPARK-30782][SQL] Column resolution doesn't respect current catalog/namespace for v2 tables. URL: https://github.com/apache/spark/pull/27532#issuecomment-584428509 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #27532: [SPARK-30782][SQL] Column resolution doesn't respect current catalog/namespace for v2 tables.

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27532: [SPARK-30782][SQL] Column resolution doesn't respect current catalog/namespace for v2 tables. URL: https://github.com/apache/spark/pull/27532#issuecomment-584428501 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #27532: [SPARK-30782][SQL] Column resolution doesn't respect current catalog/namespace for v2 tables.

2020-02-10 Thread GitBox
SparkQA commented on issue #27532: [SPARK-30782][SQL] Column resolution doesn't respect current catalog/namespace for v2 tables. URL: https://github.com/apache/spark/pull/27532#issuecomment-584428199 **[Test build #118191 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27493: [SPARK-30751][SQL] Combine the skewed readers into one in AQE skew join optimizations

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27493: [SPARK-30751][SQL] Combine the skewed readers into one in AQE skew join optimizations URL: https://github.com/apache/spark/pull/27493#issuecomment-584426170 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27493: [SPARK-30751][SQL] Combine the skewed readers into one in AQE skew join optimizations

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27493: [SPARK-30751][SQL] Combine the skewed readers into one in AQE skew join optimizations URL: https://github.com/apache/spark/pull/27493#issuecomment-584426175 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #27493: [SPARK-30751][SQL] Combine the skewed readers into one in AQE skew join optimizations

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27493: [SPARK-30751][SQL] Combine the skewed readers into one in AQE skew join optimizations URL: https://github.com/apache/spark/pull/27493#issuecomment-584426170 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27493: [SPARK-30751][SQL] Combine the skewed readers into one in AQE skew join optimizations

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27493: [SPARK-30751][SQL] Combine the skewed readers into one in AQE skew join optimizations URL: https://github.com/apache/spark/pull/27493#issuecomment-584426175 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #27493: [SPARK-30751][SQL] Combine the skewed readers into one in AQE skew join optimizations

2020-02-10 Thread GitBox
SparkQA removed a comment on issue #27493: [SPARK-30751][SQL] Combine the skewed readers into one in AQE skew join optimizations URL: https://github.com/apache/spark/pull/27493#issuecomment-584320495 **[Test build #118178 has

[GitHub] [spark] SparkQA commented on issue #27493: [SPARK-30751][SQL] Combine the skewed readers into one in AQE skew join optimizations

2020-02-10 Thread GitBox
SparkQA commented on issue #27493: [SPARK-30751][SQL] Combine the skewed readers into one in AQE skew join optimizations URL: https://github.com/apache/spark/pull/27493#issuecomment-584425666 **[Test build #118178 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27517: [WIP][SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27517: [WIP][SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/27517#issuecomment-584424807 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] SparkQA removed a comment on issue #27517: [WIP][SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-02-10 Thread GitBox
SparkQA removed a comment on issue #27517: [WIP][SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/27517#issuecomment-584409776 **[Test build #118188 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27517: [WIP][SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-02-10 Thread GitBox
AmplabJenkins removed a comment on issue #27517: [WIP][SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/27517#issuecomment-584424802 Merged build finished. Test FAILed.

[GitHub] [spark] jiangxb1987 commented on a change in pull request #27395: [SPARK-30667][CORE] Add allGather method to BarrierTaskContext

2020-02-10 Thread GitBox
jiangxb1987 commented on a change in pull request #27395: [SPARK-30667][CORE] Add allGather method to BarrierTaskContext URL: https://github.com/apache/spark/pull/27395#discussion_r377394952 ## File path: core/src/main/scala/org/apache/spark/api/python/PythonRunner.scala

[GitHub] [spark] SparkQA commented on issue #27517: [WIP][SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-02-10 Thread GitBox
SparkQA commented on issue #27517: [WIP][SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/27517#issuecomment-584424748 **[Test build #118188 has

[GitHub] [spark] jiangxb1987 commented on a change in pull request #27395: [SPARK-30667][CORE] Add allGather method to BarrierTaskContext

2020-02-10 Thread GitBox
jiangxb1987 commented on a change in pull request #27395: [SPARK-30667][CORE] Add allGather method to BarrierTaskContext URL: https://github.com/apache/spark/pull/27395#discussion_r377392151 ## File path: core/src/main/scala/org/apache/spark/BarrierCoordinator.scala ## @@

[GitHub] [spark] jiangxb1987 commented on a change in pull request #27395: [SPARK-30667][CORE] Add allGather method to BarrierTaskContext

2020-02-10 Thread GitBox
jiangxb1987 commented on a change in pull request #27395: [SPARK-30667][CORE] Add allGather method to BarrierTaskContext URL: https://github.com/apache/spark/pull/27395#discussion_r377390579 ## File path: core/src/main/scala/org/apache/spark/BarrierCoordinator.scala ## @@

[GitHub] [spark] AmplabJenkins commented on issue #27517: [WIP][SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27517: [WIP][SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/27517#issuecomment-584424807 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] jiangxb1987 commented on a change in pull request #27395: [SPARK-30667][CORE] Add allGather method to BarrierTaskContext

2020-02-10 Thread GitBox
jiangxb1987 commented on a change in pull request #27395: [SPARK-30667][CORE] Add allGather method to BarrierTaskContext URL: https://github.com/apache/spark/pull/27395#discussion_r377393009 ## File path: core/src/main/scala/org/apache/spark/BarrierCoordinator.scala ## @@

[GitHub] [spark] jiangxb1987 commented on a change in pull request #27395: [SPARK-30667][CORE] Add allGather method to BarrierTaskContext

2020-02-10 Thread GitBox
jiangxb1987 commented on a change in pull request #27395: [SPARK-30667][CORE] Add allGather method to BarrierTaskContext URL: https://github.com/apache/spark/pull/27395#discussion_r377394231 ## File path: core/src/main/scala/org/apache/spark/BarrierCoordinator.scala ## @@

[GitHub] [spark] jiangxb1987 commented on a change in pull request #27395: [SPARK-30667][CORE] Add allGather method to BarrierTaskContext

2020-02-10 Thread GitBox
jiangxb1987 commented on a change in pull request #27395: [SPARK-30667][CORE] Add allGather method to BarrierTaskContext URL: https://github.com/apache/spark/pull/27395#discussion_r377393548 ## File path: core/src/main/scala/org/apache/spark/BarrierCoordinator.scala ## @@

[GitHub] [spark] jiangxb1987 commented on a change in pull request #27395: [SPARK-30667][CORE] Add allGather method to BarrierTaskContext

2020-02-10 Thread GitBox
jiangxb1987 commented on a change in pull request #27395: [SPARK-30667][CORE] Add allGather method to BarrierTaskContext URL: https://github.com/apache/spark/pull/27395#discussion_r377394605 ## File path: core/src/main/scala/org/apache/spark/BarrierTaskContext.scala ## @@

[GitHub] [spark] AmplabJenkins commented on issue #27517: [WIP][SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-02-10 Thread GitBox
AmplabJenkins commented on issue #27517: [WIP][SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/27517#issuecomment-584424802 Merged build finished. Test FAILed.

[GitHub] [spark] jiangxb1987 commented on a change in pull request #27395: [SPARK-30667][CORE] Add allGather method to BarrierTaskContext

2020-02-10 Thread GitBox
jiangxb1987 commented on a change in pull request #27395: [SPARK-30667][CORE] Add allGather method to BarrierTaskContext URL: https://github.com/apache/spark/pull/27395#discussion_r377393331 ## File path: core/src/main/scala/org/apache/spark/BarrierCoordinator.scala ## @@

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27534: [SPARK-30731][DOCS] Refine workflow for building docs

2020-02-10 Thread GitBox
HyukjinKwon commented on a change in pull request #27534: [SPARK-30731][DOCS] Refine workflow for building docs URL: https://github.com/apache/spark/pull/27534#discussion_r377394873 ## File path: docs/README.md ## @@ -31,15 +31,41 @@ whichever version of Spark you

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27534: [SPARK-30731][DOCS] Refine workflow for building docs

2020-02-10 Thread GitBox
HyukjinKwon commented on a change in pull request #27534: [SPARK-30731][DOCS] Refine workflow for building docs URL: https://github.com/apache/spark/pull/27534#discussion_r377394628 ## File path: docs/README.md ## @@ -58,7 +84,7 @@ Note: Other versions of roxygen2 might

<    1   2   3   4   5   6   7   8   9   10   >