[GitHub] [spark] AmplabJenkins removed a comment on issue #27177: [SPARK-30491][INFRA] Enable dependency audit files to tell dependency classifier

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27177: [SPARK-30491][INFRA] Enable dependency audit files to tell dependency classifier URL: https://github.com/apache/spark/pull/27177#issuecomment-573462927 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27177: [SPARK-30491][INFRA] Enable dependency audit files to tell dependency classifier

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27177: [SPARK-30491][INFRA] Enable dependency audit files to tell dependency classifier URL: https://github.com/apache/spark/pull/27177#issuecomment-573462924 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins removed a comment on issue #27178: [SPARK-30491][INFRA][2.4] Enable dependency audit files to tell dependency classifier

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27178: [SPARK-30491][INFRA][2.4] Enable dependency audit files to tell dependency classifier URL: https://github.com/apache/spark/pull/27178#issuecomment-573462928 Test PASSed. Refer to this link for build results (access rights to CI server need

[GitHub] [spark] AmplabJenkins commented on issue #27178: [SPARK-30491][INFRA][2.4] Enable dependency audit files to tell dependency classifier

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27178: [SPARK-30491][INFRA][2.4] Enable dependency audit files to tell dependency classifier URL: https://github.com/apache/spark/pull/27178#issuecomment-573462925 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27177: [SPARK-30491][INFRA] Enable dependency audit files to tell dependency classifier

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27177: [SPARK-30491][INFRA] Enable dependency audit files to tell dependency classifier URL: https://github.com/apache/spark/pull/27177#issuecomment-573462927 Test PASSed. Refer to this link for build results (access rights to CI server needed): htt

[GitHub] [spark] AmplabJenkins commented on issue #27177: [SPARK-30491][INFRA] Enable dependency audit files to tell dependency classifier

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27177: [SPARK-30491][INFRA] Enable dependency audit files to tell dependency classifier URL: https://github.com/apache/spark/pull/27177#issuecomment-573462924 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins commented on issue #27178: [SPARK-30491][INFRA][2.4] Enable dependency audit files to tell dependency classifier

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27178: [SPARK-30491][INFRA][2.4] Enable dependency audit files to tell dependency classifier URL: https://github.com/apache/spark/pull/27178#issuecomment-573462928 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #27178: [SPARK-30491][INFRA][2.4] Enable dependency audit files to tell dependency classifier

2020-01-12 Thread GitBox
SparkQA commented on issue #27178: [SPARK-30491][INFRA][2.4] Enable dependency audit files to tell dependency classifier URL: https://github.com/apache/spark/pull/27178#issuecomment-573462800 **[Test build #116571 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuil

[GitHub] [spark] SparkQA commented on issue #27177: [SPARK-30491][INFRA] Enable dependency audit files to tell dependency classifier

2020-01-12 Thread GitBox
SparkQA commented on issue #27177: [SPARK-30491][INFRA] Enable dependency audit files to tell dependency classifier URL: https://github.com/apache/spark/pull/27177#issuecomment-573462808 **[Test build #116572 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/1

[GitHub] [spark] AmplabJenkins removed a comment on issue #27177: [SPARK-30491][INFRA] Enable dependency audit files to tell dependency classifier

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27177: [SPARK-30491][INFRA] Enable dependency audit files to tell dependency classifier URL: https://github.com/apache/spark/pull/27177#issuecomment-573434596 Can one of the admins verify this patch?

[GitHub] [spark] dongjoon-hyun commented on issue #27178: [SPARK-30491][2.4] Enable dependency audit files to tell dependency classifier

2020-01-12 Thread GitBox
dongjoon-hyun commented on issue #27178: [SPARK-30491][2.4] Enable dependency audit files to tell dependency classifier URL: https://github.com/apache/spark/pull/27178#issuecomment-573462226 Thank you for your first contribution, @mengCareers . -

[GitHub] [spark] dongjoon-hyun commented on issue #27177: [SPARK-30491] Enable dependency audit files to tell dependency classifier

2020-01-12 Thread GitBox
dongjoon-hyun commented on issue #27177: [SPARK-30491] Enable dependency audit files to tell dependency classifier URL: https://github.com/apache/spark/pull/27177#issuecomment-573462297 ok to test This is an automated message

[GitHub] [spark] dongjoon-hyun commented on issue #27177: [SPARK-30491] Enable dependency audit files to tell dependency classifier

2020-01-12 Thread GitBox
dongjoon-hyun commented on issue #27177: [SPARK-30491] Enable dependency audit files to tell dependency classifier URL: https://github.com/apache/spark/pull/27177#issuecomment-573462291 Thank you for your first contribution, @mengCareers . You opened two PRs (master and branch-2.4), right?

[GitHub] [spark] dongjoon-hyun commented on issue #27178: [SPARK-30491][2.4] Enable dependency audit files to tell dependency classifier

2020-01-12 Thread GitBox
dongjoon-hyun commented on issue #27178: [SPARK-30491][2.4] Enable dependency audit files to tell dependency classifier URL: https://github.com/apache/spark/pull/27178#issuecomment-573462241 ok to test This is an automated me

[GitHub] [spark] AmplabJenkins removed a comment on issue #27178: [SPARK-30491][2.4] Enable dependency audit files to tell dependency classifier

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27178: [SPARK-30491][2.4] Enable dependency audit files to tell dependency classifier URL: https://github.com/apache/spark/pull/27178#issuecomment-573436783 Can one of the admins verify this patch? --

[GitHub] [spark] dongjoon-hyun edited a comment on issue #27179: [SPARK-30492][SQL] Eliminate deprecation warnings in ORC datasource

2020-01-12 Thread GitBox
dongjoon-hyun edited a comment on issue #27179: [SPARK-30492][SQL] Eliminate deprecation warnings in ORC datasource URL: https://github.com/apache/spark/pull/27179#issuecomment-573462060 Historically, `org.apache.spark.sql.hive.orc.OrcFileFormat` was using the the built-in ORC of Hive 1.2.

[GitHub] [spark] dongjoon-hyun commented on issue #27179: [SPARK-30492][SQL] Eliminate deprecation warnings in ORC datasource

2020-01-12 Thread GitBox
dongjoon-hyun commented on issue #27179: [SPARK-30492][SQL] Eliminate deprecation warnings in ORC datasource URL: https://github.com/apache/spark/pull/27179#issuecomment-573462060 Historically, `org.apache.spark.sql.hive.orc.OrcFileFormat` was using the the built-in ORC of Hive 1.2.1 modul

[GitHub] [spark] MaxGekk commented on issue #27179: [SPARK-30492][SQL] Eliminate deprecation warnings in ORC datasource

2020-01-12 Thread GitBox
MaxGekk commented on issue #27179: [SPARK-30492][SQL] Eliminate deprecation warnings in ORC datasource URL: https://github.com/apache/spark/pull/27179#issuecomment-573461238 @dongjoon-hyun Just in case, do you know why there are 2 ORC implementations: - org.apache.spark.sql.hive.orc.OrcF

[GitHub] [spark] HeartSaVioR commented on issue #27158: [MINOR][BUILD][PYSPARK] Disable test_memory_limit test temporarily

2020-01-12 Thread GitBox
HeartSaVioR commented on issue #27158: [MINOR][BUILD][PYSPARK] Disable test_memory_limit test temporarily URL: https://github.com/apache/spark/pull/27158#issuecomment-573459496 We've realized the patch didn't work, although the builds succeeded for the patch itself. I feel we may ne

[GitHub] [spark] dongjoon-hyun closed pull request #27078: [SPARK-30409][SPARK-29173][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks

2020-01-12 Thread GitBox
dongjoon-hyun closed pull request #27078: [SPARK-30409][SPARK-29173][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks URL: https://github.com/apache/spark/pull/27078 This is an automated message from the Apache Git Servic

[GitHub] [spark] MaxGekk commented on a change in pull request #27078: [SPARK-30409][SPARK-29173][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks

2020-01-12 Thread GitBox
MaxGekk commented on a change in pull request #27078: [SPARK-30409][SPARK-29173][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks URL: https://github.com/apache/spark/pull/27078#discussion_r365611495 ## File path: sql/core/benchmarks/JoinBenchmark-results.txt ## @@ -2,7

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27078: [SPARK-30409][SPARK-29173][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks

2020-01-12 Thread GitBox
dongjoon-hyun commented on a change in pull request #27078: [SPARK-30409][SPARK-29173][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks URL: https://github.com/apache/spark/pull/27078#discussion_r365611089 ## File path: sql/core/benchmarks/JoinBenchmark-results.txt ## @

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27078: [SPARK-30409][SPARK-29173][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks

2020-01-12 Thread GitBox
dongjoon-hyun commented on a change in pull request #27078: [SPARK-30409][SPARK-29173][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks URL: https://github.com/apache/spark/pull/27078#discussion_r365611204 ## File path: sql/core/benchmarks/JoinBenchmark-results.txt ## @

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27078: [SPARK-30409][SPARK-29173][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks

2020-01-12 Thread GitBox
dongjoon-hyun commented on a change in pull request #27078: [SPARK-30409][SPARK-29173][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks URL: https://github.com/apache/spark/pull/27078#discussion_r365611089 ## File path: sql/core/benchmarks/JoinBenchmark-results.txt ## @

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27078: [SPARK-30409][SPARK-29173][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks

2020-01-12 Thread GitBox
dongjoon-hyun commented on a change in pull request #27078: [SPARK-30409][SPARK-29173][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks URL: https://github.com/apache/spark/pull/27078#discussion_r365611089 ## File path: sql/core/benchmarks/JoinBenchmark-results.txt ## @

[GitHub] [spark] AmplabJenkins removed a comment on issue #27030: [SPARK-30244][SQL] Emit pre/post events for "Partition" methods in ExternalCatalogWithListener

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27030: [SPARK-30244][SQL] Emit pre/post events for "Partition" methods in ExternalCatalogWithListener URL: https://github.com/apache/spark/pull/27030#issuecomment-573457358 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #27030: [SPARK-30244][SQL] Emit pre/post events for "Partition" methods in ExternalCatalogWithListener

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27030: [SPARK-30244][SQL] Emit pre/post events for "Partition" methods in ExternalCatalogWithListener URL: https://github.com/apache/spark/pull/27030#issuecomment-573457361 Test PASSed. Refer to this link for build results (access rights to CI server nee

[GitHub] [spark] AmplabJenkins removed a comment on issue #27030: [SPARK-30244][SQL] Emit pre/post events for "Partition" methods in ExternalCatalogWithListener

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27030: [SPARK-30244][SQL] Emit pre/post events for "Partition" methods in ExternalCatalogWithListener URL: https://github.com/apache/spark/pull/27030#issuecomment-573457361 Test PASSed. Refer to this link for build results (access rights to CI se

[GitHub] [spark] MaxGekk commented on issue #27078: [SPARK-30409][SPARK-29173][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks

2020-01-12 Thread GitBox
MaxGekk commented on issue #27078: [SPARK-30409][SPARK-29173][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks URL: https://github.com/apache/spark/pull/27078#issuecomment-573457360 > It would be the change on the underlying master branch code. I think it makes sense to open separ

[GitHub] [spark] AmplabJenkins commented on issue #27030: [SPARK-30244][SQL] Emit pre/post events for "Partition" methods in ExternalCatalogWithListener

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27030: [SPARK-30244][SQL] Emit pre/post events for "Partition" methods in ExternalCatalogWithListener URL: https://github.com/apache/spark/pull/27030#issuecomment-573457358 Merged build finished. Test PASSed. ---

[GitHub] [spark] SparkQA commented on issue #27030: [SPARK-30244][SQL] Emit pre/post events for "Partition" methods in ExternalCatalogWithListener

2020-01-12 Thread GitBox
SparkQA commented on issue #27030: [SPARK-30244][SQL] Emit pre/post events for "Partition" methods in ExternalCatalogWithListener URL: https://github.com/apache/spark/pull/27030#issuecomment-573457218 **[Test build #116570 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRe

[GitHub] [spark] dongjoon-hyun commented on issue #27078: [SPARK-30409][SPARK-29173][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks

2020-01-12 Thread GitBox
dongjoon-hyun commented on issue #27078: [SPARK-30409][SPARK-29173][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks URL: https://github.com/apache/spark/pull/27078#issuecomment-573456912 Thank you. No problem, @MaxGekk . What I want to say is that this `NoOp` PR improves many cas

[GitHub] [spark] ayudovin commented on a change in pull request #27030: [SPARK-30244][SQL] Emit pre/post events for "Partition" methods in ExternalCatalogWithListener

2020-01-12 Thread GitBox
ayudovin commented on a change in pull request #27030: [SPARK-30244][SQL] Emit pre/post events for "Partition" methods in ExternalCatalogWithListener URL: https://github.com/apache/spark/pull/27030#discussion_r365610473 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql

[GitHub] [spark] AmplabJenkins removed a comment on issue #27078: [SPARK-30409][SPARK-29173][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27078: [SPARK-30409][SPARK-29173][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks URL: https://github.com/apache/spark/pull/27078#issuecomment-57345 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] dongjoon-hyun edited a comment on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer

2020-01-12 Thread GitBox
dongjoon-hyun edited a comment on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer URL: https://github.com/apache/spark/pull/27077#issuecomment-573456542 @apapi . I've took a look at this PR for 2.4.5 release, but I'd like to recommend you to close t

[GitHub] [spark] AmplabJenkins commented on issue #27078: [SPARK-30409][SPARK-29173][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27078: [SPARK-30409][SPARK-29173][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks URL: https://github.com/apache/spark/pull/27078#issuecomment-573456661 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #27078: [SPARK-30409][SPARK-29173][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27078: [SPARK-30409][SPARK-29173][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks URL: https://github.com/apache/spark/pull/27078#issuecomment-573456661 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #27078: [SPARK-30409][SPARK-29173][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27078: [SPARK-30409][SPARK-29173][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks URL: https://github.com/apache/spark/pull/27078#issuecomment-57345 Test PASSed. Refer to this link for build results (access rights to CI server needed): https

[GitHub] [spark] dongjoon-hyun commented on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer

2020-01-12 Thread GitBox
dongjoon-hyun commented on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer URL: https://github.com/apache/spark/pull/27077#issuecomment-573456542 @apapi . I've took a look at this PR for 2.4.5 release, but I'd like to recommend you to close this PR

[GitHub] [spark] SparkQA commented on issue #27078: [SPARK-30409][SPARK-29173][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks

2020-01-12 Thread GitBox
SparkQA commented on issue #27078: [SPARK-30409][SPARK-29173][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks URL: https://github.com/apache/spark/pull/27078#issuecomment-573456533 **[Test build #116569 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116

[GitHub] [spark] MaxGekk removed a comment on issue #27179: [SPARK-30492][SQL] Eliminate deprecation warnings in ORC datasource

2020-01-12 Thread GitBox
MaxGekk removed a comment on issue #27179: [SPARK-30492][SQL] Eliminate deprecation warnings in ORC datasource URL: https://github.com/apache/spark/pull/27179#issuecomment-573455876 > BTW, could you finish #27078 first? Sorry, could you elaborate what I should finish? --

[GitHub] [spark] dongjoon-hyun commented on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer

2020-01-12 Thread GitBox
dongjoon-hyun commented on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer URL: https://github.com/apache/spark/pull/27077#issuecomment-573456305 The correct usage for DataSet is the following. ```scala scala> val groupData = dataset.repartitio

[GitHub] [spark] AmplabJenkins removed a comment on issue #27179: [SPARK-30492][SQL] Eliminate deprecation warnings in ORC datasource

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27179: [SPARK-30492][SQL] Eliminate deprecation warnings in ORC datasource URL: https://github.com/apache/spark/pull/27179#issuecomment-573455950 Merged build finished. Test PASSed. T

[GitHub] [spark] AmplabJenkins removed a comment on issue #27179: [SPARK-30492][SQL] Eliminate deprecation warnings in ORC datasource

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27179: [SPARK-30492][SQL] Eliminate deprecation warnings in ORC datasource URL: https://github.com/apache/spark/pull/27179#issuecomment-573455955 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://

[GitHub] [spark] MaxGekk commented on issue #27078: [SPARK-30409][SPARK-29173][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks

2020-01-12 Thread GitBox
MaxGekk commented on issue #27078: [SPARK-30409][SPARK-29173][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks URL: https://github.com/apache/spark/pull/27078#issuecomment-573455975 @dongjoon-hyun oh, sorry I missed your second PR. --

[GitHub] [spark] AmplabJenkins commented on issue #27179: [SPARK-30492][SQL] Eliminate deprecation warnings in ORC datasource

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27179: [SPARK-30492][SQL] Eliminate deprecation warnings in ORC datasource URL: https://github.com/apache/spark/pull/27179#issuecomment-573455955 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.c

[GitHub] [spark] AmplabJenkins commented on issue #27179: [SPARK-30492][SQL] Eliminate deprecation warnings in ORC datasource

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27179: [SPARK-30492][SQL] Eliminate deprecation warnings in ORC datasource URL: https://github.com/apache/spark/pull/27179#issuecomment-573455950 Merged build finished. Test PASSed. This is a

[GitHub] [spark] MaxGekk commented on issue #27179: [SPARK-30492][SQL] Eliminate deprecation warnings in ORC datasource

2020-01-12 Thread GitBox
MaxGekk commented on issue #27179: [SPARK-30492][SQL] Eliminate deprecation warnings in ORC datasource URL: https://github.com/apache/spark/pull/27179#issuecomment-573455876 > BTW, could you finish #27078 first? Sorry, could you elaborate what I should finish? --

[GitHub] [spark] MaxGekk commented on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests

2020-01-12 Thread GitBox
MaxGekk commented on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests URL: https://github.com/apache/spark/pull/27166#issuecomment-573455771 I reverted all the changes of this PR, and python tests passed (https://github.com/apache/spark/pu

[GitHub] [spark] SparkQA commented on issue #27179: [SPARK-30492][SQL] Eliminate deprecation warnings in ORC datasource

2020-01-12 Thread GitBox
SparkQA commented on issue #27179: [SPARK-30492][SQL] Eliminate deprecation warnings in ORC datasource URL: https://github.com/apache/spark/pull/27179#issuecomment-573455810 **[Test build #116568 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116568/testRep

[GitHub] [spark] dongjoon-hyun commented on issue #27179: [SPARK-30492][SQL] Eliminate deprecation warnings in ORC datasource

2020-01-12 Thread GitBox
dongjoon-hyun commented on issue #27179: [SPARK-30492][SQL] Eliminate deprecation warnings in ORC datasource URL: https://github.com/apache/spark/pull/27179#issuecomment-573455755 Thank you for pinging me, @MaxGekk . Sure! BTW, could you finish https://github.com/apache/spark/pull/27078

[GitHub] [spark] MaxGekk commented on issue #27179: [SPARK-30492][SQL] Eliminate deprecation warnings in ORC datasource

2020-01-12 Thread GitBox
MaxGekk commented on issue #27179: [SPARK-30492][SQL] Eliminate deprecation warnings in ORC datasource URL: https://github.com/apache/spark/pull/27179#issuecomment-573455410 @dongjoon-hyun Please, take a look at this. This is

[GitHub] [spark] MaxGekk opened a new pull request #27179: [SPARK-30492][SQL] Eliminate deprecation warnings in ORC datasource

2020-01-12 Thread GitBox
MaxGekk opened a new pull request #27179: [SPARK-30492][SQL] Eliminate deprecation warnings in ORC datasource URL: https://github.com/apache/spark/pull/27179 ### What changes were proposed in this pull request? In the PR, I propose to avoid usage of `getTypes()` in the `SparkOrcNewRecor

[GitHub] [spark] MaxGekk commented on a change in pull request #24018: [SPARK-23749][SQL] Replace built-in Hive API (isSub/toKryo) and remove OrcProto.Type usage

2020-01-12 Thread GitBox
MaxGekk commented on a change in pull request #24018: [SPARK-23749][SQL] Replace built-in Hive API (isSub/toKryo) and remove OrcProto.Type usage URL: https://github.com/apache/spark/pull/24018#discussion_r365608968 ## File path: sql/hive/src/main/java/org/apache/hadoop/hive/ql/io/o

[GitHub] [spark] AmplabJenkins removed a comment on issue #27165: [SPARK-28264][PYTHON][SQL] Support type hints in pandas UDF and rename/move inconsistent pandas UDF types

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27165: [SPARK-28264][PYTHON][SQL] Support type hints in pandas UDF and rename/move inconsistent pandas UDF types URL: https://github.com/apache/spark/pull/27165#issuecomment-573454266 Test PASSed. Refer to this link for build results (access righ

[GitHub] [spark] AmplabJenkins removed a comment on issue #27165: [SPARK-28264][PYTHON][SQL] Support type hints in pandas UDF and rename/move inconsistent pandas UDF types

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27165: [SPARK-28264][PYTHON][SQL] Support type hints in pandas UDF and rename/move inconsistent pandas UDF types URL: https://github.com/apache/spark/pull/27165#issuecomment-573454261 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27165: [SPARK-28264][PYTHON][SQL] Support type hints in pandas UDF and rename/move inconsistent pandas UDF types

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27165: [SPARK-28264][PYTHON][SQL] Support type hints in pandas UDF and rename/move inconsistent pandas UDF types URL: https://github.com/apache/spark/pull/27165#issuecomment-573454266 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #27165: [SPARK-28264][PYTHON][SQL] Support type hints in pandas UDF and rename/move inconsistent pandas UDF types

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27165: [SPARK-28264][PYTHON][SQL] Support type hints in pandas UDF and rename/move inconsistent pandas UDF types URL: https://github.com/apache/spark/pull/27165#issuecomment-573454261 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #27165: [SPARK-28264][PYTHON][SQL] Support type hints in pandas UDF and rename/move inconsistent pandas UDF types

2020-01-12 Thread GitBox
SparkQA removed a comment on issue #27165: [SPARK-28264][PYTHON][SQL] Support type hints in pandas UDF and rename/move inconsistent pandas UDF types URL: https://github.com/apache/spark/pull/27165#issuecomment-573440803 **[Test build #116564 has started](https://amplab.cs.berkeley.edu/jenk

[GitHub] [spark] SparkQA commented on issue #27165: [SPARK-28264][PYTHON][SQL] Support type hints in pandas UDF and rename/move inconsistent pandas UDF types

2020-01-12 Thread GitBox
SparkQA commented on issue #27165: [SPARK-28264][PYTHON][SQL] Support type hints in pandas UDF and rename/move inconsistent pandas UDF types URL: https://github.com/apache/spark/pull/27165#issuecomment-573454068 **[Test build #116564 has finished](https://amplab.cs.berkeley.edu/jenkins/job

[GitHub] [spark] AmplabJenkins removed a comment on issue #26813: [SPARK-30188][SQL][WIP][test-hive1.2] Resolve the failed unit tests when enable AQE

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #26813: [SPARK-30188][SQL][WIP][test-hive1.2] Resolve the failed unit tests when enable AQE URL: https://github.com/apache/spark/pull/26813#issuecomment-573453097 Test PASSed. Refer to this link for build results (access rights to CI server neede

[GitHub] [spark] AmplabJenkins removed a comment on issue #26813: [SPARK-30188][SQL][WIP][test-hive1.2] Resolve the failed unit tests when enable AQE

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #26813: [SPARK-30188][SQL][WIP][test-hive1.2] Resolve the failed unit tests when enable AQE URL: https://github.com/apache/spark/pull/26813#issuecomment-573453093 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins commented on issue #26813: [SPARK-30188][SQL][WIP][test-hive1.2] Resolve the failed unit tests when enable AQE

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #26813: [SPARK-30188][SQL][WIP][test-hive1.2] Resolve the failed unit tests when enable AQE URL: https://github.com/apache/spark/pull/26813#issuecomment-573453097 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24018: [SPARK-23749][SQL] Replace built-in Hive API (isSub/toKryo) and remove OrcProto.Type usage

2020-01-12 Thread GitBox
dongjoon-hyun commented on a change in pull request #24018: [SPARK-23749][SQL] Replace built-in Hive API (isSub/toKryo) and remove OrcProto.Type usage URL: https://github.com/apache/spark/pull/24018#discussion_r365607937 ## File path: sql/hive/src/main/java/org/apache/hadoop/hive/q

[GitHub] [spark] AmplabJenkins commented on issue #26813: [SPARK-30188][SQL][WIP][test-hive1.2] Resolve the failed unit tests when enable AQE

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #26813: [SPARK-30188][SQL][WIP][test-hive1.2] Resolve the failed unit tests when enable AQE URL: https://github.com/apache/spark/pull/26813#issuecomment-573453093 Merged build finished. Test PASSed. --

[GitHub] [spark] SparkQA commented on issue #26813: [SPARK-30188][SQL][WIP][test-hive1.2] Resolve the failed unit tests when enable AQE

2020-01-12 Thread GitBox
SparkQA commented on issue #26813: [SPARK-30188][SQL][WIP][test-hive1.2] Resolve the failed unit tests when enable AQE URL: https://github.com/apache/spark/pull/26813#issuecomment-573452919 **[Test build #116567 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilde

[GitHub] [spark] dongjoon-hyun commented on issue #26813: [SPARK-30188][SQL][WIP][test-hive1.2] Resolve the failed unit tests when enable AQE

2020-01-12 Thread GitBox
dongjoon-hyun commented on issue #26813: [SPARK-30188][SQL][WIP][test-hive1.2] Resolve the failed unit tests when enable AQE URL: https://github.com/apache/spark/pull/26813#issuecomment-573452826 I triggered for `hive-1.2` test. After it passed, please disable AQE to `.createWithDefault(fa

[GitHub] [spark] dongjoon-hyun commented on issue #26813: [SPARK-30188][SQL][WIP][test-hive1.2] Resolve the failed unit tests when enable AQE

2020-01-12 Thread GitBox
dongjoon-hyun commented on issue #26813: [SPARK-30188][SQL][WIP][test-hive1.2] Resolve the failed unit tests when enable AQE URL: https://github.com/apache/spark/pull/26813#issuecomment-573452715 Hi, @JkSelf . Since we have one successful run, we need to test the following. - Test with

[GitHub] [spark] dongjoon-hyun commented on issue #26813: [SPARK-30188][SQL][WIP][test-hive1.2] Resolve the failed unit tests when enable AQE

2020-01-12 Thread GitBox
dongjoon-hyun commented on issue #26813: [SPARK-30188][SQL][WIP][test-hive1.2] Resolve the failed unit tests when enable AQE URL: https://github.com/apache/spark/pull/26813#issuecomment-573452723 Retest this please. This is a

[GitHub] [spark] AmplabJenkins removed a comment on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests URL: https://github.com/apache/spark/pull/27166#issuecomment-573451407 Test FAILed. Refer to this link for build results (access rights to CI server nee

[GitHub] [spark] AmplabJenkins removed a comment on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests URL: https://github.com/apache/spark/pull/27166#issuecomment-573451404 Merged build finished. Test FAILed. ---

[GitHub] [spark] AmplabJenkins commented on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests URL: https://github.com/apache/spark/pull/27166#issuecomment-573451407 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests URL: https://github.com/apache/spark/pull/27166#issuecomment-573451404 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests

2020-01-12 Thread GitBox
SparkQA removed a comment on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests URL: https://github.com/apache/spark/pull/27166#issuecomment-573441499 **[Test build #116565 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullReq

[GitHub] [spark] SparkQA commented on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests

2020-01-12 Thread GitBox
SparkQA commented on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests URL: https://github.com/apache/spark/pull/27166#issuecomment-573451307 **[Test build #116565 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBui

[GitHub] [spark] AmplabJenkins removed a comment on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3 URL: https://github.com/apache/spark/pull/27169#issuecomment-573449712 Test PASSed. Refer to this link for build results (access rights to CI server needed): https:

[GitHub] [spark] AmplabJenkins removed a comment on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3 URL: https://github.com/apache/spark/pull/27169#issuecomment-573449710 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3 URL: https://github.com/apache/spark/pull/27169#issuecomment-573449710 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3 URL: https://github.com/apache/spark/pull/27169#issuecomment-573449712 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab

[GitHub] [spark] SparkQA commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3

2020-01-12 Thread GitBox
SparkQA commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3 URL: https://github.com/apache/spark/pull/27169#issuecomment-573449586 **[Test build #116566 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116566/testR

[GitHub] [spark] AmplabJenkins removed a comment on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3 URL: https://github.com/apache/spark/pull/27169#issuecomment-573446845 Test FAILed. Refer to this link for build results (access rights to CI server needed): https:/

[GitHub] [spark] AmplabJenkins removed a comment on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3 URL: https://github.com/apache/spark/pull/27169#issuecomment-573446843 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3 URL: https://github.com/apache/spark/pull/27169#issuecomment-573446843 Merged build finished. Test FAILed. This is

[GitHub] [spark] AmplabJenkins commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3 URL: https://github.com/apache/spark/pull/27169#issuecomment-573446845 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.

[GitHub] [spark] SparkQA removed a comment on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3

2020-01-12 Thread GitBox
SparkQA removed a comment on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3 URL: https://github.com/apache/spark/pull/27169#issuecomment-573426223 **[Test build #116558 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/1165

[GitHub] [spark] SparkQA commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3

2020-01-12 Thread GitBox
SparkQA commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3 URL: https://github.com/apache/spark/pull/27169#issuecomment-573446744 **[Test build #116558 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116558/test

[GitHub] [spark] AmplabJenkins removed a comment on issue #27176: [WIP][SPIP]Support year-month and day-time interval types

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27176: [WIP][SPIP]Support year-month and day-time interval types URL: https://github.com/apache/spark/pull/27176#issuecomment-573446014 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.b

[GitHub] [spark] AmplabJenkins removed a comment on issue #27176: [WIP][SPIP]Support year-month and day-time interval types

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27176: [WIP][SPIP]Support year-month and day-time interval types URL: https://github.com/apache/spark/pull/27176#issuecomment-573446012 Merged build finished. Test FAILed. This is an

[GitHub] [spark] SparkQA removed a comment on issue #27176: [WIP][SPIP]Support year-month and day-time interval types

2020-01-12 Thread GitBox
SparkQA removed a comment on issue #27176: [WIP][SPIP]Support year-month and day-time interval types URL: https://github.com/apache/spark/pull/27176#issuecomment-573436697 **[Test build #116563 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116563/testRepor

[GitHub] [spark] AmplabJenkins commented on issue #27176: [WIP][SPIP]Support year-month and day-time interval types

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27176: [WIP][SPIP]Support year-month and day-time interval types URL: https://github.com/apache/spark/pull/27176#issuecomment-573446012 Merged build finished. Test FAILed. This is an automate

[GitHub] [spark] AmplabJenkins commented on issue #27176: [WIP][SPIP]Support year-month and day-time interval types

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27176: [WIP][SPIP]Support year-month and day-time interval types URL: https://github.com/apache/spark/pull/27176#issuecomment-573446014 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.

[GitHub] [spark] SparkQA commented on issue #27176: [WIP][SPIP]Support year-month and day-time interval types

2020-01-12 Thread GitBox
SparkQA commented on issue #27176: [WIP][SPIP]Support year-month and day-time interval types URL: https://github.com/apache/spark/pull/27176#issuecomment-573445947 **[Test build #116563 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116563/testReport)** f

[GitHub] [spark] AmplabJenkins removed a comment on issue #27176: [WIP][SPIP]Support year-month and day-time interval types

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27176: [WIP][SPIP]Support year-month and day-time interval types URL: https://github.com/apache/spark/pull/27176#issuecomment-57328 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.b

[GitHub] [spark] AmplabJenkins removed a comment on issue #27176: [WIP][SPIP]Support year-month and day-time interval types

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27176: [WIP][SPIP]Support year-month and day-time interval types URL: https://github.com/apache/spark/pull/27176#issuecomment-57322 Merged build finished. Test FAILed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #27176: [WIP][SPIP]Support year-month and day-time interval types

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27176: [WIP][SPIP]Support year-month and day-time interval types URL: https://github.com/apache/spark/pull/27176#issuecomment-57322 Merged build finished. Test FAILed. This is an automate

[GitHub] [spark] SparkQA removed a comment on issue #27176: [WIP][SPIP]Support year-month and day-time interval types

2020-01-12 Thread GitBox
SparkQA removed a comment on issue #27176: [WIP][SPIP]Support year-month and day-time interval types URL: https://github.com/apache/spark/pull/27176#issuecomment-573434515 **[Test build #116561 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116561/testRepor

[GitHub] [spark] AmplabJenkins commented on issue #27176: [WIP][SPIP]Support year-month and day-time interval types

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27176: [WIP][SPIP]Support year-month and day-time interval types URL: https://github.com/apache/spark/pull/27176#issuecomment-57328 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27176: [WIP][SPIP]Support year-month and day-time interval types

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27176: [WIP][SPIP]Support year-month and day-time interval types URL: https://github.com/apache/spark/pull/27176#issuecomment-573444165 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.b

[GitHub] [spark] SparkQA commented on issue #27176: [WIP][SPIP]Support year-month and day-time interval types

2020-01-12 Thread GitBox
SparkQA commented on issue #27176: [WIP][SPIP]Support year-month and day-time interval types URL: https://github.com/apache/spark/pull/27176#issuecomment-573444344 **[Test build #116561 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116561/testReport)** f

[GitHub] [spark] AmplabJenkins removed a comment on issue #27176: [WIP][SPIP]Support year-month and day-time interval types

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27176: [WIP][SPIP]Support year-month and day-time interval types URL: https://github.com/apache/spark/pull/27176#issuecomment-573444163 Merged build finished. Test FAILed. This is an

<    2   3   4   5   6   7   8   9   10   >