[GitHub] [spark] HyukjinKwon commented on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests

2020-01-12 Thread GitBox
HyukjinKwon commented on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests URL: https://github.com/apache/spark/pull/27166#issuecomment-573399764 @MaxGekk, I can't take a close look right now but it might be related to the Jenkins machine

[GitHub] [spark] prog012 commented on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer

2020-01-12 Thread GitBox
prog012 commented on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer URL: https://github.com/apache/spark/pull/27077#issuecomment-573399776 @dongjoon-hyun Yes, the dataset is partitioned as following in the example: ``` partition 0:

[GitHub] [spark] SparkQA commented on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests

2020-01-12 Thread GitBox
SparkQA commented on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests URL: https://github.com/apache/spark/pull/27166#issuecomment-573400057 **[Test build #116553 has

[GitHub] [spark] SparkQA commented on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer

2020-01-12 Thread GitBox
SparkQA commented on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer URL: https://github.com/apache/spark/pull/27077#issuecomment-573400732 **[Test build #116554 has

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27174: [SPARK-30490][SQL] Eliminate compiler warnings in Avro datasource

2020-01-12 Thread GitBox
HyukjinKwon commented on a change in pull request #27174: [SPARK-30490][SQL] Eliminate compiler warnings in Avro datasource URL: https://github.com/apache/spark/pull/27174#discussion_r365572168 ## File path: external/avro/src/main/scala/org/apache/spark/sql/avro/AvroOptions.scala

[GitHub] [spark] MaxGekk commented on a change in pull request #27174: [SPARK-30490][SQL] Eliminate compiler warnings in Avro datasource

2020-01-12 Thread GitBox
MaxGekk commented on a change in pull request #27174: [SPARK-30490][SQL] Eliminate compiler warnings in Avro datasource URL: https://github.com/apache/spark/pull/27174#discussion_r365572710 ## File path: external/avro/src/main/scala/org/apache/spark/sql/avro/AvroOptions.scala

[GitHub] [spark] MaxGekk commented on a change in pull request #27174: [SPARK-30490][SQL] Eliminate compiler warnings in Avro datasource

2020-01-12 Thread GitBox
MaxGekk commented on a change in pull request #27174: [SPARK-30490][SQL] Eliminate compiler warnings in Avro datasource URL: https://github.com/apache/spark/pull/27174#discussion_r365572710 ## File path: external/avro/src/main/scala/org/apache/spark/sql/avro/AvroOptions.scala

[GitHub] [spark] AmplabJenkins commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3 URL: https://github.com/apache/spark/pull/27169#issuecomment-573407641 Merged build finished. Test FAILed. This

[GitHub] [spark] AmplabJenkins commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3 URL: https://github.com/apache/spark/pull/27169#issuecomment-573407643 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27165: [SPARK-28264][PYTHON][SQL] Support type hints in pandas UDF and rename/move inconsistent pandas UDF types

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27165: [SPARK-28264][PYTHON][SQL] Support type hints in pandas UDF and rename/move inconsistent pandas UDF types URL: https://github.com/apache/spark/pull/27165#issuecomment-573407631 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA commented on issue #27165: [SPARK-28264][PYTHON][SQL] Support type hints in pandas UDF and rename/move inconsistent pandas UDF types

2020-01-12 Thread GitBox
SparkQA commented on issue #27165: [SPARK-28264][PYTHON][SQL] Support type hints in pandas UDF and rename/move inconsistent pandas UDF types URL: https://github.com/apache/spark/pull/27165#issuecomment-573407539 **[Test build #116552 has

[GitHub] [spark] SparkQA commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3

2020-01-12 Thread GitBox
SparkQA commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3 URL: https://github.com/apache/spark/pull/27169#issuecomment-573407522 **[Test build #116550 has

[GitHub] [spark] SparkQA removed a comment on issue #27165: [SPARK-28264][PYTHON][SQL] Support type hints in pandas UDF and rename/move inconsistent pandas UDF types

2020-01-12 Thread GitBox
SparkQA removed a comment on issue #27165: [SPARK-28264][PYTHON][SQL] Support type hints in pandas UDF and rename/move inconsistent pandas UDF types URL: https://github.com/apache/spark/pull/27165#issuecomment-573399485 **[Test build #116552 has

[GitHub] [spark] SparkQA removed a comment on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3

2020-01-12 Thread GitBox
SparkQA removed a comment on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3 URL: https://github.com/apache/spark/pull/27169#issuecomment-573393411 **[Test build #116550 has

[GitHub] [spark] AmplabJenkins commented on issue #27165: [SPARK-28264][PYTHON][SQL] Support type hints in pandas UDF and rename/move inconsistent pandas UDF types

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27165: [SPARK-28264][PYTHON][SQL] Support type hints in pandas UDF and rename/move inconsistent pandas UDF types URL: https://github.com/apache/spark/pull/27165#issuecomment-573407635 Test FAILed. Refer to this link for build results (access rights to

[GitHub] [spark] SparkQA commented on issue #26813: [SPARK-30188][SQL][WIP] Resolve the failed unit tests when enable AQE

2020-01-12 Thread GitBox
SparkQA commented on issue #26813: [SPARK-30188][SQL][WIP] Resolve the failed unit tests when enable AQE URL: https://github.com/apache/spark/pull/26813#issuecomment-573410447 **[Test build #116555 has

[GitHub] [spark] SparkQA commented on issue #27064: [SPARK-30246]OneForOneStreamManager might leak memory in connectionTerminated

2020-01-12 Thread GitBox
SparkQA commented on issue #27064: [SPARK-30246]OneForOneStreamManager might leak memory in connectionTerminated URL: https://github.com/apache/spark/pull/27064#issuecomment-573414408 **[Test build #116556 has

[GitHub] [spark] AmplabJenkins commented on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer URL: https://github.com/apache/spark/pull/27077#issuecomment-573419502 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer URL: https://github.com/apache/spark/pull/27077#issuecomment-573419502 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer URL: https://github.com/apache/spark/pull/27077#issuecomment-573419506 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer URL: https://github.com/apache/spark/pull/27077#issuecomment-573419506 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] srowen commented on issue #27151: [SPARK-26218][SQL][Follow up] Fix the corner case when casting float to Integer.

2020-01-12 Thread GitBox
srowen commented on issue #27151: [SPARK-26218][SQL][Follow up] Fix the corner case when casting float to Integer. URL: https://github.com/apache/spark/pull/27151#issuecomment-573419576 (OK I'm into the idea, yes) This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #27064: [SPARK-30246]OneForOneStreamManager might leak memory in connectionTerminated

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27064: [SPARK-30246]OneForOneStreamManager might leak memory in connectionTerminated URL: https://github.com/apache/spark/pull/27064#issuecomment-573423010 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27064: [SPARK-30246]OneForOneStreamManager might leak memory in connectionTerminated

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27064: [SPARK-30246]OneForOneStreamManager might leak memory in connectionTerminated URL: https://github.com/apache/spark/pull/27064#issuecomment-573423007 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #27064: [SPARK-30246]OneForOneStreamManager might leak memory in connectionTerminated

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27064: [SPARK-30246]OneForOneStreamManager might leak memory in connectionTerminated URL: https://github.com/apache/spark/pull/27064#issuecomment-573423010 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27064: [SPARK-30246]OneForOneStreamManager might leak memory in connectionTerminated

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27064: [SPARK-30246]OneForOneStreamManager might leak memory in connectionTerminated URL: https://github.com/apache/spark/pull/27064#issuecomment-573423007 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #27064: [SPARK-30246]OneForOneStreamManager might leak memory in connectionTerminated

2020-01-12 Thread GitBox
SparkQA removed a comment on issue #27064: [SPARK-30246]OneForOneStreamManager might leak memory in connectionTerminated URL: https://github.com/apache/spark/pull/27064#issuecomment-573414408 **[Test build #116556 has

[GitHub] [spark] SparkQA commented on issue #27064: [SPARK-30246]OneForOneStreamManager might leak memory in connectionTerminated

2020-01-12 Thread GitBox
SparkQA commented on issue #27064: [SPARK-30246]OneForOneStreamManager might leak memory in connectionTerminated URL: https://github.com/apache/spark/pull/27064#issuecomment-573422899 **[Test build #116556 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests URL: https://github.com/apache/spark/pull/27166#issuecomment-573424216 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #27030: [SPARK-30244][SQL] Emit pre/post events for "Partition" methods in ExternalCatalogWithListener

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27030: [SPARK-30244][SQL] Emit pre/post events for "Partition" methods in ExternalCatalogWithListener URL: https://github.com/apache/spark/pull/27030#issuecomment-573457358 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27030: [SPARK-30244][SQL] Emit pre/post events for "Partition" methods in ExternalCatalogWithListener

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27030: [SPARK-30244][SQL] Emit pre/post events for "Partition" methods in ExternalCatalogWithListener URL: https://github.com/apache/spark/pull/27030#issuecomment-573457358 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27030: [SPARK-30244][SQL] Emit pre/post events for "Partition" methods in ExternalCatalogWithListener

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27030: [SPARK-30244][SQL] Emit pre/post events for "Partition" methods in ExternalCatalogWithListener URL: https://github.com/apache/spark/pull/27030#issuecomment-573457361 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] HeartSaVioR commented on issue #27158: [MINOR][BUILD][PYSPARK] Disable test_memory_limit test temporarily

2020-01-12 Thread GitBox
HeartSaVioR commented on issue #27158: [MINOR][BUILD][PYSPARK] Disable test_memory_limit test temporarily URL: https://github.com/apache/spark/pull/27158#issuecomment-573459496 We've realized the patch didn't work, although the builds succeeded for the patch itself. I feel we may

[GitHub] [spark] AmplabJenkins removed a comment on issue #27181: [SPARK-30493][PYTHON][ML] Remove OneVsRestModel.setClassifier

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27181: [SPARK-30493][PYTHON][ML] Remove OneVsRestModel.setClassifier URL: https://github.com/apache/spark/pull/27181#issuecomment-573470083 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27181: [SPARK-30493][PYTHON][ML] Remove OneVsRestModel.setClassifier

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27181: [SPARK-30493][PYTHON][ML] Remove OneVsRestModel.setClassifier URL: https://github.com/apache/spark/pull/27181#issuecomment-573470078 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #27181: [SPARK-30493][PYTHON][ML] Remove OneVsRestModel.setClassifier

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27181: [SPARK-30493][PYTHON][ML] Remove OneVsRestModel.setClassifier URL: https://github.com/apache/spark/pull/27181#issuecomment-573470083 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27181: [SPARK-30493][PYTHON][ML] Remove OneVsRestModel.setClassifier

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27181: [SPARK-30493][PYTHON][ML] Remove OneVsRestModel.setClassifier URL: https://github.com/apache/spark/pull/27181#issuecomment-573470078 Merged build finished. Test PASSed. This is an

[GitHub] [spark] SparkQA commented on issue #27181: [SPARK-30493][PYTHON][ML] Remove OneVsRestModel.setClassifier

2020-01-12 Thread GitBox
SparkQA commented on issue #27181: [SPARK-30493][PYTHON][ML] Remove OneVsRestModel.setClassifier URL: https://github.com/apache/spark/pull/27181#issuecomment-573469945 **[Test build #116574 has

[GitHub] [spark] github-actions[bot] closed pull request #20958: [SPARK-23844][SS] Fix socket source honors recovered offsets issue

2020-01-12 Thread GitBox
github-actions[bot] closed pull request #20958: [SPARK-23844][SS] Fix socket source honors recovered offsets issue URL: https://github.com/apache/spark/pull/20958 This is an automated message from the Apache Git Service. To

[GitHub] [spark] github-actions[bot] commented on issue #20821: [SPARK-23678][GraphX] a more efficient partition strategy

2020-01-12 Thread GitBox
github-actions[bot] commented on issue #20821: [SPARK-23678][GraphX] a more efficient partition strategy URL: https://github.com/apache/spark/pull/20821#issuecomment-573473482 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR

[GitHub] [spark] github-actions[bot] closed pull request #21148: [SPARK-24079][SQL] Update the nullability of Join output based on inferred predicates

2020-01-12 Thread GitBox
github-actions[bot] closed pull request #21148: [SPARK-24079][SQL] Update the nullability of Join output based on inferred predicates URL: https://github.com/apache/spark/pull/21148 This is an automated message from the

[GitHub] [spark] github-actions[bot] commented on issue #20826: [SPARK-2489][SQL] Support Parquet's optional fixed_len_byte_array

2020-01-12 Thread GitBox
github-actions[bot] commented on issue #20826: [SPARK-2489][SQL] Support Parquet's optional fixed_len_byte_array URL: https://github.com/apache/spark/pull/20826#issuecomment-573473478 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of

[GitHub] [spark] github-actions[bot] closed pull request #20992: [SPARK-23779][SQL] TaskMemoryManager and UnsafeSorter related classes use MemoryBlock

2020-01-12 Thread GitBox
github-actions[bot] closed pull request #20992: [SPARK-23779][SQL] TaskMemoryManager and UnsafeSorter related classes use MemoryBlock URL: https://github.com/apache/spark/pull/20992 This is an automated message from the

[GitHub] [spark] github-actions[bot] commented on issue #20599: [SPARK-23407][SQL] add a config to try to inline all mutable states during codegen

2020-01-12 Thread GitBox
github-actions[bot] commented on issue #20599: [SPARK-23407][SQL] add a config to try to inline all mutable states during codegen URL: https://github.com/apache/spark/pull/20599#issuecomment-573473489 We're closing this PR because it hasn't been updated in a while. This isn't a judgement

[GitHub] [spark] github-actions[bot] commented on issue #20820: [SPARK-23676][SQL]Support left join codegen in SortMergeJoinExec

2020-01-12 Thread GitBox
github-actions[bot] commented on issue #20820: [SPARK-23676][SQL]Support left join codegen in SortMergeJoinExec URL: https://github.com/apache/spark/pull/20820#issuecomment-573473485 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of

[GitHub] [spark] github-actions[bot] commented on issue #20532: [SPARK-23353][CORE] Allow ExecutorMetricsUpdate events to be logged t…

2020-01-12 Thread GitBox
github-actions[bot] commented on issue #20532: [SPARK-23353][CORE] Allow ExecutorMetricsUpdate events to be logged t… URL: https://github.com/apache/spark/pull/20532#issuecomment-573473493 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit

[GitHub] [spark] github-actions[bot] commented on issue #20868: [SPARK-23750][SQL] Inner Join Elimination based on Informational RI constraints

2020-01-12 Thread GitBox
github-actions[bot] commented on issue #20868: [SPARK-23750][SQL] Inner Join Elimination based on Informational RI constraints URL: https://github.com/apache/spark/pull/20868#issuecomment-573473460 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on

[GitHub] [spark] github-actions[bot] closed pull request #21075: [SPARK-23988][MESOS] Improve handling of appResource in mesos dispatcher when using Docker

2020-01-12 Thread GitBox
github-actions[bot] closed pull request #21075: [SPARK-23988][MESOS] Improve handling of appResource in mesos dispatcher when using Docker URL: https://github.com/apache/spark/pull/21075 This is an automated message from

[GitHub] [spark] github-actions[bot] closed pull request #21012: [SPARK-23890][SQL] Support CHANGE COLUMN to add nested fields to structs

2020-01-12 Thread GitBox
github-actions[bot] closed pull request #21012: [SPARK-23890][SQL] Support CHANGE COLUMN to add nested fields to structs URL: https://github.com/apache/spark/pull/21012 This is an automated message from the Apache Git

[GitHub] [spark] github-actions[bot] closed pull request #20974: [SPARK-23862][SQL] Spark ExpressionEncoder should support java enum type in scala

2020-01-12 Thread GitBox
github-actions[bot] closed pull request #20974: [SPARK-23862][SQL] Spark ExpressionEncoder should support java enum type in scala URL: https://github.com/apache/spark/pull/20974 This is an automated message from the Apache

[GitHub] [spark] github-actions[bot] commented on issue #20865: [SPARK-23542] The exists action shoule be further optimized in logical plan

2020-01-12 Thread GitBox
github-actions[bot] commented on issue #20865: [SPARK-23542] The exists action shoule be further optimized in logical plan URL: https://github.com/apache/spark/pull/20865#issuecomment-573473465 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the

[GitHub] [spark] github-actions[bot] commented on issue #25907: [SPARK-29206][SHUFFLE] Make number of shuffle server threads a multiple of number of chunk fetch handler threads.

2020-01-12 Thread GitBox
github-actions[bot] commented on issue #25907: [SPARK-29206][SHUFFLE] Make number of shuffle server threads a multiple of number of chunk fetch handler threads. URL: https://github.com/apache/spark/pull/25907#issuecomment-573473425 We're closing this PR because it hasn't been updated in a

[GitHub] [spark] AmplabJenkins removed a comment on issue #27177: [SPARK-30491][INFRA] Enable dependency audit files to tell dependency classifier

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27177: [SPARK-30491][INFRA] Enable dependency audit files to tell dependency classifier URL: https://github.com/apache/spark/pull/27177#issuecomment-573473067 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] github-actions[bot] closed pull request #20930: [SPARK-23811][Core] FetchFailed comes before Success of same task will cause child stage never succeed

2020-01-12 Thread GitBox
github-actions[bot] closed pull request #20930: [SPARK-23811][Core] FetchFailed comes before Success of same task will cause child stage never succeed URL: https://github.com/apache/spark/pull/20930 This is an automated

[GitHub] [spark] github-actions[bot] commented on issue #20854: [SPARK-23712][SQL] Interpreted UnsafeRowJoiner [WIP]

2020-01-12 Thread GitBox
github-actions[bot] commented on issue #20854: [SPARK-23712][SQL] Interpreted UnsafeRowJoiner [WIP] URL: https://github.com/apache/spark/pull/20854#issuecomment-573473472 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any

[GitHub] [spark] github-actions[bot] closed pull request #21109: [SPARK-24020][SQL] Sort-merge join inner range optimization

2020-01-12 Thread GitBox
github-actions[bot] closed pull request #21109: [SPARK-24020][SQL] Sort-merge join inner range optimization URL: https://github.com/apache/spark/pull/21109 This is an automated message from the Apache Git Service. To

[GitHub] [spark] github-actions[bot] closed pull request #20874: [SPARK-23763][SQL] OffHeapColumnVector uses MemoryBlock

2020-01-12 Thread GitBox
github-actions[bot] closed pull request #20874: [SPARK-23763][SQL] OffHeapColumnVector uses MemoryBlock URL: https://github.com/apache/spark/pull/20874 This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] AmplabJenkins commented on issue #27030: [SPARK-30244][SQL] Emit pre/post events for "Partition" methods in ExternalCatalogWithListener

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27030: [SPARK-30244][SQL] Emit pre/post events for "Partition" methods in ExternalCatalogWithListener URL: https://github.com/apache/spark/pull/27030#issuecomment-573479249 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #27030: [SPARK-30244][SQL] Emit pre/post events for "Partition" methods in ExternalCatalogWithListener

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27030: [SPARK-30244][SQL] Emit pre/post events for "Partition" methods in ExternalCatalogWithListener URL: https://github.com/apache/spark/pull/27030#issuecomment-573479246 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27030: [SPARK-30244][SQL] Emit pre/post events for "Partition" methods in ExternalCatalogWithListener

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27030: [SPARK-30244][SQL] Emit pre/post events for "Partition" methods in ExternalCatalogWithListener URL: https://github.com/apache/spark/pull/27030#issuecomment-573479249 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] SparkQA commented on issue #27030: [SPARK-30244][SQL] Emit pre/post events for "Partition" methods in ExternalCatalogWithListener

2020-01-12 Thread GitBox
SparkQA commented on issue #27030: [SPARK-30244][SQL] Emit pre/post events for "Partition" methods in ExternalCatalogWithListener URL: https://github.com/apache/spark/pull/27030#issuecomment-573479100 **[Test build #116570 has

[GitHub] [spark] SparkQA removed a comment on issue #27030: [SPARK-30244][SQL] Emit pre/post events for "Partition" methods in ExternalCatalogWithListener

2020-01-12 Thread GitBox
SparkQA removed a comment on issue #27030: [SPARK-30244][SQL] Emit pre/post events for "Partition" methods in ExternalCatalogWithListener URL: https://github.com/apache/spark/pull/27030#issuecomment-573457218 **[Test build #116570 has

[GitHub] [spark] AmplabJenkins commented on issue #27030: [SPARK-30244][SQL] Emit pre/post events for "Partition" methods in ExternalCatalogWithListener

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27030: [SPARK-30244][SQL] Emit pre/post events for "Partition" methods in ExternalCatalogWithListener URL: https://github.com/apache/spark/pull/27030#issuecomment-573479246 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27181: [SPARK-30493][PYTHON][ML] Remove OneVsRestModel setClassifier, setLabelCol and setWeightCol methods

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27181: [SPARK-30493][PYTHON][ML] Remove OneVsRestModel setClassifier, setLabelCol and setWeightCol methods URL: https://github.com/apache/spark/pull/27181#issuecomment-573481764 Test FAILed. Refer to this link for build results (access rights to

[GitHub] [spark] AmplabJenkins removed a comment on issue #27181: [SPARK-30493][PYTHON][ML] Remove OneVsRestModel setClassifier, setLabelCol and setWeightCol methods

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27181: [SPARK-30493][PYTHON][ML] Remove OneVsRestModel setClassifier, setLabelCol and setWeightCol methods URL: https://github.com/apache/spark/pull/27181#issuecomment-573481763 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #27181: [SPARK-30493][PYTHON][ML] Remove OneVsRestModel setClassifier, setLabelCol and setWeightCol methods

2020-01-12 Thread GitBox
SparkQA removed a comment on issue #27181: [SPARK-30493][PYTHON][ML] Remove OneVsRestModel setClassifier, setLabelCol and setWeightCol methods URL: https://github.com/apache/spark/pull/27181#issuecomment-573480059 **[Test build #116579 has

[GitHub] [spark] SparkQA commented on issue #27182: [SPARK-28752][BUILD][DOCS][FOLLOW-UP] Render examples imported from Jekyll properly via Rouge

2020-01-12 Thread GitBox
SparkQA commented on issue #27182: [SPARK-28752][BUILD][DOCS][FOLLOW-UP] Render examples imported from Jekyll properly via Rouge URL: https://github.com/apache/spark/pull/27182#issuecomment-573483912 **[Test build #116580 has

[GitHub] [spark] HyukjinKwon closed pull request #27182: [SPARK-28752][BUILD][DOCS][FOLLOW-UP] Render examples imported from Jekyll properly via Rouge

2020-01-12 Thread GitBox
HyukjinKwon closed pull request #27182: [SPARK-28752][BUILD][DOCS][FOLLOW-UP] Render examples imported from Jekyll properly via Rouge URL: https://github.com/apache/spark/pull/27182 This is an automated message from the

[GitHub] [spark] AmplabJenkins commented on issue #27182: [SPARK-28752][BUILD][DOCS][FOLLOW-UP] Render examples imported from Jekyll properly via Rouge

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27182: [SPARK-28752][BUILD][DOCS][FOLLOW-UP] Render examples imported from Jekyll properly via Rouge URL: https://github.com/apache/spark/pull/27182#issuecomment-573483946 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #27182: [SPARK-28752][BUILD][DOCS][FOLLOW-UP] Render examples imported from Jekyll properly via Rouge

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27182: [SPARK-28752][BUILD][DOCS][FOLLOW-UP] Render examples imported from Jekyll properly via Rouge URL: https://github.com/apache/spark/pull/27182#issuecomment-573483946 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #27182: [SPARK-28752][BUILD][DOCS][FOLLOW-UP] Render examples imported from Jekyll properly via Rouge

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27182: [SPARK-28752][BUILD][DOCS][FOLLOW-UP] Render examples imported from Jekyll properly via Rouge URL: https://github.com/apache/spark/pull/27182#issuecomment-573483945 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27182: [SPARK-28752][BUILD][DOCS][FOLLOW-UP] Render examples imported from Jekyll properly via Rouge

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27182: [SPARK-28752][BUILD][DOCS][FOLLOW-UP] Render examples imported from Jekyll properly via Rouge URL: https://github.com/apache/spark/pull/27182#issuecomment-573483945 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #27182: [SPARK-28752][BUILD][DOCS][FOLLOW-UP] Render examples imported from Jekyll properly via Rouge

2020-01-12 Thread GitBox
SparkQA removed a comment on issue #27182: [SPARK-28752][BUILD][DOCS][FOLLOW-UP] Render examples imported from Jekyll properly via Rouge URL: https://github.com/apache/spark/pull/27182#issuecomment-573482740 **[Test build #116580 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27180: [SPARK-30409][TEST][FOLLOWUP][HOTFIX] Remove dangling JSONBenchmark-jdk11-results.txt

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27180: [SPARK-30409][TEST][FOLLOWUP][HOTFIX] Remove dangling JSONBenchmark-jdk11-results.txt URL: https://github.com/apache/spark/pull/27180#issuecomment-573490149 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #27180: [SPARK-30409][TEST][FOLLOWUP][HOTFIX] Remove dangling JSONBenchmark-jdk11-results.txt

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27180: [SPARK-30409][TEST][FOLLOWUP][HOTFIX] Remove dangling JSONBenchmark-jdk11-results.txt URL: https://github.com/apache/spark/pull/27180#issuecomment-573490146 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #24173: [SPARK-27237][SS] Introduce State schema validation among query restart

2020-01-12 Thread GitBox
SparkQA commented on issue #24173: [SPARK-27237][SS] Introduce State schema validation among query restart URL: https://github.com/apache/spark/pull/24173#issuecomment-573492660 **[Test build #116590 has

[GitHub] [spark] SparkQA commented on issue #25965: [SPARK-26425][SS] Add more constraint checks in file streaming source to avoid checkpoint corruption

2020-01-12 Thread GitBox
SparkQA commented on issue #25965: [SPARK-26425][SS] Add more constraint checks in file streaming source to avoid checkpoint corruption URL: https://github.com/apache/spark/pull/25965#issuecomment-573492649 **[Test build #116587 has

[GitHub] [spark] SparkQA commented on issue #24990: [SPARK-28191][SS] New data source - state - reader part

2020-01-12 Thread GitBox
SparkQA commented on issue #24990: [SPARK-28191][SS] New data source - state - reader part URL: https://github.com/apache/spark/pull/24990#issuecomment-573492657 **[Test build #116588 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116588/testReport)** for

[GitHub] [spark] SparkQA commented on issue #25987: [SPARK-29314][SS] Don't overwrite the metric "updated" of state operator to 0 if empty batch is run

2020-01-12 Thread GitBox
SparkQA commented on issue #25987: [SPARK-29314][SS] Don't overwrite the metric "updated" of state operator to 0 if empty batch is run URL: https://github.com/apache/spark/pull/25987#issuecomment-573492644 **[Test build #116586 has

[GitHub] [spark] SparkQA commented on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events

2020-01-12 Thread GitBox
SparkQA commented on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events URL: https://github.com/apache/spark/pull/27164#issuecomment-573492646 **[Test build #116585 has

[GitHub] [spark] SparkQA commented on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark plus allowed delay

2020-01-12 Thread GitBox
SparkQA commented on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark plus allowed delay URL: https://github.com/apache/spark/pull/24936#issuecomment-573492648 **[Test build #116589 has

[GitHub] [spark] AmplabJenkins commented on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#issuecomment-573496157 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #27176: [WIP][SPIP]Support year-month and day-time interval types

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27176: [WIP][SPIP]Support year-month and day-time interval types URL: https://github.com/apache/spark/pull/27176#issuecomment-573496162 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#issuecomment-573496163 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2020-01-12 Thread GitBox
SparkQA commented on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#issuecomment-573495976 **[Test build #116593 has

[GitHub] [spark] cloud-fan closed pull request #20599: [SPARK-23407][SQL] add a config to try to inline all mutable states during codegen

2020-01-12 Thread GitBox
cloud-fan closed pull request #20599: [SPARK-23407][SQL] add a config to try to inline all mutable states during codegen URL: https://github.com/apache/spark/pull/20599 This is an automated message from the Apache Git

[GitHub] [spark] SparkQA commented on issue #27176: [WIP][SPIP]Support year-month and day-time interval types

2020-01-12 Thread GitBox
SparkQA commented on issue #27176: [WIP][SPIP]Support year-month and day-time interval types URL: https://github.com/apache/spark/pull/27176#issuecomment-573495958 **[Test build #116592 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116592/testReport)**

[GitHub] [spark] cloud-fan commented on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2020-01-12 Thread GitBox
cloud-fan commented on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#issuecomment-573495873 retest this please This is an automated message

[GitHub] [spark] AmplabJenkins commented on issue #27176: [WIP][SPIP]Support year-month and day-time interval types

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27176: [WIP][SPIP]Support year-month and day-time interval types URL: https://github.com/apache/spark/pull/27176#issuecomment-573496166 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] cloud-fan commented on a change in pull request #27150: [SPARK-30471][SQL] Fix issue when comparing String and IntegerType

2020-01-12 Thread GitBox
cloud-fan commented on a change in pull request #27150: [SPARK-30471][SQL] Fix issue when comparing String and IntegerType URL: https://github.com/apache/spark/pull/27150#discussion_r365640741 ## File path:

[GitHub] [spark] SparkQA removed a comment on issue #27157: [SPARK-30475][SQL] File source V2: Push data filters for file listing

2020-01-12 Thread GitBox
SparkQA removed a comment on issue #27157: [SPARK-30475][SQL] File source V2: Push data filters for file listing URL: https://github.com/apache/spark/pull/27157#issuecomment-573472013 **[Test build #116575 has

[GitHub] [spark] SparkQA commented on issue #27157: [SPARK-30475][SQL] File source V2: Push data filters for file listing

2020-01-12 Thread GitBox
SparkQA commented on issue #27157: [SPARK-30475][SQL] File source V2: Push data filters for file listing URL: https://github.com/apache/spark/pull/27157#issuecomment-573498816 **[Test build #116575 has

[GitHub] [spark] cloud-fan commented on issue #27150: [SPARK-30471][SQL] Fix issue when comparing String and IntegerType

2020-01-12 Thread GitBox
cloud-fan commented on issue #27150: [SPARK-30471][SQL] Fix issue when comparing String and IntegerType URL: https://github.com/apache/spark/pull/27150#issuecomment-573498959 looks good, let's add a migration guide. @gatorsmile do you think we should also add a legacy config?

[GitHub] [spark] shivsood commented on issue #25248: [SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect

2020-01-12 Thread GitBox
shivsood commented on issue #25248: [SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect URL: https://github.com/apache/spark/pull/25248#issuecomment-573502250 I will be taking this up this week. ETA end of coming week. Regards, Shiv

[GitHub] [spark] AmplabJenkins commented on issue #27184: [SPARK-28152][SQL][FOLLOWUP][2.4] Add a legacy conf for old MsSqlServerDialect numeric mapping

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27184: [SPARK-28152][SQL][FOLLOWUP][2.4] Add a legacy conf for old MsSqlServerDialect numeric mapping URL: https://github.com/apache/spark/pull/27184#issuecomment-573508502 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #27184: [SPARK-28152][SQL][FOLLOWUP][2.4] Add a legacy conf for old MsSqlServerDialect numeric mapping

2020-01-12 Thread GitBox
SparkQA commented on issue #27184: [SPARK-28152][SQL][FOLLOWUP][2.4] Add a legacy conf for old MsSqlServerDialect numeric mapping URL: https://github.com/apache/spark/pull/27184#issuecomment-573508308 **[Test build #116601 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27176: [WIP][SPIP]Support year-month and day-time interval types

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27176: [WIP][SPIP]Support year-month and day-time interval types URL: https://github.com/apache/spark/pull/27176#issuecomment-573512525 Merged build finished. Test FAILed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #27176: [WIP][SPIP]Support year-month and day-time interval types

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27176: [WIP][SPIP]Support year-month and day-time interval types URL: https://github.com/apache/spark/pull/27176#issuecomment-573512531 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27176: [WIP][SPIP]Support year-month and day-time interval types

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27176: [WIP][SPIP]Support year-month and day-time interval types URL: https://github.com/apache/spark/pull/27176#issuecomment-573512525 Merged build finished. Test FAILed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #27176: [WIP][SPIP]Support year-month and day-time interval types

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27176: [WIP][SPIP]Support year-month and day-time interval types URL: https://github.com/apache/spark/pull/27176#issuecomment-573512531 Test FAILed. Refer to this link for build results (access rights to CI server needed):

<    1   2   3   4   5   6   7   8   9   10   >