[GitHub] [spark] Fokko commented on a change in pull request #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType

2019-11-25 Thread GitBox
Fokko commented on a change in pull request #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType URL: https://github.com/apache/spark/pull/26644#discussion_r350212404 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/types/StructType.scala

[GitHub] [spark] cloud-fan commented on a change in pull request #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions

2019-11-25 Thread GitBox
cloud-fan commented on a change in pull request #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions URL: https://github.com/apache/spark/pull/26629#discussion_r350210075 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions

2019-11-25 Thread GitBox
cloud-fan commented on a change in pull request #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions URL: https://github.com/apache/spark/pull/26629#discussion_r350209881 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions

2019-11-25 Thread GitBox
cloud-fan commented on a change in pull request #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions URL: https://github.com/apache/spark/pull/26629#discussion_r350209822 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions

2019-11-25 Thread GitBox
cloud-fan commented on a change in pull request #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions URL: https://github.com/apache/spark/pull/26629#discussion_r350207427 ## File path:

[GitHub] [spark] SparkQA commented on issue #26590: [SPARK-29953][SS] Don't clean up source files for FileStreamSource if the files belong to the output of FileStreamSink

2019-11-25 Thread GitBox
SparkQA commented on issue #26590: [SPARK-29953][SS] Don't clean up source files for FileStreamSource if the files belong to the output of FileStreamSink URL: https://github.com/apache/spark/pull/26590#issuecomment-558173641 **[Test build #114406 has

[GitHub] [spark] cloud-fan commented on issue #26663: [SPARK-30015][Core] Continuous shuffle block fetching should be disabled by default when the old fetch protocol is used

2019-11-25 Thread GitBox
cloud-fan commented on issue #26663: [SPARK-30015][Core] Continuous shuffle block fetching should be disabled by default when the old fetch protocol is used URL: https://github.com/apache/spark/pull/26663#issuecomment-558172907 just for curiosity, how things can go wrong if we do batch

[GitHub] [spark] HeartSaVioR commented on a change in pull request #26590: [SPARK-29953][SS] Don't clean up source files for FileStreamSource if the files belong to the output of FileStreamSink

2019-11-25 Thread GitBox
HeartSaVioR commented on a change in pull request #26590: [SPARK-29953][SS] Don't clean up source files for FileStreamSource if the files belong to the output of FileStreamSink URL: https://github.com/apache/spark/pull/26590#discussion_r350204398 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions URL: https://github.com/apache/spark/pull/26629#issuecomment-558171012 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions URL: https://github.com/apache/spark/pull/26629#issuecomment-558170998 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions URL: https://github.com/apache/spark/pull/26629#issuecomment-558171012 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions URL: https://github.com/apache/spark/pull/26629#issuecomment-558170998 Merged build finished. Test PASSed. This

[GitHub] [spark] SparkQA commented on issue #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions

2019-11-25 Thread GitBox
SparkQA commented on issue #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions URL: https://github.com/apache/spark/pull/26629#issuecomment-558170353 **[Test build #114405 has

[GitHub] [spark] maropu commented on issue #26651: [SPARK-30008][SQL] The dataType of collect_list/collect_set aggs should be ArrayType(_, false)

2019-11-25 Thread GitBox
maropu commented on issue #26651: [SPARK-30008][SQL] The dataType of collect_list/collect_set aggs should be ArrayType(_, false) URL: https://github.com/apache/spark/pull/26651#issuecomment-558168661 Can you add end-2-end tests in `DataFrameAggregateSuite`?

[GitHub] [spark] maropu commented on a change in pull request #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType

2019-11-25 Thread GitBox
maropu commented on a change in pull request #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType URL: https://github.com/apache/spark/pull/26644#discussion_r350189632 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/types/TestUDT.scala

[GitHub] [spark] maropu commented on a change in pull request #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType

2019-11-25 Thread GitBox
maropu commented on a change in pull request #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType URL: https://github.com/apache/spark/pull/26644#discussion_r350188985 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/types/DataTypeSuite.scala

[GitHub] [spark] maropu commented on a change in pull request #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType

2019-11-25 Thread GitBox
maropu commented on a change in pull request #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType URL: https://github.com/apache/spark/pull/26644#discussion_r350189185 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/types/DataTypeSuite.scala

[GitHub] [spark] maropu commented on a change in pull request #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType

2019-11-25 Thread GitBox
maropu commented on a change in pull request #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType URL: https://github.com/apache/spark/pull/26644#discussion_r350188985 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/types/DataTypeSuite.scala

[GitHub] [spark] maropu commented on a change in pull request #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType

2019-11-25 Thread GitBox
maropu commented on a change in pull request #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType URL: https://github.com/apache/spark/pull/26644#discussion_r350188874 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/types/DataTypeSuite.scala

[GitHub] [spark] maropu commented on a change in pull request #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType

2019-11-25 Thread GitBox
maropu commented on a change in pull request #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType URL: https://github.com/apache/spark/pull/26644#discussion_r350188193 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/types/StructType.scala

[GitHub] [spark] gaborgsomogyi commented on issue #26502: [SPARK-29876][SS] Delete/archive file source completed files in separate thread

2019-11-25 Thread GitBox
gaborgsomogyi commented on issue #26502: [SPARK-29876][SS] Delete/archive file source completed files in separate thread URL: https://github.com/apache/spark/pull/26502#issuecomment-558158189 @zsxwing this is an addition to the source file archival/delete which worth the attention.

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #26590: [SPARK-29953][SS] Don't clean up source files for FileStreamSource if the files belong to the output of FileStreamSink

2019-11-25 Thread GitBox
gaborgsomogyi commented on a change in pull request #26590: [SPARK-29953][SS] Don't clean up source files for FileStreamSource if the files belong to the output of FileStreamSink URL: https://github.com/apache/spark/pull/26590#discussion_r350149070 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #26617: [SPARK-29979][SQL]Add basic/reserved property key constants in TableCatalog and SupportsNamespaces

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #26617: [SPARK-29979][SQL]Add basic/reserved property key constants in TableCatalog and SupportsNamespaces URL: https://github.com/apache/spark/pull/26617#issuecomment-558154824 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26617: [SPARK-29979][SQL]Add basic/reserved property key constants in TableCatalog and SupportsNamespaces

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #26617: [SPARK-29979][SQL]Add basic/reserved property key constants in TableCatalog and SupportsNamespaces URL: https://github.com/apache/spark/pull/26617#issuecomment-558154824 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26617: [SPARK-29979][SQL]Add basic/reserved property key constants in TableCatalog and SupportsNamespaces

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #26617: [SPARK-29979][SQL]Add basic/reserved property key constants in TableCatalog and SupportsNamespaces URL: https://github.com/apache/spark/pull/26617#issuecomment-558154839 Test PASSed. Refer to this link for build results (access rights to

[GitHub] [spark] AmplabJenkins commented on issue #26617: [SPARK-29979][SQL]Add basic/reserved property key constants in TableCatalog and SupportsNamespaces

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #26617: [SPARK-29979][SQL]Add basic/reserved property key constants in TableCatalog and SupportsNamespaces URL: https://github.com/apache/spark/pull/26617#issuecomment-558154839 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #26659: [MINOR][DOC] Fix the CalendarIntervalType description

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #26659: [MINOR][DOC] Fix the CalendarIntervalType description URL: https://github.com/apache/spark/pull/26659#issuecomment-558154267 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #26659: [MINOR][DOC] Fix the CalendarIntervalType description

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #26659: [MINOR][DOC] Fix the CalendarIntervalType description URL: https://github.com/apache/spark/pull/26659#issuecomment-558154282 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26659: [MINOR][DOC] Fix the CalendarIntervalType description

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #26659: [MINOR][DOC] Fix the CalendarIntervalType description URL: https://github.com/apache/spark/pull/26659#issuecomment-558154282 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26659: [MINOR][DOC] Fix the CalendarIntervalType description

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #26659: [MINOR][DOC] Fix the CalendarIntervalType description URL: https://github.com/apache/spark/pull/26659#issuecomment-558154267 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] SparkQA commented on issue #26617: [SPARK-29979][SQL]Add basic/reserved property key constants in Table and SupportsNamespaces

2019-11-25 Thread GitBox
SparkQA commented on issue #26617: [SPARK-29979][SQL]Add basic/reserved property key constants in Table and SupportsNamespaces URL: https://github.com/apache/spark/pull/26617#issuecomment-558154001 **[Test build #114396 has

[GitHub] [spark] SparkQA removed a comment on issue #26617: [SPARK-29979][SQL]Add basic/reserved property key constants in Table and SupportsNamespaces

2019-11-25 Thread GitBox
SparkQA removed a comment on issue #26617: [SPARK-29979][SQL]Add basic/reserved property key constants in Table and SupportsNamespaces URL: https://github.com/apache/spark/pull/26617#issuecomment-558053209 **[Test build #114396 has

[GitHub] [spark] SparkQA commented on issue #26659: [MINOR][DOC] Fix the CalendarIntervalType description

2019-11-25 Thread GitBox
SparkQA commented on issue #26659: [MINOR][DOC] Fix the CalendarIntervalType description URL: https://github.com/apache/spark/pull/26659#issuecomment-558153570 **[Test build #114397 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/114397/testReport)** for

[GitHub] [spark] SparkQA removed a comment on issue #26659: [MINOR][DOC] Fix the CalendarIntervalType description

2019-11-25 Thread GitBox
SparkQA removed a comment on issue #26659: [MINOR][DOC] Fix the CalendarIntervalType description URL: https://github.com/apache/spark/pull/26659#issuecomment-558061817 **[Test build #114397 has

[GitHub] [spark] maropu commented on a change in pull request #26656: [SPARK-27986][SQL] Support ANSI SQL filter clause for aggregate expression

2019-11-25 Thread GitBox
maropu commented on a change in pull request #26656: [SPARK-27986][SQL] Support ANSI SQL filter clause for aggregate expression URL: https://github.com/apache/spark/pull/26656#discussion_r350168291 ## File path: sql/core/src/test/resources/sql-tests/inputs/group-by-filter.sql

[GitHub] [spark] AmplabJenkins removed a comment on issue #26617: [SPARK-29979][SQL]Add basic/reserved property key constants in Table and SupportsNamespaces

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #26617: [SPARK-29979][SQL]Add basic/reserved property key constants in Table and SupportsNamespaces URL: https://github.com/apache/spark/pull/26617#issuecomment-558143849 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #26617: [SPARK-29979][SQL]Add basic/reserved property key constants in Table and SupportsNamespaces

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #26617: [SPARK-29979][SQL]Add basic/reserved property key constants in Table and SupportsNamespaces URL: https://github.com/apache/spark/pull/26617#issuecomment-558143839 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26617: [SPARK-29979][SQL]Add basic/reserved property key constants in Table and SupportsNamespaces

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #26617: [SPARK-29979][SQL]Add basic/reserved property key constants in Table and SupportsNamespaces URL: https://github.com/apache/spark/pull/26617#issuecomment-558143849 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #26617: [SPARK-29979][SQL]Add basic/reserved property key constants in Table and SupportsNamespaces

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #26617: [SPARK-29979][SQL]Add basic/reserved property key constants in Table and SupportsNamespaces URL: https://github.com/apache/spark/pull/26617#issuecomment-558143839 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #26617: [SPARK-29979][SQL]Add basic/reserved property key constants in Table and SupportsNamespaces

2019-11-25 Thread GitBox
SparkQA commented on issue #26617: [SPARK-29979][SQL]Add basic/reserved property key constants in Table and SupportsNamespaces URL: https://github.com/apache/spark/pull/26617#issuecomment-558143270 **[Test build #114394 has

[GitHub] [spark] SparkQA removed a comment on issue #26617: [SPARK-29979][SQL]Add basic/reserved property key constants in Table and SupportsNamespaces

2019-11-25 Thread GitBox
SparkQA removed a comment on issue #26617: [SPARK-29979][SQL]Add basic/reserved property key constants in Table and SupportsNamespaces URL: https://github.com/apache/spark/pull/26617#issuecomment-558047736 **[Test build #114394 has

[GitHub] [spark] AmplabJenkins commented on issue #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions URL: https://github.com/apache/spark/pull/26629#issuecomment-558142204 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions URL: https://github.com/apache/spark/pull/26629#issuecomment-558142211 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions URL: https://github.com/apache/spark/pull/26629#issuecomment-558142204 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions URL: https://github.com/apache/spark/pull/26629#issuecomment-558142211 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions

2019-11-25 Thread GitBox
SparkQA commented on issue #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions URL: https://github.com/apache/spark/pull/26629#issuecomment-558141677 **[Test build #114391 has

[GitHub] [spark] SparkQA removed a comment on issue #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions

2019-11-25 Thread GitBox
SparkQA removed a comment on issue #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions URL: https://github.com/apache/spark/pull/26629#issuecomment-558045084 **[Test build #114391 has

[GitHub] [spark] maropu commented on a change in pull request #26656: [SPARK-27986][SQL] Support ANSI SQL filter clause for aggregate expression.

2019-11-25 Thread GitBox
maropu commented on a change in pull request #26656: [SPARK-27986][SQL] Support ANSI SQL filter clause for aggregate expression. URL: https://github.com/apache/spark/pull/26656#discussion_r350164140 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #26592: [SPARK-29371][SQL] Fractional representation for interval string

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #26592: [SPARK-29371][SQL] Fractional representation for interval string URL: https://github.com/apache/spark/pull/26592#issuecomment-558140120 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26592: [SPARK-29371][SQL] Fractional representation for interval string

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #26592: [SPARK-29371][SQL] Fractional representation for interval string URL: https://github.com/apache/spark/pull/26592#issuecomment-558140112 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26592: [SPARK-29371][SQL] Fractional representation for interval string

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #26592: [SPARK-29371][SQL] Fractional representation for interval string URL: https://github.com/apache/spark/pull/26592#issuecomment-558140112 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #26592: [SPARK-29371][SQL] Fractional representation for interval string

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #26592: [SPARK-29371][SQL] Fractional representation for interval string URL: https://github.com/apache/spark/pull/26592#issuecomment-558140120 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #26592: [SPARK-29371][SQL] Fractional representation for interval string

2019-11-25 Thread GitBox
SparkQA removed a comment on issue #26592: [SPARK-29371][SQL] Fractional representation for interval string URL: https://github.com/apache/spark/pull/26592#issuecomment-558042519 **[Test build #114389 has

[GitHub] [spark] SparkQA commented on issue #26592: [SPARK-29371][SQL] Fractional representation for interval string

2019-11-25 Thread GitBox
SparkQA commented on issue #26592: [SPARK-29371][SQL] Fractional representation for interval string URL: https://github.com/apache/spark/pull/26592#issuecomment-558139471 **[Test build #114389 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType URL: https://github.com/apache/spark/pull/26644#issuecomment-558138271 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType URL: https://github.com/apache/spark/pull/26644#issuecomment-558138264 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType URL: https://github.com/apache/spark/pull/26644#issuecomment-558138271 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType URL: https://github.com/apache/spark/pull/26644#issuecomment-558138264 Merged build finished. Test PASSed. This

[GitHub] [spark] maropu commented on a change in pull request #26656: [SPARK-27986][SQL] Support ANSI SQL filter clause for aggregate expression.

2019-11-25 Thread GitBox
maropu commented on a change in pull request #26656: [SPARK-27986][SQL] Support ANSI SQL filter clause for aggregate expression. URL: https://github.com/apache/spark/pull/26656#discussion_r350160173 ## File path: sql/core/src/test/resources/sql-tests/inputs/group-by-filter.sql

[GitHub] [spark] SparkQA removed a comment on issue #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType

2019-11-25 Thread GitBox
SparkQA removed a comment on issue #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType URL: https://github.com/apache/spark/pull/26644#issuecomment-558039816 **[Test build #114386 has

[GitHub] [spark] SparkQA commented on issue #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType

2019-11-25 Thread GitBox
SparkQA commented on issue #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType URL: https://github.com/apache/spark/pull/26644#issuecomment-558137704 **[Test build #114386 has

[GitHub] [spark] AmplabJenkins commented on issue #26663: [SPARK-30015][Core] Continuous shuffle block fetching should be disabled by default when the old fetch protocol is used

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #26663: [SPARK-30015][Core] Continuous shuffle block fetching should be disabled by default when the old fetch protocol is used URL: https://github.com/apache/spark/pull/26663#issuecomment-558137326 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26663: [SPARK-30015][Core] Continuous shuffle block fetching should be disabled by default when the old fetch protocol is used

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #26663: [SPARK-30015][Core] Continuous shuffle block fetching should be disabled by default when the old fetch protocol is used URL: https://github.com/apache/spark/pull/26663#issuecomment-558137326 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26662: [SPARK-30026][SQL] Whitespaces can be identified as delimiters in interval string

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #26662: [SPARK-30026][SQL] Whitespaces can be identified as delimiters in interval string URL: https://github.com/apache/spark/pull/26662#issuecomment-558134671 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #26663: [SPARK-30015][Core] Continuous shuffle block fetching should be disabled by default when the old fetch protocol is used

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #26663: [SPARK-30015][Core] Continuous shuffle block fetching should be disabled by default when the old fetch protocol is used URL: https://github.com/apache/spark/pull/26663#issuecomment-558137329 Test PASSed. Refer to this link for build results

[GitHub] [spark] AmplabJenkins removed a comment on issue #26663: [SPARK-30015][Core] Continuous shuffle block fetching should be disabled by default when the old fetch protocol is used

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #26663: [SPARK-30015][Core] Continuous shuffle block fetching should be disabled by default when the old fetch protocol is used URL: https://github.com/apache/spark/pull/26663#issuecomment-558137329 Test PASSed. Refer to this link for build

[GitHub] [spark] AmplabJenkins removed a comment on issue #26662: [SPARK-30026][SQL] Whitespaces can be identified as delimiters in interval string

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #26662: [SPARK-30026][SQL] Whitespaces can be identified as delimiters in interval string URL: https://github.com/apache/spark/pull/26662#issuecomment-558134663 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #26662: [SPARK-30026][SQL] Whitespaces can be identified as delimiters in interval string

2019-11-25 Thread GitBox
SparkQA commented on issue #26662: [SPARK-30026][SQL] Whitespaces can be identified as delimiters in interval string URL: https://github.com/apache/spark/pull/26662#issuecomment-558136898 **[Test build #114404 has

[GitHub] [spark] SparkQA commented on issue #26663: [SPARK-30015][Core] Continuous shuffle block fetching should be disabled by default when the old fetch protocol is used

2019-11-25 Thread GitBox
SparkQA commented on issue #26663: [SPARK-30015][Core] Continuous shuffle block fetching should be disabled by default when the old fetch protocol is used URL: https://github.com/apache/spark/pull/26663#issuecomment-558136893 **[Test build #114403 has

[GitHub] [spark] maropu commented on issue #26661: [SPARK-29975][SQL][followup] document --CONFIG_DIM

2019-11-25 Thread GitBox
maropu commented on issue #26661: [SPARK-29975][SQL][followup] document --CONFIG_DIM URL: https://github.com/apache/spark/pull/26661#issuecomment-558136351 (I got relieved...) This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins removed a comment on issue #26661: [SPARK-29975][SQL][followup] document --CONFIG_DIM

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #26661: [SPARK-29975][SQL][followup] document --CONFIG_DIM URL: https://github.com/apache/spark/pull/26661#issuecomment-558136174 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #26661: [SPARK-29975][SQL][followup] document --CONFIG_DIM

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #26661: [SPARK-29975][SQL][followup] document --CONFIG_DIM URL: https://github.com/apache/spark/pull/26661#issuecomment-558136187 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26661: [SPARK-29975][SQL][followup] document --CONFIG_DIM

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #26661: [SPARK-29975][SQL][followup] document --CONFIG_DIM URL: https://github.com/apache/spark/pull/26661#issuecomment-558136187 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26661: [SPARK-29975][SQL][followup] document --CONFIG_DIM

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #26661: [SPARK-29975][SQL][followup] document --CONFIG_DIM URL: https://github.com/apache/spark/pull/26661#issuecomment-558136174 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] SparkQA removed a comment on issue #26661: [SPARK-29975][SQL][followup] document --CONFIG_DIM

2019-11-25 Thread GitBox
SparkQA removed a comment on issue #26661: [SPARK-29975][SQL][followup] document --CONFIG_DIM URL: https://github.com/apache/spark/pull/26661#issuecomment-558047676 **[Test build #114392 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/114392/testReport)**

[GitHub] [spark] SparkQA commented on issue #26661: [SPARK-29975][SQL][followup] document --CONFIG_DIM

2019-11-25 Thread GitBox
SparkQA commented on issue #26661: [SPARK-29975][SQL][followup] document --CONFIG_DIM URL: https://github.com/apache/spark/pull/26661#issuecomment-558135624 **[Test build #114392 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/114392/testReport)** for PR

[GitHub] [spark] xuanyuanking commented on a change in pull request #26147: [SPARK-9853][Core][Follow-up] Regularize all the shuffle configurations related to adaptive execution

2019-11-25 Thread GitBox
xuanyuanking commented on a change in pull request #26147: [SPARK-9853][Core][Follow-up] Regularize all the shuffle configurations related to adaptive execution URL: https://github.com/apache/spark/pull/26147#discussion_r350156205 ## File path:

[GitHub] [spark] xuanyuanking opened a new pull request #26663: [SPARK-30015][Core] Continuous shuffle block fetching should be disabled by default when the old fetch protocol is used

2019-11-25 Thread GitBox
xuanyuanking opened a new pull request #26663: [SPARK-30015][Core] Continuous shuffle block fetching should be disabled by default when the old fetch protocol is used URL: https://github.com/apache/spark/pull/26663 ### What changes were proposed in this pull request? Disable continuous

[GitHub] [spark] AmplabJenkins removed a comment on issue #25214: [SPARK-28461][SQL] Pad Decimal numbers with trailing zeros to the scale of the column

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #25214: [SPARK-28461][SQL] Pad Decimal numbers with trailing zeros to the scale of the column URL: https://github.com/apache/spark/pull/25214#issuecomment-558134735 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #25214: [SPARK-28461][SQL] Pad Decimal numbers with trailing zeros to the scale of the column

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #25214: [SPARK-28461][SQL] Pad Decimal numbers with trailing zeros to the scale of the column URL: https://github.com/apache/spark/pull/25214#issuecomment-558134725 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26662: [SPARK-30026][SQL] Whitespaces can be identified as delimiters in interval string

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #26662: [SPARK-30026][SQL] Whitespaces can be identified as delimiters in interval string URL: https://github.com/apache/spark/pull/26662#issuecomment-558134663 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25214: [SPARK-28461][SQL] Pad Decimal numbers with trailing zeros to the scale of the column

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #25214: [SPARK-28461][SQL] Pad Decimal numbers with trailing zeros to the scale of the column URL: https://github.com/apache/spark/pull/25214#issuecomment-558134735 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25214: [SPARK-28461][SQL] Pad Decimal numbers with trailing zeros to the scale of the column

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #25214: [SPARK-28461][SQL] Pad Decimal numbers with trailing zeros to the scale of the column URL: https://github.com/apache/spark/pull/25214#issuecomment-558134725 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #25214: [SPARK-28461][SQL] Pad Decimal numbers with trailing zeros to the scale of the column

2019-11-25 Thread GitBox
SparkQA removed a comment on issue #25214: [SPARK-28461][SQL] Pad Decimal numbers with trailing zeros to the scale of the column URL: https://github.com/apache/spark/pull/25214#issuecomment-558039833 **[Test build #114387 has

[GitHub] [spark] AmplabJenkins commented on issue #26662: [SPARK-30026][SQL] Whitespaces can be identified as delimiters in interval string

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #26662: [SPARK-30026][SQL] Whitespaces can be identified as delimiters in interval string URL: https://github.com/apache/spark/pull/26662#issuecomment-558134671 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #25214: [SPARK-28461][SQL] Pad Decimal numbers with trailing zeros to the scale of the column

2019-11-25 Thread GitBox
SparkQA commented on issue #25214: [SPARK-28461][SQL] Pad Decimal numbers with trailing zeros to the scale of the column URL: https://github.com/apache/spark/pull/25214#issuecomment-558134045 **[Test build #114387 has

[GitHub] [spark] yaooqinn opened a new pull request #26662: [SPARK-30026][SQL] Whitespaces can be identified as delimiters in interval string

2019-11-25 Thread GitBox
yaooqinn opened a new pull request #26662: [SPARK-30026][SQL] Whitespaces can be identified as delimiters in interval string URL: https://github.com/apache/spark/pull/26662 ### What changes were proposed in this pull request? We are now able to handle whitespaces for integral and

[GitHub] [spark] AmplabJenkins removed a comment on issue #26656: [SPARK-27986][SQL] Support ANSI SQL filter clause for aggregate expression.

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #26656: [SPARK-27986][SQL] Support ANSI SQL filter clause for aggregate expression. URL: https://github.com/apache/spark/pull/26656#issuecomment-558133353 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26656: [SPARK-27986][SQL] Support ANSI SQL filter clause for aggregate expression.

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #26656: [SPARK-27986][SQL] Support ANSI SQL filter clause for aggregate expression. URL: https://github.com/apache/spark/pull/26656#issuecomment-558133360 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26656: [SPARK-27986][SQL] Support ANSI SQL filter clause for aggregate expression.

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #26656: [SPARK-27986][SQL] Support ANSI SQL filter clause for aggregate expression. URL: https://github.com/apache/spark/pull/26656#issuecomment-558133360 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26656: [SPARK-27986][SQL] Support ANSI SQL filter clause for aggregate expression.

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #26656: [SPARK-27986][SQL] Support ANSI SQL filter clause for aggregate expression. URL: https://github.com/apache/spark/pull/26656#issuecomment-558133353 Merged build finished. Test PASSed.

[GitHub] [spark] sarutak commented on a change in pull request #26201: [SPARK-29543][SS][UI] Init structured streaming ui

2019-11-25 Thread GitBox
sarutak commented on a change in pull request #26201: [SPARK-29543][SS][UI] Init structured streaming ui URL: https://github.com/apache/spark/pull/26201#discussion_r350125988 ## File path: core/src/main/resources/org/apache/spark/ui/static/structured-streaming-page.js ##

[GitHub] [spark] AmplabJenkins removed a comment on issue #26593: [SPARK-29890][SQL] DataFrameNaFunctions.fill should handle duplicate columns

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #26593: [SPARK-29890][SQL] DataFrameNaFunctions.fill should handle duplicate columns URL: https://github.com/apache/spark/pull/26593#issuecomment-558132906 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #26656: [SPARK-27986][SQL] Support ANSI SQL filter clause for aggregate expression.

2019-11-25 Thread GitBox
SparkQA removed a comment on issue #26656: [SPARK-27986][SQL] Support ANSI SQL filter clause for aggregate expression. URL: https://github.com/apache/spark/pull/26656#issuecomment-558039817 **[Test build #114385 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #26593: [SPARK-29890][SQL] DataFrameNaFunctions.fill should handle duplicate columns

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #26593: [SPARK-29890][SQL] DataFrameNaFunctions.fill should handle duplicate columns URL: https://github.com/apache/spark/pull/26593#issuecomment-558132913 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #26656: [SPARK-27986][SQL] Support ANSI SQL filter clause for aggregate expression.

2019-11-25 Thread GitBox
SparkQA commented on issue #26656: [SPARK-27986][SQL] Support ANSI SQL filter clause for aggregate expression. URL: https://github.com/apache/spark/pull/26656#issuecomment-558132795 **[Test build #114385 has

[GitHub] [spark] AmplabJenkins commented on issue #26593: [SPARK-29890][SQL] DataFrameNaFunctions.fill should handle duplicate columns

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #26593: [SPARK-29890][SQL] DataFrameNaFunctions.fill should handle duplicate columns URL: https://github.com/apache/spark/pull/26593#issuecomment-558132913 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26593: [SPARK-29890][SQL] DataFrameNaFunctions.fill should handle duplicate columns

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #26593: [SPARK-29890][SQL] DataFrameNaFunctions.fill should handle duplicate columns URL: https://github.com/apache/spark/pull/26593#issuecomment-558132906 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #26593: [SPARK-29890][SQL] DataFrameNaFunctions.fill should handle duplicate columns

2019-11-25 Thread GitBox
SparkQA removed a comment on issue #26593: [SPARK-29890][SQL] DataFrameNaFunctions.fill should handle duplicate columns URL: https://github.com/apache/spark/pull/26593#issuecomment-558042523 **[Test build #114388 has

[GitHub] [spark] SparkQA commented on issue #26593: [SPARK-29890][SQL] DataFrameNaFunctions.fill should handle duplicate columns

2019-11-25 Thread GitBox
SparkQA commented on issue #26593: [SPARK-29890][SQL] DataFrameNaFunctions.fill should handle duplicate columns URL: https://github.com/apache/spark/pull/26593#issuecomment-558132345 **[Test build #114388 has

<    3   4   5   6   7   8   9   10   11   >