[GitHub] [spark] maropu commented on a change in pull request #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer

2020-01-07 Thread GitBox
maropu commented on a change in pull request #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer URL: https://github.com/apache/spark/pull/27077#discussion_r364101431 ## File path:

[GitHub] [spark] maropu commented on a change in pull request #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer

2020-01-07 Thread GitBox
maropu commented on a change in pull request #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer URL: https://github.com/apache/spark/pull/27077#discussion_r364100706 ## File path:

[GitHub] [spark] maropu commented on a change in pull request #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer

2020-01-07 Thread GitBox
maropu commented on a change in pull request #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer URL: https://github.com/apache/spark/pull/27077#discussion_r364100529 ## File path:

[GitHub] [spark] maropu commented on a change in pull request #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer

2020-01-07 Thread GitBox
maropu commented on a change in pull request #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer URL: https://github.com/apache/spark/pull/27077#discussion_r364100529 ## File path:

[GitHub] [spark] maropu commented on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer

2020-01-07 Thread GitBox
maropu commented on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer URL: https://github.com/apache/spark/pull/27077#issuecomment-571931540 Ah, I got the point. This is an automated

[GitHub] [spark] maropu commented on a change in pull request #27128: [SPARK-30421][SQL] Dropped columns still available for filtering

2020-01-07 Thread GitBox
maropu commented on a change in pull request #27128: [SPARK-30421][SQL] Dropped columns still available for filtering URL: https://github.com/apache/spark/pull/27128#discussion_r364098534 ## File path: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala ## @@

[GitHub] [spark] AmplabJenkins removed a comment on issue #26863: [SPARK-30234][SQL] ADD FILE cannot add directories from sql CLI

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #26863: [SPARK-30234][SQL] ADD FILE cannot add directories from sql CLI URL: https://github.com/apache/spark/pull/26863#issuecomment-571929234 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26863: [SPARK-30234][SQL] ADD FILE cannot add directories from sql CLI

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #26863: [SPARK-30234][SQL] ADD FILE cannot add directories from sql CLI URL: https://github.com/apache/spark/pull/26863#issuecomment-571929229 Merged build finished. Test FAILed. This

[GitHub] [spark] AmplabJenkins commented on issue #26863: [SPARK-30234][SQL] ADD FILE cannot add directories from sql CLI

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #26863: [SPARK-30234][SQL] ADD FILE cannot add directories from sql CLI URL: https://github.com/apache/spark/pull/26863#issuecomment-571929229 Merged build finished. Test FAILed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #26863: [SPARK-30234][SQL] ADD FILE cannot add directories from sql CLI

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #26863: [SPARK-30234][SQL] ADD FILE cannot add directories from sql CLI URL: https://github.com/apache/spark/pull/26863#issuecomment-571929234 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #26863: [SPARK-30234][SQL] ADD FILE cannot add directories from sql CLI

2020-01-07 Thread GitBox
SparkQA removed a comment on issue #26863: [SPARK-30234][SQL] ADD FILE cannot add directories from sql CLI URL: https://github.com/apache/spark/pull/26863#issuecomment-571917595 **[Test build #116285 has

[GitHub] [spark] SparkQA commented on issue #26863: [SPARK-30234][SQL] ADD FILE cannot add directories from sql CLI

2020-01-07 Thread GitBox
SparkQA commented on issue #26863: [SPARK-30234][SQL] ADD FILE cannot add directories from sql CLI URL: https://github.com/apache/spark/pull/26863#issuecomment-571929176 **[Test build #116285 has

[GitHub] [spark] Eric5553 commented on a change in pull request #26977: [SPARK-30326][SQL] Raise exception if analyzer exceed max iterations

2020-01-07 Thread GitBox
Eric5553 commented on a change in pull request #26977: [SPARK-30326][SQL] Raise exception if analyzer exceed max iterations URL: https://github.com/apache/spark/pull/26977#discussion_r364096684 ## File path:

[GitHub] [spark] Eric5553 commented on a change in pull request #26977: [SPARK-30326][SQL] Raise exception if analyzer exceed max iterations

2020-01-07 Thread GitBox
Eric5553 commented on a change in pull request #26977: [SPARK-30326][SQL] Raise exception if analyzer exceed max iterations URL: https://github.com/apache/spark/pull/26977#discussion_r364095962 ## File path:

[GitHub] [spark] Ngone51 commented on a change in pull request #27126: [SPARK-30417][CORE] Task speculation numTaskThreshold should be greater than 0 even if the configuration is not set correctly

2020-01-07 Thread GitBox
Ngone51 commented on a change in pull request #27126: [SPARK-30417][CORE] Task speculation numTaskThreshold should be greater than 0 even if the configuration is not set correctly URL: https://github.com/apache/spark/pull/27126#discussion_r364096069 ## File path:

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27128: [SPARK-30421][SQL] Dropped columns still available for filtering

2020-01-07 Thread GitBox
HyukjinKwon commented on a change in pull request #27128: [SPARK-30421][SQL] Dropped columns still available for filtering URL: https://github.com/apache/spark/pull/27128#discussion_r364092740 ## File path: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala ## @@

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27128: [SPARK-30421][SQL] Dropped columns still available for filtering

2020-01-07 Thread GitBox
HyukjinKwon commented on a change in pull request #27128: [SPARK-30421][SQL] Dropped columns still available for filtering URL: https://github.com/apache/spark/pull/27128#discussion_r364092570 ## File path: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala ## @@

[GitHub] [spark] HyukjinKwon commented on a change in pull request #24518: [SPARK-27627][SQL] Make option "pathGlobFilter" as a general option for all file sources

2020-01-07 Thread GitBox
HyukjinKwon commented on a change in pull request #24518: [SPARK-27627][SQL] Make option "pathGlobFilter" as a general option for all file sources URL: https://github.com/apache/spark/pull/24518#discussion_r364092114 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #27132: [SPARK-30454][SQL] Handle Null Pointer exception in HiveSQLException

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #27132: [SPARK-30454][SQL] Handle Null Pointer exception in HiveSQLException URL: https://github.com/apache/spark/pull/27132#issuecomment-571923689 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #27132: [SPARK-30454][SQL] Handle Null Pointer exception in HiveSQLException

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #27132: [SPARK-30454][SQL] Handle Null Pointer exception in HiveSQLException URL: https://github.com/apache/spark/pull/27132#issuecomment-571924051 Can one of the admins verify this patch?

[GitHub] [spark] HyukjinKwon commented on a change in pull request #24518: [SPARK-27627][SQL] Make option "pathGlobFilter" as a general option for all file sources

2020-01-07 Thread GitBox
HyukjinKwon commented on a change in pull request #24518: [SPARK-27627][SQL] Make option "pathGlobFilter" as a general option for all file sources URL: https://github.com/apache/spark/pull/24518#discussion_r364091900 ## File path:

[GitHub] [spark] HyukjinKwon commented on a change in pull request #24518: [SPARK-27627][SQL] Make option "pathGlobFilter" as a general option for all file sources

2020-01-07 Thread GitBox
HyukjinKwon commented on a change in pull request #24518: [SPARK-27627][SQL] Make option "pathGlobFilter" as a general option for all file sources URL: https://github.com/apache/spark/pull/24518#discussion_r364091620 ## File path:

[GitHub] [spark] HyukjinKwon commented on a change in pull request #24518: [SPARK-27627][SQL] Make option "pathGlobFilter" as a general option for all file sources

2020-01-07 Thread GitBox
HyukjinKwon commented on a change in pull request #24518: [SPARK-27627][SQL] Make option "pathGlobFilter" as a general option for all file sources URL: https://github.com/apache/spark/pull/24518#discussion_r364091810 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #27132: [SPARK-30454][SQL] Handle Null Pointer exception in HiveSQLException

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #27132: [SPARK-30454][SQL] Handle Null Pointer exception in HiveSQLException URL: https://github.com/apache/spark/pull/27132#issuecomment-571923689 Can one of the admins verify this patch?

[GitHub] [spark] PavithraRamachandran opened a new pull request #27132: [SPARK-30454][SQL] Handle Null Pointer exception in HiveSQLException

2020-01-07 Thread GitBox
PavithraRamachandran opened a new pull request #27132: [SPARK-30454][SQL] Handle Null Pointer exception in HiveSQLException URL: https://github.com/apache/spark/pull/27132 ### What changes were proposed in this pull request? Null Handling missed in HiveSQLException class in

[GitHub] [spark] zhengruifeng commented on a change in pull request #27097: [SPARK-9478][ML][PYSPARK] Add sample weights to Random Forest

2020-01-07 Thread GitBox
zhengruifeng commented on a change in pull request #27097: [SPARK-9478][ML][PYSPARK] Add sample weights to Random Forest URL: https://github.com/apache/spark/pull/27097#discussion_r364090059 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks URL: https://github.com/apache/spark/pull/27078#issuecomment-571922117 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks URL: https://github.com/apache/spark/pull/27078#issuecomment-571922123 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks URL: https://github.com/apache/spark/pull/27078#issuecomment-571922123 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks URL: https://github.com/apache/spark/pull/27078#issuecomment-571922117 Merged build finished. Test PASSed. This is an

[GitHub] [spark] zhengruifeng commented on a change in pull request #27097: [SPARK-9478][ML][PYSPARK] Add sample weights to Random Forest

2020-01-07 Thread GitBox
zhengruifeng commented on a change in pull request #27097: [SPARK-9478][ML][PYSPARK] Add sample weights to Random Forest URL: https://github.com/apache/spark/pull/27097#discussion_r364090059 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #27131: [SPARK-30455][Web UI] Select All should unselect after un-selecting any selected item from list

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #27131: [SPARK-30455][Web UI] Select All should unselect after un-selecting any selected item from list URL: https://github.com/apache/spark/pull/27131#issuecomment-571921641 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #27131: [SPARK-30455][Web UI] Select All should unselect after un-selecting any selected item from list

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #27131: [SPARK-30455][Web UI] Select All should unselect after un-selecting any selected item from list URL: https://github.com/apache/spark/pull/27131#issuecomment-571921955 Can one of the admins verify this patch?

[GitHub] [spark] SparkQA commented on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks

2020-01-07 Thread GitBox
SparkQA commented on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks URL: https://github.com/apache/spark/pull/27078#issuecomment-571921739 **[Test build #116286 has

[GitHub] [spark] AmplabJenkins commented on issue #27131: [SPARK-30455][Web UI] Select All should unselect after un-selecting any selected item from list

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #27131: [SPARK-30455][Web UI] Select All should unselect after un-selecting any selected item from list URL: https://github.com/apache/spark/pull/27131#issuecomment-571921641 Can one of the admins verify this patch?

[GitHub] [spark] 07ARB opened a new pull request #27131: [SPARK-30455][Web UI] Select All should unselect after un-selecting any selected item from list

2020-01-07 Thread GitBox
07ARB opened a new pull request #27131: [SPARK-30455][Web UI] Select All should unselect after un-selecting any selected item from list URL: https://github.com/apache/spark/pull/27131 ### What changes were proposed in this pull request? Select All should unselect after un-selecting any

[GitHub] [spark] AmplabJenkins commented on issue #27130: [Spark-25993][SQL][TEST]Add test cases for CREATE EXTERNAL TABLE with subdirectories

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #27130: [Spark-25993][SQL][TEST]Add test cases for CREATE EXTERNAL TABLE with subdirectories URL: https://github.com/apache/spark/pull/27130#issuecomment-571919850 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins removed a comment on issue #27130: [Spark-25993][SQL][TEST]Add test cases for CREATE EXTERNAL TABLE with subdirectories

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #27130: [Spark-25993][SQL][TEST]Add test cases for CREATE EXTERNAL TABLE with subdirectories URL: https://github.com/apache/spark/pull/27130#issuecomment-571919499 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #27130: [Spark-25993][SQL][TEST]Add test cases for CREATE EXTERNAL TABLE with subdirectories

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #27130: [Spark-25993][SQL][TEST]Add test cases for CREATE EXTERNAL TABLE with subdirectories URL: https://github.com/apache/spark/pull/27130#issuecomment-571919499 Can one of the admins verify this patch?

[GitHub] [spark] kevinyu98 edited a comment on issue #23108: [Spark-25993][SQL][TEST]Add test cases for CREATE EXTERNAL TABLE with subdirectories

2020-01-07 Thread GitBox
kevinyu98 edited a comment on issue #23108: [Spark-25993][SQL][TEST]Add test cases for CREATE EXTERNAL TABLE with subdirectories URL: https://github.com/apache/spark/pull/23108#issuecomment-571918348 I did the rebase on the master, open a new

[GitHub] [spark] MaxGekk commented on a change in pull request #24518: [SPARK-27627][SQL] Make option "pathGlobFilter" as a general option for all file sources

2020-01-07 Thread GitBox
MaxGekk commented on a change in pull request #24518: [SPARK-27627][SQL] Make option "pathGlobFilter" as a general option for all file sources URL: https://github.com/apache/spark/pull/24518#discussion_r364086734 ## File path:

[GitHub] [spark] kevinyu98 commented on issue #23108: [Spark-25993][SQL][TEST]Add test cases for CREATE EXTERNAL TABLE with subdirectories

2020-01-07 Thread GitBox
kevinyu98 commented on issue #23108: [Spark-25993][SQL][TEST]Add test cases for CREATE EXTERNAL TABLE with subdirectories URL: https://github.com/apache/spark/pull/23108#issuecomment-571918348 I did the rebase on the master, open a new pr[27130](https://github.com/apache/spark/pull/27130)

[GitHub] [spark] kevinyu98 opened a new pull request #27130: [Spark-25993][SQL][TEST]Add test cases for CREATE EXTERNAL TABLE with subdirectories

2020-01-07 Thread GitBox
kevinyu98 opened a new pull request #27130: [Spark-25993][SQL][TEST]Add test cases for CREATE EXTERNAL TABLE with subdirectories URL: https://github.com/apache/spark/pull/27130 ### What changes were proposed in this pull request? ### Why are the changes needed?

[GitHub] [spark] SparkQA commented on issue #26863: [SPARK-30234][SQL] ADD FILE cannot add directories from sql CLI

2020-01-07 Thread GitBox
SparkQA commented on issue #26863: [SPARK-30234][SQL] ADD FILE cannot add directories from sql CLI URL: https://github.com/apache/spark/pull/26863#issuecomment-571917595 **[Test build #116285 has

[GitHub] [spark] Ngone51 commented on issue #26881: [SPARK-30252][SQL] Disallow negative scale of Decimal under ansi mode

2020-01-07 Thread GitBox
Ngone51 commented on issue #26881: [SPARK-30252][SQL] Disallow negative scale of Decimal under ansi mode URL: https://github.com/apache/spark/pull/26881#issuecomment-571917318 cc @cloud-fan This is an automated message from

[GitHub] [spark] AmplabJenkins removed a comment on issue #26863: [SPARK-30234][SQL] ADD FILE cannot add directories from sql CLI

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #26863: [SPARK-30234][SQL] ADD FILE cannot add directories from sql CLI URL: https://github.com/apache/spark/pull/26863#issuecomment-571915957 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #26863: [SPARK-30234][SQL] ADD FILE cannot add directories from sql CLI

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #26863: [SPARK-30234][SQL] ADD FILE cannot add directories from sql CLI URL: https://github.com/apache/spark/pull/26863#issuecomment-571915964 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] HyukjinKwon commented on issue #27109: [SPARK-30434][PYTHON][SQL] Move pandas related functionalities into 'pandas' sub-package

2020-01-07 Thread GitBox
HyukjinKwon commented on issue #27109: [SPARK-30434][PYTHON][SQL] Move pandas related functionalities into 'pandas' sub-package URL: https://github.com/apache/spark/pull/27109#issuecomment-571915998 Thanks all. I will merge this tomorrow if I don't see any major concerns.

[GitHub] [spark] AmplabJenkins commented on issue #26863: [SPARK-30234][SQL] ADD FILE cannot add directories from sql CLI

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #26863: [SPARK-30234][SQL] ADD FILE cannot add directories from sql CLI URL: https://github.com/apache/spark/pull/26863#issuecomment-571915964 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26863: [SPARK-30234][SQL] ADD FILE cannot add directories from sql CLI

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #26863: [SPARK-30234][SQL] ADD FILE cannot add directories from sql CLI URL: https://github.com/apache/spark/pull/26863#issuecomment-571915957 Merged build finished. Test PASSed. This is an

[GitHub] [spark] HyukjinKwon commented on issue #26863: [SPARK-30234][SQL] ADD FILE cannot add directories from sql CLI

2020-01-07 Thread GitBox
HyukjinKwon commented on issue #26863: [SPARK-30234][SQL] ADD FILE cannot add directories from sql CLI URL: https://github.com/apache/spark/pull/26863#issuecomment-571915576 retest this please This is an automated message

[GitHub] [spark] AmplabJenkins commented on issue #27125: [SPARK-30214][SQL][FOLLOWUP] Remove statement logical plans for namespace commands

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #27125: [SPARK-30214][SQL][FOLLOWUP] Remove statement logical plans for namespace commands URL: https://github.com/apache/spark/pull/27125#issuecomment-571914884 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27125: [SPARK-30214][SQL][FOLLOWUP] Remove statement logical plans for namespace commands

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #27125: [SPARK-30214][SQL][FOLLOWUP] Remove statement logical plans for namespace commands URL: https://github.com/apache/spark/pull/27125#issuecomment-571914886 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #27125: [SPARK-30214][SQL][FOLLOWUP] Remove statement logical plans for namespace commands

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #27125: [SPARK-30214][SQL][FOLLOWUP] Remove statement logical plans for namespace commands URL: https://github.com/apache/spark/pull/27125#issuecomment-571914886 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27125: [SPARK-30214][SQL][FOLLOWUP] Remove statement logical plans for namespace commands

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #27125: [SPARK-30214][SQL][FOLLOWUP] Remove statement logical plans for namespace commands URL: https://github.com/apache/spark/pull/27125#issuecomment-571914884 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #27125: [SPARK-30214][SQL][FOLLOWUP] Remove statement logical plans for namespace commands

2020-01-07 Thread GitBox
SparkQA removed a comment on issue #27125: [SPARK-30214][SQL][FOLLOWUP] Remove statement logical plans for namespace commands URL: https://github.com/apache/spark/pull/27125#issuecomment-571867256 **[Test build #116278 has

[GitHub] [spark] SparkQA commented on issue #27125: [SPARK-30214][SQL][FOLLOWUP] Remove statement logical plans for namespace commands

2020-01-07 Thread GitBox
SparkQA commented on issue #27125: [SPARK-30214][SQL][FOLLOWUP] Remove statement logical plans for namespace commands URL: https://github.com/apache/spark/pull/27125#issuecomment-571914404 **[Test build #116278 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE/ALTER NAMESPACE syntax

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE/ALTER NAMESPACE syntax URL: https://github.com/apache/spark/pull/26806#issuecomment-571912983 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE/ALTER NAMESPACE syntax

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE/ALTER NAMESPACE syntax URL: https://github.com/apache/spark/pull/26806#issuecomment-571912976 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE/ALTER NAMESPACE syntax

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE/ALTER NAMESPACE syntax URL: https://github.com/apache/spark/pull/26806#issuecomment-571912976 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE/ALTER NAMESPACE syntax

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE/ALTER NAMESPACE syntax URL: https://github.com/apache/spark/pull/26806#issuecomment-571912983 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] SparkQA removed a comment on issue #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE/ALTER NAMESPACE syntax

2020-01-07 Thread GitBox
SparkQA removed a comment on issue #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE/ALTER NAMESPACE syntax URL: https://github.com/apache/spark/pull/26806#issuecomment-571865447 **[Test build #116276 has

[GitHub] [spark] SparkQA commented on issue #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE/ALTER NAMESPACE syntax

2020-01-07 Thread GitBox
SparkQA commented on issue #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE/ALTER NAMESPACE syntax URL: https://github.com/apache/spark/pull/26806#issuecomment-571912494 **[Test build #116276 has

[GitHub] [spark] gengliangwang closed pull request #27127: [SPARK-30267][SQL][FollowUp] Use while loop in Avro Array Deserializer

2020-01-07 Thread GitBox
gengliangwang closed pull request #27127: [SPARK-30267][SQL][FollowUp] Use while loop in Avro Array Deserializer URL: https://github.com/apache/spark/pull/27127 This is an automated message from the Apache Git Service. To

[GitHub] [spark] gengliangwang commented on issue #27127: [SPARK-30267][SQL][FollowUp] Use while loop in Avro Array Deserializer

2020-01-07 Thread GitBox
gengliangwang commented on issue #27127: [SPARK-30267][SQL][FollowUp] Use while loop in Avro Array Deserializer URL: https://github.com/apache/spark/pull/27127#issuecomment-571912061 @steven-aerts Thanks for the benchmark!

[GitHub] [spark] gengliangwang commented on issue #27127: [SPARK-30267][SQL][FollowUp] Use while loop in Avro Array Deserializer

2020-01-07 Thread GitBox
gengliangwang commented on issue #27127: [SPARK-30267][SQL][FollowUp] Use while loop in Avro Array Deserializer URL: https://github.com/apache/spark/pull/27127#issuecomment-571912138 Merging to master. This is an automated

[GitHub] [spark] ajithme commented on issue #27039: [SPARK-29174][SQL] LOCAL is not supported in INSERT OVERWRITE DIRECTORY to data source

2020-01-07 Thread GitBox
ajithme commented on issue #27039: [SPARK-29174][SQL] LOCAL is not supported in INSERT OVERWRITE DIRECTORY to data source URL: https://github.com/apache/spark/pull/27039#issuecomment-571909593 gentle ping @HyukjinKwon @dongjoon-hyun

[GitHub] [spark] ajithme removed a comment on issue #27039: [SPARK-29174][SQL] LOCAL is not supported in INSERT OVERWRITE DIRECTORY to data source

2020-01-07 Thread GitBox
ajithme removed a comment on issue #27039: [SPARK-29174][SQL] LOCAL is not supported in INSERT OVERWRITE DIRECTORY to data source URL: https://github.com/apache/spark/pull/27039#issuecomment-570120641 gentle ping @HyukjinKwon @dongjoon-hyun

[GitHub] [spark] ajithme commented on issue #27041: [SPARK-25061] Precedence for ThriftServer hiveconf commandline parameter

2020-01-07 Thread GitBox
ajithme commented on issue #27041: [SPARK-25061] Precedence for ThriftServer hiveconf commandline parameter URL: https://github.com/apache/spark/pull/27041#issuecomment-571909273 gentle ping @yhuai @dongjoon-hyun @HyukjinKwon

[GitHub] [spark] ajithme removed a comment on issue #27041: [SPARK-25061] Precedence for ThriftServer hiveconf commandline parameter

2020-01-07 Thread GitBox
ajithme removed a comment on issue #27041: [SPARK-25061] Precedence for ThriftServer hiveconf commandline parameter URL: https://github.com/apache/spark/pull/27041#issuecomment-570187234 gentle ping @HyukjinKwon @steveloughran @cloud-fan @yhuai @gatorsmile

[GitHub] [spark] uncleGen commented on issue #26343: [SPARK-29683][YARN] Job will fail due to executor failures all available nodes are blacklisted

2020-01-07 Thread GitBox
uncleGen commented on issue #26343: [SPARK-29683][YARN] Job will fail due to executor failures all available nodes are blacklisted URL: https://github.com/apache/spark/pull/26343#issuecomment-571905423 Kindly reminder to @dongjoon-hyun

[GitHub] [spark] AmplabJenkins removed a comment on issue #27079: [SPARK-30410][SQL] Calculating size of table with large number of partitions causes flooding logs

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #27079: [SPARK-30410][SQL] Calculating size of table with large number of partitions causes flooding logs URL: https://github.com/apache/spark/pull/27079#issuecomment-571903674 Test PASSed. Refer to this link for build results (access rights to

[GitHub] [spark] AmplabJenkins removed a comment on issue #27079: [SPARK-30410][SQL] Calculating size of table with large number of partitions causes flooding logs

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #27079: [SPARK-30410][SQL] Calculating size of table with large number of partitions causes flooding logs URL: https://github.com/apache/spark/pull/27079#issuecomment-571903668 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27079: [SPARK-30410][SQL] Calculating size of table with large number of partitions causes flooding logs

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #27079: [SPARK-30410][SQL] Calculating size of table with large number of partitions causes flooding logs URL: https://github.com/apache/spark/pull/27079#issuecomment-571903668 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27079: [SPARK-30410][SQL] Calculating size of table with large number of partitions causes flooding logs

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #27079: [SPARK-30410][SQL] Calculating size of table with large number of partitions causes flooding logs URL: https://github.com/apache/spark/pull/27079#issuecomment-571903674 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] SparkQA removed a comment on issue #27079: [SPARK-30410][SQL] Calculating size of table with large number of partitions causes flooding logs

2020-01-07 Thread GitBox
SparkQA removed a comment on issue #27079: [SPARK-30410][SQL] Calculating size of table with large number of partitions causes flooding logs URL: https://github.com/apache/spark/pull/27079#issuecomment-571855240 **[Test build #116274 has

[GitHub] [spark] SparkQA commented on issue #27079: [SPARK-30410][SQL] Calculating size of table with large number of partitions causes flooding logs

2020-01-07 Thread GitBox
SparkQA commented on issue #27079: [SPARK-30410][SQL] Calculating size of table with large number of partitions causes flooding logs URL: https://github.com/apache/spark/pull/27079#issuecomment-571903207 **[Test build #116274 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27116: [SPARK-30440][CORE][TEST] Fix flaky test of SPARK-30359

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #27116: [SPARK-30440][CORE][TEST] Fix flaky test of SPARK-30359 URL: https://github.com/apache/spark/pull/27116#issuecomment-571902912 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #27116: [SPARK-30440][CORE][TEST] Fix flaky test of SPARK-30359

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #27116: [SPARK-30440][CORE][TEST] Fix flaky test of SPARK-30359 URL: https://github.com/apache/spark/pull/27116#issuecomment-571902917 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27116: [SPARK-30440][CORE][TEST] Fix flaky test of SPARK-30359

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #27116: [SPARK-30440][CORE][TEST] Fix flaky test of SPARK-30359 URL: https://github.com/apache/spark/pull/27116#issuecomment-571902912 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #27116: [SPARK-30440][CORE][TEST] Fix flaky test of SPARK-30359

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #27116: [SPARK-30440][CORE][TEST] Fix flaky test of SPARK-30359 URL: https://github.com/apache/spark/pull/27116#issuecomment-571902917 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #27116: [SPARK-30440][CORE][TEST] Fix flaky test of SPARK-30359

2020-01-07 Thread GitBox
SparkQA commented on issue #27116: [SPARK-30440][CORE][TEST] Fix flaky test of SPARK-30359 URL: https://github.com/apache/spark/pull/27116#issuecomment-571902668 **[Test build #116284 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116284/testReport)** for

[GitHub] [spark] yujiantao commented on issue #10362: [SPARK-12218] [SQL] Invalid splitting of nested AND expressions in Data Source filter API

2020-01-07 Thread GitBox
yujiantao commented on issue #10362: [SPARK-12218] [SQL] Invalid splitting of nested AND expressions in Data Source filter API URL: https://github.com/apache/spark/pull/10362#issuecomment-571902074 @liancheng Is there any fix on this case? We have big performance issue as we have many

[GitHub] [spark] yujiantao edited a comment on issue #10362: [SPARK-12218] [SQL] Invalid splitting of nested AND expressions in Data Source filter API

2020-01-07 Thread GitBox
yujiantao edited a comment on issue #10362: [SPARK-12218] [SQL] Invalid splitting of nested AND expressions in Data Source filter API URL: https://github.com/apache/spark/pull/10362#issuecomment-571902074 @liancheng Is there any fix on this case? We have a big performance issue as we

[GitHub] [spark] Ngone51 commented on a change in pull request #27116: [SPARK-30440][CORE][TEST] Fix flaky test of SPARK-30359

2020-01-07 Thread GitBox
Ngone51 commented on a change in pull request #27116: [SPARK-30440][CORE][TEST] Fix flaky test of SPARK-30359 URL: https://github.com/apache/spark/pull/27116#discussion_r364073084 ## File path: core/src/test/scala/org/apache/spark/scheduler/TaskSetManagerSuite.scala ##

[GitHub] [spark] Ngone51 commented on a change in pull request #27116: [SPARK-30440][CORE][TEST] Fix flaky test of SPARK-30359

2020-01-07 Thread GitBox
Ngone51 commented on a change in pull request #27116: [SPARK-30440][CORE][TEST] Fix flaky test of SPARK-30359 URL: https://github.com/apache/spark/pull/27116#discussion_r364073084 ## File path: core/src/test/scala/org/apache/spark/scheduler/TaskSetManagerSuite.scala ##

[GitHub] [spark] apapi edited a comment on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer

2020-01-07 Thread GitBox
apapi edited a comment on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer URL: https://github.com/apache/spark/pull/27077#issuecomment-571900240 @maropu My example in description is ambiguous, I updated the example. More details: For

[GitHub] [spark] AmplabJenkins removed a comment on issue #27129: [SPARK-30427] Add config item for limiting partition number when calculating statistics through File System

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #27129: [SPARK-30427] Add config item for limiting partition number when calculating statistics through File System URL: https://github.com/apache/spark/pull/27129#issuecomment-571901395 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27129: [SPARK-30427] Add config item for limiting partition number when calculating statistics through File System

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #27129: [SPARK-30427] Add config item for limiting partition number when calculating statistics through File System URL: https://github.com/apache/spark/pull/27129#issuecomment-571901399 Test PASSed. Refer to this link for build results (access rights to

[GitHub] [spark] AmplabJenkins removed a comment on issue #27129: [SPARK-30427] Add config item for limiting partition number when calculating statistics through File System

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #27129: [SPARK-30427] Add config item for limiting partition number when calculating statistics through File System URL: https://github.com/apache/spark/pull/27129#issuecomment-571901399 Test PASSed. Refer to this link for build results (access

[GitHub] [spark] AmplabJenkins commented on issue #27129: [SPARK-30427] Add config item for limiting partition number when calculating statistics through File System

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #27129: [SPARK-30427] Add config item for limiting partition number when calculating statistics through File System URL: https://github.com/apache/spark/pull/27129#issuecomment-571901395 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #27129: [SPARK-30427] Add config item for limiting partition number when calculating statistics through File System

2020-01-07 Thread GitBox
SparkQA commented on issue #27129: [SPARK-30427] Add config item for limiting partition number when calculating statistics through File System URL: https://github.com/apache/spark/pull/27129#issuecomment-571901051 **[Test build #116283 has

[GitHub] [spark] fuwhu commented on issue #27129: [SPARK-30427] Add config item for limiting partition number when calculating statistics through File System

2020-01-07 Thread GitBox
fuwhu commented on issue #27129: [SPARK-30427] Add config item for limiting partition number when calculating statistics through File System URL: https://github.com/apache/spark/pull/27129#issuecomment-571900769 cc: @cloud-fan @wangyum

[GitHub] [spark] fuwhu commented on issue #27129: [SPARK-30427] Add config item for limiting partition number when calculating statistics through File System

2020-01-07 Thread GitBox
fuwhu commented on issue #27129: [SPARK-30427] Add config item for limiting partition number when calculating statistics through File System URL: https://github.com/apache/spark/pull/27129#issuecomment-571900461 This config can also be used in PruneHiveTablePartitions which is proposed in

[GitHub] [spark] fuwhu edited a comment on issue #27129: [SPARK-30427] Add config item for limiting partition number when calculating statistics through File System

2020-01-07 Thread GitBox
fuwhu edited a comment on issue #27129: [SPARK-30427] Add config item for limiting partition number when calculating statistics through File System URL: https://github.com/apache/spark/pull/27129#issuecomment-571900461 This config can also be used in PruneHiveTablePartitions which is

[GitHub] [spark] apapi commented on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer

2020-01-07 Thread GitBox
apapi commented on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer URL: https://github.com/apache/spark/pull/27077#issuecomment-571900240 @maropu My example in description is ambiguous, I updated the example. More details: For

[GitHub] [spark] fuwhu opened a new pull request #27129: [SPARK-30427] Add config item for limiting partition number when calculating statistics through File System

2020-01-07 Thread GitBox
fuwhu opened a new pull request #27129: [SPARK-30427] Add config item for limiting partition number when calculating statistics through File System URL: https://github.com/apache/spark/pull/27129 ### What changes were proposed in this pull request? Add config

[GitHub] [spark] advancedxy commented on issue #25919: [SPARK-15616][SQL] Hive table supports partition pruning in JoinSelection

2020-01-07 Thread GitBox
advancedxy commented on issue #25919: [SPARK-15616][SQL] Hive table supports partition pruning in JoinSelection URL: https://github.com/apache/spark/pull/25919#issuecomment-571900204 closed in favor of #26805 This is an

[GitHub] [spark] advancedxy closed pull request #25919: [SPARK-15616][SQL] Hive table supports partition pruning in JoinSelection

2020-01-07 Thread GitBox
advancedxy closed pull request #25919: [SPARK-15616][SQL] Hive table supports partition pruning in JoinSelection URL: https://github.com/apache/spark/pull/25919 This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on issue #26959: [SPARK-30315][SQL] Add adaptive execution context

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #26959: [SPARK-30315][SQL] Add adaptive execution context URL: https://github.com/apache/spark/pull/26959#issuecomment-571896636 Test PASSed. Refer to this link for build results (access rights to CI server needed):

  1   2   3   4   5   6   7   8   9   10   >