[GitHub] [spark] JkSelf commented on issue #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default

2020-01-06 Thread GitBox
JkSelf commented on issue #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default URL: https://github.com/apache/spark/pull/26813#issuecomment-571440605 @cloud-fan @dongjoon-hyun @HyukjinKwon updated all your comments. Thanks.

[GitHub] [spark] AmplabJenkins commented on issue #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default

2020-01-06 Thread GitBox
AmplabJenkins commented on issue #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default URL: https://github.com/apache/spark/pull/26813#issuecomment-571440644 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default

2020-01-06 Thread GitBox
AmplabJenkins commented on issue #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default URL: https://github.com/apache/spark/pull/26813#issuecomment-571440653 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27099: [SPARK-30335][SQL][DOCS] Add a note first, last, collect_list and collect_set can be non-deterministic in SQL function docs as well

2020-01-06 Thread GitBox
AmplabJenkins removed a comment on issue #27099: [SPARK-30335][SQL][DOCS] Add a note first, last, collect_list and collect_set can be non-deterministic in SQL function docs as well URL: https://github.com/apache/spark/pull/27099#issuecomment-571440084 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27102: [SPARK-30431][SQL] Update SqlBase.g4 to create commentSpec pattern like locationSpec

2020-01-06 Thread GitBox
AmplabJenkins removed a comment on issue #27102: [SPARK-30431][SQL] Update SqlBase.g4 to create commentSpec pattern like locationSpec URL: https://github.com/apache/spark/pull/27102#issuecomment-571439797 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #27099: [SPARK-30335][SQL][DOCS] Add a note first, last, collect_list and collect_set can be non-deterministic in SQL function docs as well

2020-01-06 Thread GitBox
AmplabJenkins removed a comment on issue #27099: [SPARK-30335][SQL][DOCS] Add a note first, last, collect_list and collect_set can be non-deterministic in SQL function docs as well URL: https://github.com/apache/spark/pull/27099#issuecomment-571440088 Test PASSed. Refer to this link

[GitHub] [spark] AmplabJenkins commented on issue #27099: [SPARK-30335][SQL][DOCS] Add a note first, last, collect_list and collect_set can be non-deterministic in SQL function docs as well

2020-01-06 Thread GitBox
AmplabJenkins commented on issue #27099: [SPARK-30335][SQL][DOCS] Add a note first, last, collect_list and collect_set can be non-deterministic in SQL function docs as well URL: https://github.com/apache/spark/pull/27099#issuecomment-571440084 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27099: [SPARK-30335][SQL][DOCS] Add a note first, last, collect_list and collect_set can be non-deterministic in SQL function docs as well

2020-01-06 Thread GitBox
AmplabJenkins commented on issue #27099: [SPARK-30335][SQL][DOCS] Add a note first, last, collect_list and collect_set can be non-deterministic in SQL function docs as well URL: https://github.com/apache/spark/pull/27099#issuecomment-571440088 Test PASSed. Refer to this link for build

[GitHub] [spark] iRakson commented on issue #26863: [SPARK-30234]ADD FILE cannot add directories from sql CLI

2020-01-06 Thread GitBox
iRakson commented on issue #26863: [SPARK-30234]ADD FILE cannot add directories from sql CLI URL: https://github.com/apache/spark/pull/26863#issuecomment-571440126 > Looks fine otherwise. @iRakson can you resolve conflicts and update? Done.

[GitHub] [spark] SparkQA removed a comment on issue #27099: [SPARK-30335][SQL][DOCS] Add a note first, last, collect_list and collect_set can be non-deterministic in SQL function docs as well

2020-01-06 Thread GitBox
SparkQA removed a comment on issue #27099: [SPARK-30335][SQL][DOCS] Add a note first, last, collect_list and collect_set can be non-deterministic in SQL function docs as well URL: https://github.com/apache/spark/pull/27099#issuecomment-571388058 **[Test build #116195 has

[GitHub] [spark] SparkQA removed a comment on issue #27102: [SPARK-30431][SQL] Update SqlBase.g4 to create commentSpec pattern like locationSpec

2020-01-06 Thread GitBox
SparkQA removed a comment on issue #27102: [SPARK-30431][SQL] Update SqlBase.g4 to create commentSpec pattern like locationSpec URL: https://github.com/apache/spark/pull/27102#issuecomment-571412482 **[Test build #116204 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27102: [SPARK-30431][SQL] Update SqlBase.g4 to create commentSpec pattern like locationSpec

2020-01-06 Thread GitBox
AmplabJenkins removed a comment on issue #27102: [SPARK-30431][SQL] Update SqlBase.g4 to create commentSpec pattern like locationSpec URL: https://github.com/apache/spark/pull/27102#issuecomment-571439793 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA commented on issue #27102: [SPARK-30431][SQL] Update SqlBase.g4 to create commentSpec pattern like locationSpec

2020-01-06 Thread GitBox
SparkQA commented on issue #27102: [SPARK-30431][SQL] Update SqlBase.g4 to create commentSpec pattern like locationSpec URL: https://github.com/apache/spark/pull/27102#issuecomment-571439689 **[Test build #116204 has

[GitHub] [spark] SparkQA commented on issue #27099: [SPARK-30335][SQL][DOCS] Add a note first, last, collect_list and collect_set can be non-deterministic in SQL function docs as well

2020-01-06 Thread GitBox
SparkQA commented on issue #27099: [SPARK-30335][SQL][DOCS] Add a note first, last, collect_list and collect_set can be non-deterministic in SQL function docs as well URL: https://github.com/apache/spark/pull/27099#issuecomment-571439695 **[Test build #116195 has

[GitHub] [spark] AmplabJenkins commented on issue #27102: [SPARK-30431][SQL] Update SqlBase.g4 to create commentSpec pattern like locationSpec

2020-01-06 Thread GitBox
AmplabJenkins commented on issue #27102: [SPARK-30431][SQL] Update SqlBase.g4 to create commentSpec pattern like locationSpec URL: https://github.com/apache/spark/pull/27102#issuecomment-571439797 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27102: [SPARK-30431][SQL] Update SqlBase.g4 to create commentSpec pattern like locationSpec

2020-01-06 Thread GitBox
AmplabJenkins commented on issue #27102: [SPARK-30431][SQL] Update SqlBase.g4 to create commentSpec pattern like locationSpec URL: https://github.com/apache/spark/pull/27102#issuecomment-571439793 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26943: [SPARK-30298][SQL] Bucket join should work for self-join with views

2020-01-06 Thread GitBox
AmplabJenkins removed a comment on issue #26943: [SPARK-30298][SQL] Bucket join should work for self-join with views URL: https://github.com/apache/spark/pull/26943#issuecomment-571439096 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26943: [SPARK-30298][SQL] Bucket join should work for self-join with views

2020-01-06 Thread GitBox
AmplabJenkins removed a comment on issue #26943: [SPARK-30298][SQL] Bucket join should work for self-join with views URL: https://github.com/apache/spark/pull/26943#issuecomment-571439092 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27102: [SPARK-30431][SQL] Update SqlBase.g4 to create commentSpec pattern like locationSpec

2020-01-06 Thread GitBox
AmplabJenkins removed a comment on issue #27102: [SPARK-30431][SQL] Update SqlBase.g4 to create commentSpec pattern like locationSpec URL: https://github.com/apache/spark/pull/27102#issuecomment-571438955 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #26943: [SPARK-30298][SQL] Bucket join should work for self-join with views

2020-01-06 Thread GitBox
AmplabJenkins commented on issue #26943: [SPARK-30298][SQL] Bucket join should work for self-join with views URL: https://github.com/apache/spark/pull/26943#issuecomment-571439096 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27102: [SPARK-30431][SQL] Update SqlBase.g4 to create commentSpec pattern like locationSpec

2020-01-06 Thread GitBox
AmplabJenkins removed a comment on issue #27102: [SPARK-30431][SQL] Update SqlBase.g4 to create commentSpec pattern like locationSpec URL: https://github.com/apache/spark/pull/27102#issuecomment-571438947 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26943: [SPARK-30298][SQL] Bucket join should work for self-join with views

2020-01-06 Thread GitBox
AmplabJenkins commented on issue #26943: [SPARK-30298][SQL] Bucket join should work for self-join with views URL: https://github.com/apache/spark/pull/26943#issuecomment-571439092 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #27102: [SPARK-30431][SQL] Update SqlBase.g4 to create commentSpec pattern like locationSpec

2020-01-06 Thread GitBox
AmplabJenkins commented on issue #27102: [SPARK-30431][SQL] Update SqlBase.g4 to create commentSpec pattern like locationSpec URL: https://github.com/apache/spark/pull/27102#issuecomment-571438947 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27102: [SPARK-30431][SQL] Update SqlBase.g4 to create commentSpec pattern like locationSpec

2020-01-06 Thread GitBox
AmplabJenkins commented on issue #27102: [SPARK-30431][SQL] Update SqlBase.g4 to create commentSpec pattern like locationSpec URL: https://github.com/apache/spark/pull/27102#issuecomment-571438955 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #26943: [SPARK-30298][SQL] Bucket join should work for self-join with views

2020-01-06 Thread GitBox
SparkQA removed a comment on issue #26943: [SPARK-30298][SQL] Bucket join should work for self-join with views URL: https://github.com/apache/spark/pull/26943#issuecomment-571389871 **[Test build #116197 has

[GitHub] [spark] SparkQA commented on issue #27102: [SPARK-30431][SQL] Update SqlBase.g4 to create commentSpec pattern like locationSpec

2020-01-06 Thread GitBox
SparkQA commented on issue #27102: [SPARK-30431][SQL] Update SqlBase.g4 to create commentSpec pattern like locationSpec URL: https://github.com/apache/spark/pull/27102#issuecomment-571438681 **[Test build #116212 has

[GitHub] [spark] SparkQA commented on issue #26943: [SPARK-30298][SQL] Bucket join should work for self-join with views

2020-01-06 Thread GitBox
SparkQA commented on issue #26943: [SPARK-30298][SQL] Bucket join should work for self-join with views URL: https://github.com/apache/spark/pull/26943#issuecomment-571438632 **[Test build #116197 has

[GitHub] [spark] cloud-fan commented on a change in pull request #27109: [SPARK-30434][PYTHON][SQL] Move pandas related functionalities into 'pandas' sub-package

2020-01-06 Thread GitBox
cloud-fan commented on a change in pull request #27109: [SPARK-30434][PYTHON][SQL] Move pandas related functionalities into 'pandas' sub-package URL: https://github.com/apache/spark/pull/27109#discussion_r36359 ## File path: python/pyspark/sql/dataframe.py ## @@

[GitHub] [spark] HeartSaVioR edited a comment on issue #27107: [SPARK-30436][SQL] Allow CREATE EXTERNAL TABLE with only requiring LOCATION

2020-01-06 Thread GitBox
HeartSaVioR edited a comment on issue #27107: [SPARK-30436][SQL] Allow CREATE EXTERNAL TABLE with only requiring LOCATION URL: https://github.com/apache/spark/pull/27107#issuecomment-571432884 The thing is that it "conditionally" works which is very confusing because the condition is

[GitHub] [spark] HeartSaVioR edited a comment on issue #27107: [SPARK-30436][SQL] Allow CREATE EXTERNAL TABLE with only requiring LOCATION

2020-01-06 Thread GitBox
HeartSaVioR edited a comment on issue #27107: [SPARK-30436][SQL] Allow CREATE EXTERNAL TABLE with only requiring LOCATION URL: https://github.com/apache/spark/pull/27107#issuecomment-571435159 IMHO, to avoid confusion, we may need to either differentiate visitCreateTable and

[GitHub] [spark] AmplabJenkins commented on issue #27111: [SPARK-30441][Graphx]Improve the memory usage in StronglyConnectedComponents

2020-01-06 Thread GitBox
AmplabJenkins commented on issue #27111: [SPARK-30441][Graphx]Improve the memory usage in StronglyConnectedComponents URL: https://github.com/apache/spark/pull/27111#issuecomment-571435610 Can one of the admins verify this patch?

[GitHub] [spark] HeartSaVioR edited a comment on issue #27107: [SPARK-30436][SQL] Allow CREATE EXTERNAL TABLE with only requiring LOCATION

2020-01-06 Thread GitBox
HeartSaVioR edited a comment on issue #27107: [SPARK-30436][SQL] Allow CREATE EXTERNAL TABLE with only requiring LOCATION URL: https://github.com/apache/spark/pull/27107#issuecomment-571435159 IMHO, to avoid confusion, we may need to either differentiate createTable and createHiveTable at

[GitHub] [spark] cloud-fan closed pull request #26993: [SPARK-30338][SQL] Avoid unnecessary InternalRow copies in ParquetRowConverter

2020-01-06 Thread GitBox
cloud-fan closed pull request #26993: [SPARK-30338][SQL] Avoid unnecessary InternalRow copies in ParquetRowConverter URL: https://github.com/apache/spark/pull/26993 This is an automated message from the Apache Git Service.

[GitHub] [spark] HeartSaVioR commented on issue #27107: [SPARK-30436][SQL] Allow CREATE EXTERNAL TABLE with only requiring LOCATION

2020-01-06 Thread GitBox
HeartSaVioR commented on issue #27107: [SPARK-30436][SQL] Allow CREATE EXTERNAL TABLE with only requiring LOCATION URL: https://github.com/apache/spark/pull/27107#issuecomment-571435159 IMHO, to avoid confusion, we may need to either differentiate createTable and createHiveTable at the

[GitHub] [spark] cloud-fan commented on issue #26993: [SPARK-30338][SQL] Avoid unnecessary InternalRow copies in ParquetRowConverter

2020-01-06 Thread GitBox
cloud-fan commented on issue #26993: [SPARK-30338][SQL] Avoid unnecessary InternalRow copies in ParquetRowConverter URL: https://github.com/apache/spark/pull/26993#issuecomment-571435079 thanks, merging to master! This is an

[GitHub] [spark] imback82 commented on a change in pull request #27095: [SPARK-30214][SQL] V2 commands resolves namespaces with new resolution framework

2020-01-06 Thread GitBox
imback82 commented on a change in pull request #27095: [SPARK-30214][SQL] V2 commands resolves namespaces with new resolution framework URL: https://github.com/apache/spark/pull/27095#discussion_r363592006 ## File path:

[GitHub] [spark] HeartSaVioR edited a comment on issue #27107: [SPARK-30436][SQL] Allow CREATE EXTERNAL TABLE with only requiring LOCATION

2020-01-06 Thread GitBox
HeartSaVioR edited a comment on issue #27107: [SPARK-30436][SQL] Allow CREATE EXTERNAL TABLE with only requiring LOCATION URL: https://github.com/apache/spark/pull/27107#issuecomment-571432884 The thing is that it "conditionally" works which is very confusing because the condition is

[GitHub] [spark] HeartSaVioR edited a comment on issue #27107: [SPARK-30436][SQL] Allow CREATE EXTERNAL TABLE with only requiring LOCATION

2020-01-06 Thread GitBox
HeartSaVioR edited a comment on issue #27107: [SPARK-30436][SQL] Allow CREATE EXTERNAL TABLE with only requiring LOCATION URL: https://github.com/apache/spark/pull/27107#issuecomment-571432884 The thing is that it "conditionally" works which is very confusing because the condition is

[GitHub] [spark] jmzhoulab opened a new pull request #27111: [SPARK-30441][Graphx]Improve the memory usage in StronglyConnectedComponents

2020-01-06 Thread GitBox
jmzhoulab opened a new pull request #27111: [SPARK-30441][Graphx]Improve the memory usage in StronglyConnectedComponents URL: https://github.com/apache/spark/pull/27111 ### What changes were proposed in this pull request? Make the Graph/RDD as non-persistent for 'sccGraph' in 'do ...

[GitHub] [spark] jmzhoulab closed pull request #27111: [SPARK-30441][Graphx]Improve the memory usage in StronglyConnectedComponents

2020-01-06 Thread GitBox
jmzhoulab closed pull request #27111: [SPARK-30441][Graphx]Improve the memory usage in StronglyConnectedComponents URL: https://github.com/apache/spark/pull/27111 This is an automated message from the Apache Git Service. To

[GitHub] [spark] HeartSaVioR edited a comment on issue #27107: [SPARK-30436][SQL] Allow CREATE EXTERNAL TABLE with only requiring LOCATION

2020-01-06 Thread GitBox
HeartSaVioR edited a comment on issue #27107: [SPARK-30436][SQL] Allow CREATE EXTERNAL TABLE with only requiring LOCATION URL: https://github.com/apache/spark/pull/27107#issuecomment-571432884 The thing is that it "conditionally" works which is very confusing because the condition is

[GitHub] [spark] HeartSaVioR commented on issue #27107: [SPARK-30436][SQL] Allow CREATE EXTERNAL TABLE with only requiring LOCATION

2020-01-06 Thread GitBox
HeartSaVioR commented on issue #27107: [SPARK-30436][SQL] Allow CREATE EXTERNAL TABLE with only requiring LOCATION URL: https://github.com/apache/spark/pull/27107#issuecomment-571432884 The thing is that it "conditionally" works which is very confusing because the condition is whether the

[GitHub] [spark] cloud-fan commented on issue #27107: [SPARK-30436][SQL] Allow CREATE EXTERNAL TABLE with only requiring LOCATION

2020-01-06 Thread GitBox
cloud-fan commented on issue #27107: [SPARK-30436][SQL] Allow CREATE EXTERNAL TABLE with only requiring LOCATION URL: https://github.com/apache/spark/pull/27107#issuecomment-571430471 I think the question here is what shall we do for `CREATE EXTERNAL TABLE ... LOCATION`. In Spark 2.4 it

[GitHub] [spark] sandeep-katta commented on issue #25452: [SPARK-28710][SQL]to fix replace function, spark should call drop and create function

2020-01-06 Thread GitBox
sandeep-katta commented on issue #25452: [SPARK-28710][SQL]to fix replace function, spark should call drop and create function URL: https://github.com/apache/spark/pull/25452#issuecomment-571430188 ping @viirya This is an

[GitHub] [spark] HeartSaVioR commented on a change in pull request #27107: [SPARK-30436][SQL] Allow CREATE EXTERNAL TABLE with only requiring LOCATION

2020-01-06 Thread GitBox
HeartSaVioR commented on a change in pull request #27107: [SPARK-30436][SQL] Allow CREATE EXTERNAL TABLE with only requiring LOCATION URL: https://github.com/apache/spark/pull/27107#discussion_r363588306 ## File path:

[GitHub] [spark] HeartSaVioR commented on a change in pull request #27107: [SPARK-30436][SQL] Allow CREATE EXTERNAL TABLE with only requiring LOCATION

2020-01-06 Thread GitBox
HeartSaVioR commented on a change in pull request #27107: [SPARK-30436][SQL] Allow CREATE EXTERNAL TABLE with only requiring LOCATION URL: https://github.com/apache/spark/pull/27107#discussion_r363588196 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #27107: [SPARK-30436][SQL] Allow CREATE EXTERNAL TABLE with only requiring LOCATION

2020-01-06 Thread GitBox
cloud-fan commented on a change in pull request #27107: [SPARK-30436][SQL] Allow CREATE EXTERNAL TABLE with only requiring LOCATION URL: https://github.com/apache/spark/pull/27107#discussion_r363588303 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #27085: [SPARK-29779][CORE] Compact old event log files and cleanup

2020-01-06 Thread GitBox
AmplabJenkins removed a comment on issue #27085: [SPARK-29779][CORE] Compact old event log files and cleanup URL: https://github.com/apache/spark/pull/27085#issuecomment-571429480 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27085: [SPARK-29779][CORE] Compact old event log files and cleanup

2020-01-06 Thread GitBox
AmplabJenkins removed a comment on issue #27085: [SPARK-29779][CORE] Compact old event log files and cleanup URL: https://github.com/apache/spark/pull/27085#issuecomment-571429476 Merged build finished. Test PASSed. This is

[GitHub] [spark] HeartSaVioR commented on a change in pull request #27107: [SPARK-30436][SQL] Allow CREATE EXTERNAL TABLE with only requiring LOCATION

2020-01-06 Thread GitBox
HeartSaVioR commented on a change in pull request #27107: [SPARK-30436][SQL] Allow CREATE EXTERNAL TABLE with only requiring LOCATION URL: https://github.com/apache/spark/pull/27107#discussion_r363587788 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #27085: [SPARK-29779][CORE] Compact old event log files and cleanup

2020-01-06 Thread GitBox
AmplabJenkins commented on issue #27085: [SPARK-29779][CORE] Compact old event log files and cleanup URL: https://github.com/apache/spark/pull/27085#issuecomment-571429480 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27085: [SPARK-29779][CORE] Compact old event log files and cleanup

2020-01-06 Thread GitBox
AmplabJenkins commented on issue #27085: [SPARK-29779][CORE] Compact old event log files and cleanup URL: https://github.com/apache/spark/pull/27085#issuecomment-571429476 Merged build finished. Test PASSed. This is an

[GitHub] [spark] SparkQA commented on issue #27085: [SPARK-29779][CORE] Compact old event log files and cleanup

2020-01-06 Thread GitBox
SparkQA commented on issue #27085: [SPARK-29779][CORE] Compact old event log files and cleanup URL: https://github.com/apache/spark/pull/27085#issuecomment-571429093 **[Test build #116211 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116211/testReport)**

[GitHub] [spark] HeartSaVioR commented on a change in pull request #27107: [SPARK-30436][SQL] Allow CREATE EXTERNAL TABLE with only requiring LOCATION

2020-01-06 Thread GitBox
HeartSaVioR commented on a change in pull request #27107: [SPARK-30436][SQL] Allow CREATE EXTERNAL TABLE with only requiring LOCATION URL: https://github.com/apache/spark/pull/27107#discussion_r363587788 ## File path:

[GitHub] [spark] HyukjinKwon commented on issue #26863: [SPARK-30234]ADD FILE cannot add directories from sql CLI

2020-01-06 Thread GitBox
HyukjinKwon commented on issue #26863: [SPARK-30234]ADD FILE cannot add directories from sql CLI URL: https://github.com/apache/spark/pull/26863#issuecomment-571428505 Looks fine otherwise. @iRakson can you resolve conflicts and update?

[GitHub] [spark] HyukjinKwon commented on a change in pull request #26863: [SPARK-30234]ADD FILE cannot add directories from sql CLI

2020-01-06 Thread GitBox
HyukjinKwon commented on a change in pull request #26863: [SPARK-30234]ADD FILE cannot add directories from sql CLI URL: https://github.com/apache/spark/pull/26863#discussion_r363587226 ## File path:

[GitHub] [spark] HyukjinKwon commented on a change in pull request #26863: [SPARK-30234]ADD FILE cannot add directories from sql CLI

2020-01-06 Thread GitBox
HyukjinKwon commented on a change in pull request #26863: [SPARK-30234]ADD FILE cannot add directories from sql CLI URL: https://github.com/apache/spark/pull/26863#discussion_r363587191 ## File path:

[GitHub] [spark] dongjoon-hyun commented on issue #27106: [SPARK-30435][DOC] Update doc of Supported Hive Features

2020-01-06 Thread GitBox
dongjoon-hyun commented on issue #27106: [SPARK-30435][DOC] Update doc of Supported Hive Features URL: https://github.com/apache/spark/pull/27106#issuecomment-571427379 cc @dilipbiswal This is an automated message from the

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27106: [SPARK-30435][DOC] Update doc of Supported Hive Features

2020-01-06 Thread GitBox
dongjoon-hyun commented on a change in pull request #27106: [SPARK-30435][DOC] Update doc of Supported Hive Features URL: https://github.com/apache/spark/pull/27106#discussion_r363586530 ## File path: docs/sql-migration-guide.md ## @@ -862,10 +863,21 @@ Spark SQL

[GitHub] [spark] AmplabJenkins removed a comment on issue #27103: [SPARK-30381][ML] Refactor GBT to reuse treePoints for all trees

2020-01-06 Thread GitBox
AmplabJenkins removed a comment on issue #27103: [SPARK-30381][ML] Refactor GBT to reuse treePoints for all trees URL: https://github.com/apache/spark/pull/27103#issuecomment-571425207 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27103: [SPARK-30381][ML] Refactor GBT to reuse treePoints for all trees

2020-01-06 Thread GitBox
AmplabJenkins removed a comment on issue #27103: [SPARK-30381][ML] Refactor GBT to reuse treePoints for all trees URL: https://github.com/apache/spark/pull/27103#issuecomment-571425202 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #27103: [SPARK-30381][ML] Refactor GBT to reuse treePoints for all trees

2020-01-06 Thread GitBox
SparkQA removed a comment on issue #27103: [SPARK-30381][ML] Refactor GBT to reuse treePoints for all trees URL: https://github.com/apache/spark/pull/27103#issuecomment-571412481 **[Test build #116203 has

[GitHub] [spark] AmplabJenkins commented on issue #27103: [SPARK-30381][ML] Refactor GBT to reuse treePoints for all trees

2020-01-06 Thread GitBox
AmplabJenkins commented on issue #27103: [SPARK-30381][ML] Refactor GBT to reuse treePoints for all trees URL: https://github.com/apache/spark/pull/27103#issuecomment-571425207 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] dongjoon-hyun commented on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty

2020-01-06 Thread GitBox
dongjoon-hyun commented on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty URL: https://github.com/apache/spark/pull/22721#issuecomment-571425132 Thank you, @wangyum and @cloud-fan . Can we have this at Apache Spark 2.4.5?

[GitHub] [spark] AmplabJenkins commented on issue #27103: [SPARK-30381][ML] Refactor GBT to reuse treePoints for all trees

2020-01-06 Thread GitBox
AmplabJenkins commented on issue #27103: [SPARK-30381][ML] Refactor GBT to reuse treePoints for all trees URL: https://github.com/apache/spark/pull/27103#issuecomment-571425202 Merged build finished. Test PASSed. This is an

[GitHub] [spark] SparkQA commented on issue #27103: [SPARK-30381][ML] Refactor GBT to reuse treePoints for all trees

2020-01-06 Thread GitBox
SparkQA commented on issue #27103: [SPARK-30381][ML] Refactor GBT to reuse treePoints for all trees URL: https://github.com/apache/spark/pull/27103#issuecomment-571425014 **[Test build #116203 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27113: [SPARK-30432][Graphx]reduce degree recomputation in StronglyConnectedComponents

2020-01-06 Thread GitBox
AmplabJenkins removed a comment on issue #27113: [SPARK-30432][Graphx]reduce degree recomputation in StronglyConnectedComponents URL: https://github.com/apache/spark/pull/27113#issuecomment-571424322 Can one of the admins verify this patch?

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27107: [SPARK-30436][SQL] Allow CREATE EXTERNAL TABLE with only requiring LOCATION

2020-01-06 Thread GitBox
dongjoon-hyun commented on a change in pull request #27107: [SPARK-30436][SQL] Allow CREATE EXTERNAL TABLE with only requiring LOCATION URL: https://github.com/apache/spark/pull/27107#discussion_r363584533 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #27113: [SPARK-30432][Graphx]reduce degree recomputation in StronglyConnectedComponents

2020-01-06 Thread GitBox
AmplabJenkins commented on issue #27113: [SPARK-30432][Graphx]reduce degree recomputation in StronglyConnectedComponents URL: https://github.com/apache/spark/pull/27113#issuecomment-571424517 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #27113: [SPARK-30432][Graphx]reduce degree recomputation in StronglyConnectedComponents

2020-01-06 Thread GitBox
AmplabJenkins commented on issue #27113: [SPARK-30432][Graphx]reduce degree recomputation in StronglyConnectedComponents URL: https://github.com/apache/spark/pull/27113#issuecomment-571424322 Can one of the admins verify this patch?

[GitHub] [spark] xs-li opened a new pull request #27113: [SPARK-30432][Graphx]reduce degree recomputation in StronglyConnectedComponents

2020-01-06 Thread GitBox
xs-li opened a new pull request #27113: [SPARK-30432][Graphx]reduce degree recomputation in StronglyConnectedComponents URL: https://github.com/apache/spark/pull/27113 So the computation happens every time in the do-while loop, the first time the outer while loop executes. although just

[GitHub] [spark] cloud-fan commented on issue #27105: [SPARK-30433][SQL] Make conflict attributes resolution more scalable in ResolveReferences

2020-01-06 Thread GitBox
cloud-fan commented on issue #27105: [SPARK-30433][SQL] Make conflict attributes resolution more scalable in ResolveReferences URL: https://github.com/apache/spark/pull/27105#issuecomment-571423971 thanks, merging to master!

[GitHub] [spark] cloud-fan closed pull request #27105: [SPARK-30433][SQL] Make conflict attributes resolution more scalable in ResolveReferences

2020-01-06 Thread GitBox
cloud-fan closed pull request #27105: [SPARK-30433][SQL] Make conflict attributes resolution more scalable in ResolveReferences URL: https://github.com/apache/spark/pull/27105 This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on issue #27042: [SPARK-30382][SQL] Remove Hive LogUtils usage to prevent ClassNotFoundException

2020-01-06 Thread GitBox
SparkQA commented on issue #27042: [SPARK-30382][SQL] Remove Hive LogUtils usage to prevent ClassNotFoundException URL: https://github.com/apache/spark/pull/27042#issuecomment-571423601 **[Test build #116207 has

[GitHub] [spark] AmplabJenkins commented on issue #27042: [SPARK-30382][SQL] Remove Hive LogUtils usage to prevent ClassNotFoundException

2020-01-06 Thread GitBox
AmplabJenkins commented on issue #27042: [SPARK-30382][SQL] Remove Hive LogUtils usage to prevent ClassNotFoundException URL: https://github.com/apache/spark/pull/27042#issuecomment-571423669 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27042: [SPARK-30382][SQL] Remove Hive LogUtils usage to prevent ClassNotFoundException

2020-01-06 Thread GitBox
AmplabJenkins removed a comment on issue #27042: [SPARK-30382][SQL] Remove Hive LogUtils usage to prevent ClassNotFoundException URL: https://github.com/apache/spark/pull/27042#issuecomment-571423675 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27042: [SPARK-30382][SQL] Remove Hive LogUtils usage to prevent ClassNotFoundException

2020-01-06 Thread GitBox
AmplabJenkins removed a comment on issue #27042: [SPARK-30382][SQL] Remove Hive LogUtils usage to prevent ClassNotFoundException URL: https://github.com/apache/spark/pull/27042#issuecomment-571423669 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27042: [SPARK-30382][SQL] Remove Hive LogUtils usage to prevent ClassNotFoundException

2020-01-06 Thread GitBox
AmplabJenkins commented on issue #27042: [SPARK-30382][SQL] Remove Hive LogUtils usage to prevent ClassNotFoundException URL: https://github.com/apache/spark/pull/27042#issuecomment-571423675 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #27042: [SPARK-30382][SQL] Remove Hive LogUtils usage to prevent ClassNotFoundException

2020-01-06 Thread GitBox
SparkQA removed a comment on issue #27042: [SPARK-30382][SQL] Remove Hive LogUtils usage to prevent ClassNotFoundException URL: https://github.com/apache/spark/pull/27042#issuecomment-571417402 **[Test build #116207 has

[GitHub] [spark] cloud-fan commented on a change in pull request #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE NAMESPACE syntax

2020-01-06 Thread GitBox
cloud-fan commented on a change in pull request #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE NAMESPACE syntax URL: https://github.com/apache/spark/pull/26806#discussion_r363583751 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27107: [SPARK-30436][SQL] Allow CREATE EXTERNAL TABLE with only requiring LOCATION

2020-01-06 Thread GitBox
dongjoon-hyun commented on a change in pull request #27107: [SPARK-30436][SQL] Allow CREATE EXTERNAL TABLE with only requiring LOCATION URL: https://github.com/apache/spark/pull/27107#discussion_r363583307 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #27102: [SPARK-30431][SQL] Update SqlBase.g4 to create commentSpec pattern like locationSpec

2020-01-06 Thread GitBox
cloud-fan commented on a change in pull request #27102: [SPARK-30431][SQL] Update SqlBase.g4 to create commentSpec pattern like locationSpec URL: https://github.com/apache/spark/pull/27102#discussion_r363583148 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27107: [SPARK-30436][SQL] Allow CREATE EXTERNAL TABLE with only requiring LOCATION

2020-01-06 Thread GitBox
dongjoon-hyun commented on a change in pull request #27107: [SPARK-30436][SQL] Allow CREATE EXTERNAL TABLE with only requiring LOCATION URL: https://github.com/apache/spark/pull/27107#discussion_r363582971 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27107: [SPARK-30436][SQL] Allow CREATE EXTERNAL TABLE with only requiring LOCATION

2020-01-06 Thread GitBox
dongjoon-hyun commented on a change in pull request #27107: [SPARK-30436][SQL] Allow CREATE EXTERNAL TABLE with only requiring LOCATION URL: https://github.com/apache/spark/pull/27107#discussion_r363582971 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27107: [SPARK-30436][SQL] Allow CREATE EXTERNAL TABLE with only requiring LOCATION

2020-01-06 Thread GitBox
dongjoon-hyun commented on a change in pull request #27107: [SPARK-30436][SQL] Allow CREATE EXTERNAL TABLE with only requiring LOCATION URL: https://github.com/apache/spark/pull/27107#discussion_r363582775 ## File path:

[GitHub] [spark] cloud-fan commented on issue #27095: [SPARK-30214][SQL] V2 commands resolves namespaces with new resolution framework

2020-01-06 Thread GitBox
cloud-fan commented on issue #27095: [SPARK-30214][SQL] V2 commands resolves namespaces with new resolution framework URL: https://github.com/apache/spark/pull/27095#issuecomment-571422412 LGTM except one comment This is an

[GitHub] [spark] cloud-fan commented on a change in pull request #27095: [SPARK-30214][SQL] V2 commands resolves namespaces with new resolution framework

2020-01-06 Thread GitBox
cloud-fan commented on a change in pull request #27095: [SPARK-30214][SQL] V2 commands resolves namespaces with new resolution framework URL: https://github.com/apache/spark/pull/27095#discussion_r363582446 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #27095: [SPARK-30214][SQL] V2 commands resolves namespaces with new resolution framework

2020-01-06 Thread GitBox
cloud-fan commented on a change in pull request #27095: [SPARK-30214][SQL] V2 commands resolves namespaces with new resolution framework URL: https://github.com/apache/spark/pull/27095#discussion_r363582446 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #27102: [SPARK-30431][SQL] Update SqlBase.g4 to create commentSpec pattern like locationSpec

2020-01-06 Thread GitBox
AmplabJenkins commented on issue #27102: [SPARK-30431][SQL] Update SqlBase.g4 to create commentSpec pattern like locationSpec URL: https://github.com/apache/spark/pull/27102#issuecomment-571422101 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27102: [SPARK-30431][SQL] Update SqlBase.g4 to create commentSpec pattern like locationSpec

2020-01-06 Thread GitBox
AmplabJenkins commented on issue #27102: [SPARK-30431][SQL] Update SqlBase.g4 to create commentSpec pattern like locationSpec URL: https://github.com/apache/spark/pull/27102#issuecomment-571422106 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27102: [SPARK-30431][SQL] Update SqlBase.g4 to create commentSpec pattern like locationSpec

2020-01-06 Thread GitBox
AmplabJenkins removed a comment on issue #27102: [SPARK-30431][SQL] Update SqlBase.g4 to create commentSpec pattern like locationSpec URL: https://github.com/apache/spark/pull/27102#issuecomment-571422101 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27102: [SPARK-30431][SQL] Update SqlBase.g4 to create commentSpec pattern like locationSpec

2020-01-06 Thread GitBox
AmplabJenkins removed a comment on issue #27102: [SPARK-30431][SQL] Update SqlBase.g4 to create commentSpec pattern like locationSpec URL: https://github.com/apache/spark/pull/27102#issuecomment-571422106 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] SparkQA commented on issue #27102: [SPARK-30431][SQL] Update SqlBase.g4 to create commentSpec pattern like locationSpec

2020-01-06 Thread GitBox
SparkQA commented on issue #27102: [SPARK-30431][SQL] Update SqlBase.g4 to create commentSpec pattern like locationSpec URL: https://github.com/apache/spark/pull/27102#issuecomment-571421892 **[Test build #116210 has

[GitHub] [spark] yaooqinn commented on a change in pull request #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE NAMESPACE syntax

2020-01-06 Thread GitBox
yaooqinn commented on a change in pull request #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE NAMESPACE syntax URL: https://github.com/apache/spark/pull/26806#discussion_r363582051 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #27095: [SPARK-30214][SQL] V2 commands resolves namespaces with new resolution framework

2020-01-06 Thread GitBox
cloud-fan commented on a change in pull request #27095: [SPARK-30214][SQL] V2 commands resolves namespaces with new resolution framework URL: https://github.com/apache/spark/pull/27095#discussion_r363581573 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #27095: [SPARK-30214][SQL] V2 commands resolves namespaces with new resolution framework

2020-01-06 Thread GitBox
cloud-fan commented on a change in pull request #27095: [SPARK-30214][SQL] V2 commands resolves namespaces with new resolution framework URL: https://github.com/apache/spark/pull/27095#discussion_r363581630 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #27109: [SPARK-30434][PYTHON][SQL] Move pandas related functionalities into 'pandas' sub-package

2020-01-06 Thread GitBox
AmplabJenkins removed a comment on issue #27109: [SPARK-30434][PYTHON][SQL] Move pandas related functionalities into 'pandas' sub-package URL: https://github.com/apache/spark/pull/27109#issuecomment-571420801 Merged build finished. Test PASSed.

[GitHub] [spark] cloud-fan commented on a change in pull request #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE NAMESPACE syntax

2020-01-06 Thread GitBox
cloud-fan commented on a change in pull request #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE NAMESPACE syntax URL: https://github.com/apache/spark/pull/26806#discussion_r363581297 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #27109: [SPARK-30434][PYTHON][SQL] Move pandas related functionalities into 'pandas' sub-package

2020-01-06 Thread GitBox
AmplabJenkins removed a comment on issue #27109: [SPARK-30434][PYTHON][SQL] Move pandas related functionalities into 'pandas' sub-package URL: https://github.com/apache/spark/pull/27109#issuecomment-571420809 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #26875: [SPARK-30245][SQL] Add cache for Like and RLike when pattern is not static

2020-01-06 Thread GitBox
AmplabJenkins removed a comment on issue #26875: [SPARK-30245][SQL] Add cache for Like and RLike when pattern is not static URL: https://github.com/apache/spark/pull/26875#issuecomment-571420797 Test PASSed. Refer to this link for build results (access rights to CI server needed):

<    1   2   3   4   5   6   7   8   9   10   >