[GitHub] [spark] SparkQA commented on issue #27326: [SPARK-30609] Allow default merge command resolution to be bypassed by DSv2 tables

2020-01-22 Thread GitBox
SparkQA commented on issue #27326: [SPARK-30609] Allow default merge command resolution to be bypassed by DSv2 tables URL: https://github.com/apache/spark/pull/27326#issuecomment-577468037 **[Test build #117257 has

[GitHub] [spark] AmplabJenkins commented on issue #27326: [SPARK-30609] Allow default merge command resolution to be bypassed by DSv2 tables

2020-01-22 Thread GitBox
AmplabJenkins commented on issue #27326: [SPARK-30609] Allow default merge command resolution to be bypassed by DSv2 tables URL: https://github.com/apache/spark/pull/27326#issuecomment-577468373 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27326: [SPARK-30609] Allow default merge command resolution to be bypassed by DSv2 tables

2020-01-22 Thread GitBox
AmplabJenkins removed a comment on issue #27326: [SPARK-30609] Allow default merge command resolution to be bypassed by DSv2 tables URL: https://github.com/apache/spark/pull/27326#issuecomment-577468366 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27326: [SPARK-30609] Allow default merge command resolution to be bypassed by DSv2 tables

2020-01-22 Thread GitBox
AmplabJenkins commented on issue #27326: [SPARK-30609] Allow default merge command resolution to be bypassed by DSv2 tables URL: https://github.com/apache/spark/pull/27326#issuecomment-577468366 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #27326: [SPARK-30609] Allow default merge command resolution to be bypassed by DSv2 tables

2020-01-22 Thread GitBox
SparkQA removed a comment on issue #27326: [SPARK-30609] Allow default merge command resolution to be bypassed by DSv2 tables URL: https://github.com/apache/spark/pull/27326#issuecomment-577399332 **[Test build #117257 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27330: [MINOR][ML] Deprecate numTrees in GBT

2020-01-22 Thread GitBox
AmplabJenkins removed a comment on issue #27330: [MINOR][ML] Deprecate numTrees in GBT URL: https://github.com/apache/spark/pull/27330#issuecomment-577472933 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27330: [MINOR][ML] Deprecate numTrees in GBT

2020-01-22 Thread GitBox
AmplabJenkins removed a comment on issue #27330: [MINOR][ML] Deprecate numTrees in GBT URL: https://github.com/apache/spark/pull/27330#issuecomment-577472926 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] dongjoon-hyun commented on issue #27327: Revert "[SPARK-30535][SQL] Migrate ALTER TABLE commands to the new framework

2020-01-22 Thread GitBox
dongjoon-hyun commented on issue #27327: Revert "[SPARK-30535][SQL] Migrate ALTER TABLE commands to the new framework URL: https://github.com/apache/spark/pull/27327#issuecomment-577473248 cc @imback82 and @cloud-fan This

[GitHub] [spark] huaxingao commented on a change in pull request #27297: [SPARK-30588][DOC] Document CLUSTER BY Clause of SELECT statement in SQL Reference.

2020-01-22 Thread GitBox
huaxingao commented on a change in pull request #27297: [SPARK-30588][DOC] Document CLUSTER BY Clause of SELECT statement in SQL Reference. URL: https://github.com/apache/spark/pull/27297#discussion_r369906872 ## File path: docs/sql-ref-syntax-qry-select-clusterby.md ##

[GitHub] [spark] JoshRosen edited a comment on issue #27246: [SPARK-30536][CORE][SQL] Sort-merge join operator spilling performance improvements

2020-01-22 Thread GitBox
JoshRosen edited a comment on issue #27246: [SPARK-30536][CORE][SQL] Sort-merge join operator spilling performance improvements URL: https://github.com/apache/spark/pull/27246#issuecomment-577483354 Regarding the "Implement lazy initialization of UnsafeSorterSpillReader" portion of the

[GitHub] [spark] AmplabJenkins removed a comment on issue #27331: [WIP][SPARK-29157][SQL][PYSPARK] Add DataFrameWriterV2 to Python API

2020-01-22 Thread GitBox
AmplabJenkins removed a comment on issue #27331: [WIP][SPARK-29157][SQL][PYSPARK] Add DataFrameWriterV2 to Python API URL: https://github.com/apache/spark/pull/27331#issuecomment-577484119 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27331: [WIP][SPARK-29157][SQL][PYSPARK] Add DataFrameWriterV2 to Python API

2020-01-22 Thread GitBox
AmplabJenkins removed a comment on issue #27331: [WIP][SPARK-29157][SQL][PYSPARK] Add DataFrameWriterV2 to Python API URL: https://github.com/apache/spark/pull/27331#issuecomment-577484124 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27331: [WIP][SPARK-29157][SQL][PYSPARK] Add DataFrameWriterV2 to Python API

2020-01-22 Thread GitBox
AmplabJenkins commented on issue #27331: [WIP][SPARK-29157][SQL][PYSPARK] Add DataFrameWriterV2 to Python API URL: https://github.com/apache/spark/pull/27331#issuecomment-577484119 Merged build finished. Test PASSed. This is

[GitHub] [spark] dongjoon-hyun edited a comment on issue #27233: [SPARK-29701][SQL] Correct behaviours of group analytical queries when empty input given

2020-01-22 Thread GitBox
dongjoon-hyun edited a comment on issue #27233: [SPARK-29701][SQL] Correct behaviours of group analytical queries when empty input given URL: https://github.com/apache/spark/pull/27233#issuecomment-577487224 @tgravescs . Yes, it does. However, this is correctly a SQL correctness issue.

[GitHub] [spark] AmplabJenkins commented on issue #27332: [SPARK-30575][FOLLOWUP] Fix super nit problems

2020-01-22 Thread GitBox
AmplabJenkins commented on issue #27332: [SPARK-30575][FOLLOWUP] Fix super nit problems URL: https://github.com/apache/spark/pull/27332#issuecomment-577488732 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27332: [SPARK-30575][FOLLOWUP] Fix super nit problems

2020-01-22 Thread GitBox
AmplabJenkins removed a comment on issue #27332: [SPARK-30575][FOLLOWUP] Fix super nit problems URL: https://github.com/apache/spark/pull/27332#issuecomment-577488732 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] dongjoon-hyun edited a comment on issue #27233: [SPARK-29701][SQL] Correct behaviours of group analytical queries when empty input given

2020-01-22 Thread GitBox
dongjoon-hyun edited a comment on issue #27233: [SPARK-29701][SQL] Correct behaviours of group analytical queries when empty input given URL: https://github.com/apache/spark/pull/27233#issuecomment-577487224 @tgravescs . Yes, it does. However, this is correctly a SQL correctness issue.

[GitHub] [spark] AmplabJenkins commented on issue #27332: [SPARK-30575][FOLLOWUP] Fix super nit problems

2020-01-22 Thread GitBox
AmplabJenkins commented on issue #27332: [SPARK-30575][FOLLOWUP] Fix super nit problems URL: https://github.com/apache/spark/pull/27332#issuecomment-577488723 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] SparkQA removed a comment on issue #27332: [SPARK-30575][FOLLOWUP] Fix super nit problems

2020-01-22 Thread GitBox
SparkQA removed a comment on issue #27332: [SPARK-30575][FOLLOWUP] Fix super nit problems URL: https://github.com/apache/spark/pull/27332#issuecomment-577486829 **[Test build #117272 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/117272/testReport)** for

[GitHub] [spark] AmplabJenkins removed a comment on issue #27332: [SPARK-30575][FOLLOWUP] Fix super nit problems

2020-01-22 Thread GitBox
AmplabJenkins removed a comment on issue #27332: [SPARK-30575][FOLLOWUP] Fix super nit problems URL: https://github.com/apache/spark/pull/27332#issuecomment-577488723 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] SparkQA commented on issue #27332: [SPARK-30575][FOLLOWUP] Fix super nit problems

2020-01-22 Thread GitBox
SparkQA commented on issue #27332: [SPARK-30575][FOLLOWUP] Fix super nit problems URL: https://github.com/apache/spark/pull/27332#issuecomment-577488661 **[Test build #117272 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/117272/testReport)** for PR

[GitHub] [spark] dongjoon-hyun commented on issue #27267: [SPARK-30556][SQL] Copy sparkContext.localproperties to child thread inSubqueryExec.executionContext

2020-01-22 Thread GitBox
dongjoon-hyun commented on issue #27267: [SPARK-30556][SQL] Copy sparkContext.localproperties to child thread inSubqueryExec.executionContext URL: https://github.com/apache/spark/pull/27267#issuecomment-577475531 Could you make a backporting PR against branch-2.4, @ajithme ?

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27325: [SPARK-30607][SQL][PYSPARK][SPARKR] Add overlay wrappers for SparkR and PySpark

2020-01-22 Thread GitBox
HyukjinKwon commented on a change in pull request #27325: [SPARK-30607][SQL][PYSPARK][SPARKR] Add overlay wrappers for SparkR and PySpark URL: https://github.com/apache/spark/pull/27325#discussion_r369897304 ## File path: R/pkg/R/functions.R ## @@ -1319,6 +1327,33 @@

[GitHub] [spark] srowen commented on issue #27238: [SPARK-30531][Web UI] Do not render plan viz when it exists already

2020-01-22 Thread GitBox
srowen commented on issue #27238: [SPARK-30531][Web UI] Do not render plan viz when it exists already URL: https://github.com/apache/spark/pull/27238#issuecomment-577468862 Merged to master This is an automated message from

[GitHub] [spark] srowen closed pull request #27238: [SPARK-30531][Web UI] Do not render plan viz when it exists already

2020-01-22 Thread GitBox
srowen closed pull request #27238: [SPARK-30531][Web UI] Do not render plan viz when it exists already URL: https://github.com/apache/spark/pull/27238 This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] AmplabJenkins removed a comment on issue #27326: [SPARK-30609] Allow default merge command resolution to be bypassed by DSv2 tables

2020-01-22 Thread GitBox
AmplabJenkins removed a comment on issue #27326: [SPARK-30609] Allow default merge command resolution to be bypassed by DSv2 tables URL: https://github.com/apache/spark/pull/27326#issuecomment-577468373 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #27311: [SPARK-27996][K8S] Send HTTP redirect using the correct protocol when Spark History server is deployed behind the reverse proxy

2020-01-22 Thread GitBox
AmplabJenkins removed a comment on issue #27311: [SPARK-27996][K8S] Send HTTP redirect using the correct protocol when Spark History server is deployed behind the reverse proxy URL: https://github.com/apache/spark/pull/27311#issuecomment-576822712 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #27311: [SPARK-27996][WEBUI] Send HTTP redirect using the correct protocol when Spark History server is deployed behind the reverse proxy

2020-01-22 Thread GitBox
AmplabJenkins commented on issue #27311: [SPARK-27996][WEBUI] Send HTTP redirect using the correct protocol when Spark History server is deployed behind the reverse proxy URL: https://github.com/apache/spark/pull/27311#issuecomment-577474536 Test PASSed. Refer to this link for build

[GitHub] [spark] AmplabJenkins commented on issue #27311: [SPARK-27996][WEBUI] Send HTTP redirect using the correct protocol when Spark History server is deployed behind the reverse proxy

2020-01-22 Thread GitBox
AmplabJenkins commented on issue #27311: [SPARK-27996][WEBUI] Send HTTP redirect using the correct protocol when Spark History server is deployed behind the reverse proxy URL: https://github.com/apache/spark/pull/27311#issuecomment-577474528 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #27311: [SPARK-27996][K8S] Send HTTP redirect using the correct protocol when Spark History server is deployed behind the reverse proxy

2020-01-22 Thread GitBox
SparkQA commented on issue #27311: [SPARK-27996][K8S] Send HTTP redirect using the correct protocol when Spark History server is deployed behind the reverse proxy URL: https://github.com/apache/spark/pull/27311#issuecomment-577474274 **[Test build #117269 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27311: [SPARK-27996][WEBUI] Send HTTP redirect using the correct protocol when Spark History server is deployed behind the reverse proxy

2020-01-22 Thread GitBox
AmplabJenkins removed a comment on issue #27311: [SPARK-27996][WEBUI] Send HTTP redirect using the correct protocol when Spark History server is deployed behind the reverse proxy URL: https://github.com/apache/spark/pull/27311#issuecomment-577474528 Merged build finished. Test PASSed.

[GitHub] [spark] dongjoon-hyun commented on issue #27311: [SPARK-27996][K8S] Send HTTP redirect using the correct protocol when Spark History server is deployed behind the reverse proxy #27083

2020-01-22 Thread GitBox
dongjoon-hyun commented on issue #27311: [SPARK-27996][K8S] Send HTTP redirect using the correct protocol when Spark History server is deployed behind the reverse proxy #27083 URL: https://github.com/apache/spark/pull/27311#issuecomment-577474086 Thank you for making a PR against `master`

[GitHub] [spark] huaxingao commented on a change in pull request #27298: [SPARK-30589][DOC] Document DISTRIBUTE BY Clause of SELECT statement in SQL Reference

2020-01-22 Thread GitBox
huaxingao commented on a change in pull request #27298: [SPARK-30589][DOC] Document DISTRIBUTE BY Clause of SELECT statement in SQL Reference URL: https://github.com/apache/spark/pull/27298#discussion_r369908525 ## File path: docs/sql-ref-syntax-qry-select-distribute-by.md

[GitHub] [spark] ajithme commented on issue #27267: [SPARK-30556][SQL] Copy sparkContext.localproperties to child thread inSubqueryExec.executionContext

2020-01-22 Thread GitBox
ajithme commented on issue #27267: [SPARK-30556][SQL] Copy sparkContext.localproperties to child thread inSubqueryExec.executionContext URL: https://github.com/apache/spark/pull/27267#issuecomment-577477802 Thanks @dongjoon-hyun @cloud-fan @hvanhovell @dongjoon-hyun sure, i will

[GitHub] [spark] cloud-fan commented on issue #25107: [SPARK-28344][SQL] detect ambiguous self-join and fail the query

2020-01-22 Thread GitBox
cloud-fan commented on issue #25107: [SPARK-28344][SQL] detect ambiguous self-join and fail the query URL: https://github.com/apache/spark/pull/25107#issuecomment-577482122 This is not a complete fix but fail the query if we are not able to resolve the ambiguity. Is it OK to backport? It

[GitHub] [spark] AmplabJenkins commented on issue #27332: [SPARK-30575][FOLLOWUP] Fix super nit problems

2020-01-22 Thread GitBox
AmplabJenkins commented on issue #27332: [SPARK-30575][FOLLOWUP] Fix super nit problems URL: https://github.com/apache/spark/pull/27332#issuecomment-577485577 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27332: [SPARK-30575][FOLLOWUP] Fix super nit problems

2020-01-22 Thread GitBox
AmplabJenkins commented on issue #27332: [SPARK-30575][FOLLOWUP] Fix super nit problems URL: https://github.com/apache/spark/pull/27332#issuecomment-577485572 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] SparkQA removed a comment on issue #27330: [MINOR][ML] Deprecate numTrees in GBT

2020-01-22 Thread GitBox
SparkQA removed a comment on issue #27330: [MINOR][ML] Deprecate numTrees in GBT URL: https://github.com/apache/spark/pull/27330#issuecomment-577472602 **[Test build #117268 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/117268/testReport)** for PR 27330

[GitHub] [spark] SparkQA commented on issue #27330: [MINOR][ML] Deprecate numTrees in GBT

2020-01-22 Thread GitBox
SparkQA commented on issue #27330: [MINOR][ML] Deprecate numTrees in GBT URL: https://github.com/apache/spark/pull/27330#issuecomment-577486094 **[Test build #117268 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/117268/testReport)** for PR 27330 at

[GitHub] [spark] huaxingao commented on issue #27332: [SPARK-30575][FOLLOWUP] Fix super nit problems

2020-01-22 Thread GitBox
huaxingao commented on issue #27332: [SPARK-30575][FOLLOWUP] Fix super nit problems URL: https://github.com/apache/spark/pull/27332#issuecomment-577485948 @dilipbiswal Sorry I missed a few in the first review. Thanks a lot for bearing with my nitpicking.

[GitHub] [spark] dongjoon-hyun edited a comment on issue #27233: [SPARK-29701][SQL] Correct behaviours of group analytical queries when empty input given

2020-01-22 Thread GitBox
dongjoon-hyun edited a comment on issue #27233: [SPARK-29701][SQL] Correct behaviours of group analytical queries when empty input given URL: https://github.com/apache/spark/pull/27233#issuecomment-577487224 @tgravescs . Yes, it does. However, this is correctly a SQL correctness issue.

[GitHub] [spark] dongjoon-hyun commented on issue #27233: [SPARK-29701][SQL] Correct behaviours of group analytical queries when empty input given

2020-01-22 Thread GitBox
dongjoon-hyun commented on issue #27233: [SPARK-29701][SQL] Correct behaviours of group analytical queries when empty input given URL: https://github.com/apache/spark/pull/27233#issuecomment-577487224 @tgravescs . This is correctly a SQL correctness issue. Technically, `PostgreSQL`

[GitHub] [spark] asfgit closed pull request #27326: [SPARK-30609] Allow default merge command resolution to be bypassed by DSv2 tables

2020-01-22 Thread GitBox
asfgit closed pull request #27326: [SPARK-30609] Allow default merge command resolution to be bypassed by DSv2 tables URL: https://github.com/apache/spark/pull/27326 This is an automated message from the Apache Git Service.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27332: [SPARK-30575][FOLLOWUP] Fix super nit problems

2020-01-22 Thread GitBox
AmplabJenkins removed a comment on issue #27332: [SPARK-30575][FOLLOWUP] Fix super nit problems URL: https://github.com/apache/spark/pull/27332#issuecomment-577485577 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27332: [SPARK-30575][FOLLOWUP] Fix super nit problems

2020-01-22 Thread GitBox
AmplabJenkins removed a comment on issue #27332: [SPARK-30575][FOLLOWUP] Fix super nit problems URL: https://github.com/apache/spark/pull/27332#issuecomment-577485572 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #27326: [SPARK-30609] Allow default merge command resolution to be bypassed by DSv2 tables

2020-01-22 Thread GitBox
AmplabJenkins removed a comment on issue #27326: [SPARK-30609] Allow default merge command resolution to be bypassed by DSv2 tables URL: https://github.com/apache/spark/pull/27326#issuecomment-577491641 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #27311: [SPARK-27996][WEBUI] Send HTTP redirect using the correct protocol when Spark History server is deployed behind the reverse proxy

2020-01-22 Thread GitBox
AmplabJenkins removed a comment on issue #27311: [SPARK-27996][WEBUI] Send HTTP redirect using the correct protocol when Spark History server is deployed behind the reverse proxy URL: https://github.com/apache/spark/pull/27311#issuecomment-577474536 Test PASSed. Refer to this link for

[GitHub] [spark] dongjoon-hyun closed pull request #27267: [SPARK-30556][SQL] Copy sparkContext.localproperties to child thread inSubqueryExec.executionContext

2020-01-22 Thread GitBox
dongjoon-hyun closed pull request #27267: [SPARK-30556][SQL] Copy sparkContext.localproperties to child thread inSubqueryExec.executionContext URL: https://github.com/apache/spark/pull/27267 This is an automated message

[GitHub] [spark] tgravescs commented on issue #27233: [SPARK-29701][SQL] Correct behaviours of group analytical queries when empty input given

2020-01-22 Thread GitBox
tgravescs commented on issue #27233: [SPARK-29701][SQL] Correct behaviours of group analytical queries when empty input given URL: https://github.com/apache/spark/pull/27233#issuecomment-577475140 thanks for the confirmation, I would say we remove correctness tag from jira. I was

[GitHub] [spark] AmplabJenkins commented on issue #27331: [WIP][SPARK-29157][SQL][PYSPARK] Add DataFrameWriterV2 to Python API

2020-01-22 Thread GitBox
AmplabJenkins commented on issue #27331: [WIP][SPARK-29157][SQL][PYSPARK] Add DataFrameWriterV2 to Python API URL: https://github.com/apache/spark/pull/27331#issuecomment-577484124 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] JoshRosen edited a comment on issue #27246: [SPARK-30536][CORE][SQL] Sort-merge join operator spilling performance improvements

2020-01-22 Thread GitBox
JoshRosen edited a comment on issue #27246: [SPARK-30536][CORE][SQL] Sort-merge join operator spilling performance improvements URL: https://github.com/apache/spark/pull/27246#issuecomment-577483354 Regarding the "Implement lazy initialization of UnsafeSorterSpillReader" portion of the

[GitHub] [spark] SparkQA commented on issue #27331: [WIP][SPARK-29157][SQL][PYSPARK] Add DataFrameWriterV2 to Python API

2020-01-22 Thread GitBox
SparkQA commented on issue #27331: [WIP][SPARK-29157][SQL][PYSPARK] Add DataFrameWriterV2 to Python API URL: https://github.com/apache/spark/pull/27331#issuecomment-577483838 **[Test build #117270 has

[GitHub] [spark] SparkQA commented on issue #27325: [SPARK-30607][SQL][PYSPARK][SPARKR] Add overlay wrappers for SparkR and PySpark

2020-01-22 Thread GitBox
SparkQA commented on issue #27325: [SPARK-30607][SQL][PYSPARK][SPARKR] Add overlay wrappers for SparkR and PySpark URL: https://github.com/apache/spark/pull/27325#issuecomment-577483869 **[Test build #117271 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27331: [WIP][SPARK-29157][SQL][PYSPARK] Add DataFrameWriterV2 to Python API

2020-01-22 Thread GitBox
AmplabJenkins removed a comment on issue #27331: [WIP][SPARK-29157][SQL][PYSPARK] Add DataFrameWriterV2 to Python API URL: https://github.com/apache/spark/pull/27331#issuecomment-577489280 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27331: [WIP][SPARK-29157][SQL][PYSPARK] Add DataFrameWriterV2 to Python API

2020-01-22 Thread GitBox
AmplabJenkins removed a comment on issue #27331: [WIP][SPARK-29157][SQL][PYSPARK] Add DataFrameWriterV2 to Python API URL: https://github.com/apache/spark/pull/27331#issuecomment-577489274 Merged build finished. Test PASSed.

[GitHub] [spark] JoshRosen commented on a change in pull request #27246: [SPARK-30536][CORE][SQL] Sort-merge join operator spilling performance improvements

2020-01-22 Thread GitBox
JoshRosen commented on a change in pull request #27246: [SPARK-30536][CORE][SQL] Sort-merge join operator spilling performance improvements URL: https://github.com/apache/spark/pull/27246#discussion_r369918361 ## File path:

[GitHub] [spark] dongjoon-hyun edited a comment on issue #27233: [SPARK-29701][SQL] Correct behaviours of group analytical queries when empty input given

2020-01-22 Thread GitBox
dongjoon-hyun edited a comment on issue #27233: [SPARK-29701][SQL] Correct behaviours of group analytical queries when empty input given URL: https://github.com/apache/spark/pull/27233#issuecomment-577487224 @tgravescs . Yes, it does. However, this is correctly a SQL **correctness**

[GitHub] [spark] SparkQA commented on issue #27331: [WIP][SPARK-29157][SQL][PYSPARK] Add DataFrameWriterV2 to Python API

2020-01-22 Thread GitBox
SparkQA commented on issue #27331: [WIP][SPARK-29157][SQL][PYSPARK] Add DataFrameWriterV2 to Python API URL: https://github.com/apache/spark/pull/27331#issuecomment-577489059 **[Test build #117270 has

[GitHub] [spark] SparkQA removed a comment on issue #27331: [WIP][SPARK-29157][SQL][PYSPARK] Add DataFrameWriterV2 to Python API

2020-01-22 Thread GitBox
SparkQA removed a comment on issue #27331: [WIP][SPARK-29157][SQL][PYSPARK] Add DataFrameWriterV2 to Python API URL: https://github.com/apache/spark/pull/27331#issuecomment-577483838 **[Test build #117270 has

[GitHub] [spark] AmplabJenkins commented on issue #27331: [WIP][SPARK-29157][SQL][PYSPARK] Add DataFrameWriterV2 to Python API

2020-01-22 Thread GitBox
AmplabJenkins commented on issue #27331: [WIP][SPARK-29157][SQL][PYSPARK] Add DataFrameWriterV2 to Python API URL: https://github.com/apache/spark/pull/27331#issuecomment-577489274 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #27331: [WIP][SPARK-29157][SQL][PYSPARK] Add DataFrameWriterV2 to Python API

2020-01-22 Thread GitBox
AmplabJenkins commented on issue #27331: [WIP][SPARK-29157][SQL][PYSPARK] Add DataFrameWriterV2 to Python API URL: https://github.com/apache/spark/pull/27331#issuecomment-577489280 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] dongjoon-hyun edited a comment on issue #27233: [SPARK-29701][SQL] Correct behaviours of group analytical queries when empty input given

2020-01-22 Thread GitBox
dongjoon-hyun edited a comment on issue #27233: [SPARK-29701][SQL] Correct behaviours of group analytical queries when empty input given URL: https://github.com/apache/spark/pull/27233#issuecomment-577487224 @tgravescs . Yes, it does. However, this is correctly a **SQL correctness**

[GitHub] [spark] dongjoon-hyun edited a comment on issue #27233: [SPARK-29701][SQL] Correct behaviours of group analytical queries when empty input given

2020-01-22 Thread GitBox
dongjoon-hyun edited a comment on issue #27233: [SPARK-29701][SQL] Correct behaviours of group analytical queries when empty input given URL: https://github.com/apache/spark/pull/27233#issuecomment-577487224 @tgravescs . Yes, it does. However, this is correctly a **SQL correctness**

[GitHub] [spark] dongjoon-hyun edited a comment on issue #27233: [SPARK-29701][SQL] Correct behaviours of group analytical queries when empty input given

2020-01-22 Thread GitBox
dongjoon-hyun edited a comment on issue #27233: [SPARK-29701][SQL] Correct behaviours of group analytical queries when empty input given URL: https://github.com/apache/spark/pull/27233#issuecomment-577487224 @tgravescs . Yes, it does. However, this is correctly a SQL correctness issue.

[GitHub] [spark] SparkQA commented on issue #27319: [SPARK-30605][SQL] move defaultNamespace from SupportsNamespace to CatalogPlugin

2020-01-22 Thread GitBox
SparkQA commented on issue #27319: [SPARK-30605][SQL] move defaultNamespace from SupportsNamespace to CatalogPlugin URL: https://github.com/apache/spark/pull/27319#issuecomment-577498915 **[Test build #117275 has

[GitHub] [spark] dongjoon-hyun commented on issue #27106: [SPARK-30435][DOC] Update doc of Supported Hive Features

2020-01-22 Thread GitBox
dongjoon-hyun commented on issue #27106: [SPARK-30435][DOC] Update doc of Supported Hive Features URL: https://github.com/apache/spark/pull/27106#issuecomment-577498531 As a last piece of the update, could you update the outdated screenshot in the PR description?

[GitHub] [spark] SparkQA commented on issue #27327: Revert "[SPARK-30535][SQL] Migrate ALTER TABLE commands to the new framework

2020-01-22 Thread GitBox
SparkQA commented on issue #27327: Revert "[SPARK-30535][SQL] Migrate ALTER TABLE commands to the new framework URL: https://github.com/apache/spark/pull/27327#issuecomment-577504651 **[Test build #117267 has

[GitHub] [spark] dilipbiswal commented on a change in pull request #27297: [SPARK-30588][DOC] Document CLUSTER BY Clause of SELECT statement in SQL Reference.

2020-01-22 Thread GitBox
dilipbiswal commented on a change in pull request #27297: [SPARK-30588][DOC] Document CLUSTER BY Clause of SELECT statement in SQL Reference. URL: https://github.com/apache/spark/pull/27297#discussion_r369940344 ## File path: docs/sql-ref-syntax-qry-select-clusterby.md ##

[GitHub] [spark] SparkQA commented on issue #27298: [SPARK-30589][DOC] Document DISTRIBUTE BY Clause of SELECT statement in SQL Reference

2020-01-22 Thread GitBox
SparkQA commented on issue #27298: [SPARK-30589][DOC] Document DISTRIBUTE BY Clause of SELECT statement in SQL Reference URL: https://github.com/apache/spark/pull/27298#issuecomment-577517463 **[Test build #117278 has

[GitHub] [spark] dilipbiswal commented on a change in pull request #27289: [SPARK-30581][DOC] Document SORT BY Clause of SELECT statement in SQLReference

2020-01-22 Thread GitBox
dilipbiswal commented on a change in pull request #27289: [SPARK-30581][DOC] Document SORT BY Clause of SELECT statement in SQLReference URL: https://github.com/apache/spark/pull/27289#discussion_r369943469 ## File path: docs/sql-ref-syntax-qry-select-sortby.md ## @@ -0,0

[GitHub] [spark] AmplabJenkins removed a comment on issue #27298: [SPARK-30589][DOC] Document DISTRIBUTE BY Clause of SELECT statement in SQL Reference

2020-01-22 Thread GitBox
AmplabJenkins removed a comment on issue #27298: [SPARK-30589][DOC] Document DISTRIBUTE BY Clause of SELECT statement in SQL Reference URL: https://github.com/apache/spark/pull/27298#issuecomment-577517762 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #27288: [SPARK-30579][DOC] Document ORDER BY Clause of SELECT statement in SQL Reference

2020-01-22 Thread GitBox
AmplabJenkins removed a comment on issue #27288: [SPARK-30579][DOC] Document ORDER BY Clause of SELECT statement in SQL Reference URL: https://github.com/apache/spark/pull/27288#issuecomment-577517770 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27289: [SPARK-30581][DOC] Document SORT BY Clause of SELECT statement in SQLReference

2020-01-22 Thread GitBox
AmplabJenkins removed a comment on issue #27289: [SPARK-30581][DOC] Document SORT BY Clause of SELECT statement in SQLReference URL: https://github.com/apache/spark/pull/27289#issuecomment-577517749 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27289: [SPARK-30581][DOC] Document SORT BY Clause of SELECT statement in SQLReference

2020-01-22 Thread GitBox
AmplabJenkins removed a comment on issue #27289: [SPARK-30581][DOC] Document SORT BY Clause of SELECT statement in SQLReference URL: https://github.com/apache/spark/pull/27289#issuecomment-577517756 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27288: [SPARK-30579][DOC] Document ORDER BY Clause of SELECT statement in SQL Reference

2020-01-22 Thread GitBox
AmplabJenkins removed a comment on issue #27288: [SPARK-30579][DOC] Document ORDER BY Clause of SELECT statement in SQL Reference URL: https://github.com/apache/spark/pull/27288#issuecomment-577517774 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #27288: [SPARK-30579][DOC] Document ORDER BY Clause of SELECT statement in SQL Reference

2020-01-22 Thread GitBox
SparkQA commented on issue #27288: [SPARK-30579][DOC] Document ORDER BY Clause of SELECT statement in SQL Reference URL: https://github.com/apache/spark/pull/27288#issuecomment-577517497 **[Test build #117280 has

[GitHub] [spark] SparkQA commented on issue #27289: [SPARK-30581][DOC] Document SORT BY Clause of SELECT statement in SQLReference

2020-01-22 Thread GitBox
SparkQA commented on issue #27289: [SPARK-30581][DOC] Document SORT BY Clause of SELECT statement in SQLReference URL: https://github.com/apache/spark/pull/27289#issuecomment-577517477 **[Test build #117279 has

[GitHub] [spark] AmplabJenkins commented on issue #27288: [SPARK-30579][DOC] Document ORDER BY Clause of SELECT statement in SQL Reference

2020-01-22 Thread GitBox
AmplabJenkins commented on issue #27288: [SPARK-30579][DOC] Document ORDER BY Clause of SELECT statement in SQL Reference URL: https://github.com/apache/spark/pull/27288#issuecomment-577517770 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27288: [SPARK-30579][DOC] Document ORDER BY Clause of SELECT statement in SQL Reference

2020-01-22 Thread GitBox
AmplabJenkins commented on issue #27288: [SPARK-30579][DOC] Document ORDER BY Clause of SELECT statement in SQL Reference URL: https://github.com/apache/spark/pull/27288#issuecomment-577517774 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27298: [SPARK-30589][DOC] Document DISTRIBUTE BY Clause of SELECT statement in SQL Reference

2020-01-22 Thread GitBox
AmplabJenkins commented on issue #27298: [SPARK-30589][DOC] Document DISTRIBUTE BY Clause of SELECT statement in SQL Reference URL: https://github.com/apache/spark/pull/27298#issuecomment-577517762 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27289: [SPARK-30581][DOC] Document SORT BY Clause of SELECT statement in SQLReference

2020-01-22 Thread GitBox
AmplabJenkins commented on issue #27289: [SPARK-30581][DOC] Document SORT BY Clause of SELECT statement in SQLReference URL: https://github.com/apache/spark/pull/27289#issuecomment-577517756 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27289: [SPARK-30581][DOC] Document SORT BY Clause of SELECT statement in SQLReference

2020-01-22 Thread GitBox
AmplabJenkins commented on issue #27289: [SPARK-30581][DOC] Document SORT BY Clause of SELECT statement in SQLReference URL: https://github.com/apache/spark/pull/27289#issuecomment-577517749 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27298: [SPARK-30589][DOC] Document DISTRIBUTE BY Clause of SELECT statement in SQL Reference

2020-01-22 Thread GitBox
AmplabJenkins commented on issue #27298: [SPARK-30589][DOC] Document DISTRIBUTE BY Clause of SELECT statement in SQL Reference URL: https://github.com/apache/spark/pull/27298#issuecomment-577517758 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27298: [SPARK-30589][DOC] Document DISTRIBUTE BY Clause of SELECT statement in SQL Reference

2020-01-22 Thread GitBox
AmplabJenkins removed a comment on issue #27298: [SPARK-30589][DOC] Document DISTRIBUTE BY Clause of SELECT statement in SQL Reference URL: https://github.com/apache/spark/pull/27298#issuecomment-577517758 Merged build finished. Test PASSed.

[GitHub] [spark] MaxGekk commented on a change in pull request #27324: [SPARK-30188][SQL][TESTS][FOLLOW-UP] Remove `sorted` in the check of expression example outputs

2020-01-22 Thread GitBox
MaxGekk commented on a change in pull request #27324: [SPARK-30188][SQL][TESTS][FOLLOW-UP] Remove `sorted` in the check of expression example outputs URL: https://github.com/apache/spark/pull/27324#discussion_r369959927 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #27335: [SPARK-30601][BUILD][2.4] Add a Google Maven Central as a primary repository

2020-01-22 Thread GitBox
AmplabJenkins commented on issue #27335: [SPARK-30601][BUILD][2.4] Add a Google Maven Central as a primary repository URL: https://github.com/apache/spark/pull/27335#issuecomment-577536688 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27335: [SPARK-30601][BUILD][2.4] Add a Google Maven Central as a primary repository

2020-01-22 Thread GitBox
AmplabJenkins removed a comment on issue #27335: [SPARK-30601][BUILD][2.4] Add a Google Maven Central as a primary repository URL: https://github.com/apache/spark/pull/27335#issuecomment-577536676 Merged build finished. Test PASSed.

[GitHub] [spark] HyukjinKwon commented on issue #27325: [SPARK-30607][SQL][PYSPARK][SPARKR] Add overlay wrappers for SparkR and PySpark

2020-01-22 Thread GitBox
HyukjinKwon commented on issue #27325: [SPARK-30607][SQL][PYSPARK][SPARKR] Add overlay wrappers for SparkR and PySpark URL: https://github.com/apache/spark/pull/27325#issuecomment-577536853 Merged to master. This is an

[GitHub] [spark] HyukjinKwon closed pull request #27325: [SPARK-30607][SQL][PYSPARK][SPARKR] Add overlay wrappers for SparkR and PySpark

2020-01-22 Thread GitBox
HyukjinKwon closed pull request #27325: [SPARK-30607][SQL][PYSPARK][SPARKR] Add overlay wrappers for SparkR and PySpark URL: https://github.com/apache/spark/pull/27325 This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins commented on issue #27335: [SPARK-30601][BUILD][2.4] Add a Google Maven Central as a primary repository

2020-01-22 Thread GitBox
AmplabJenkins commented on issue #27335: [SPARK-30601][BUILD][2.4] Add a Google Maven Central as a primary repository URL: https://github.com/apache/spark/pull/27335#issuecomment-577536676 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27335: [SPARK-30601][BUILD][2.4] Add a Google Maven Central as a primary repository

2020-01-22 Thread GitBox
AmplabJenkins removed a comment on issue #27335: [SPARK-30601][BUILD][2.4] Add a Google Maven Central as a primary repository URL: https://github.com/apache/spark/pull/27335#issuecomment-577536688 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #27335: [SPARK-30601][BUILD][2.4] Add a Google Maven Central as a primary repository

2020-01-22 Thread GitBox
SparkQA commented on issue #27335: [SPARK-30601][BUILD][2.4] Add a Google Maven Central as a primary repository URL: https://github.com/apache/spark/pull/27335#issuecomment-577536391 **[Test build #117284 has

[GitHub] [spark] cloud-fan commented on issue #27318: [SPARK-30603][SQL] move RESERVED_PROPERTIES from SupportsNamespaces and TableCatalog to CatalogV2Util

2020-01-22 Thread GitBox
cloud-fan commented on issue #27318: [SPARK-30603][SQL] move RESERVED_PROPERTIES from SupportsNamespaces and TableCatalog to CatalogV2Util URL: https://github.com/apache/spark/pull/27318#issuecomment-577556309 sorry it conflicts, can you resolve it frist?

[GitHub] [spark] AmplabJenkins commented on issue #27333: [WIP][DO-NOT-MERGE][SPARK-29438][SS][FOLLOWUP] Add regression tests for Streaming Aggregation and flatMapGroupsWithState

2020-01-22 Thread GitBox
AmplabJenkins commented on issue #27333: [WIP][DO-NOT-MERGE][SPARK-29438][SS][FOLLOWUP] Add regression tests for Streaming Aggregation and flatMapGroupsWithState URL: https://github.com/apache/spark/pull/27333#issuecomment-577495035 Test PASSed. Refer to this link for build results

[GitHub] [spark] AmplabJenkins commented on issue #27333: [WIP][DO-NOT-MERGE][SPARK-29438][SS][FOLLOWUP] Add regression tests for Streaming Aggregation and flatMapGroupsWithState

2020-01-22 Thread GitBox
AmplabJenkins commented on issue #27333: [WIP][DO-NOT-MERGE][SPARK-29438][SS][FOLLOWUP] Add regression tests for Streaming Aggregation and flatMapGroupsWithState URL: https://github.com/apache/spark/pull/27333#issuecomment-577495028 Merged build finished. Test PASSed.

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #27106: [SPARK-30435][DOC] Update doc of Supported Hive Features

2020-01-22 Thread GitBox
AngersZh commented on a change in pull request #27106: [SPARK-30435][DOC] Update doc of Supported Hive Features URL: https://github.com/apache/spark/pull/27106#discussion_r369923680 ## File path: docs/sql-migration-guide.md ## @@ -862,10 +863,34 @@ Spark SQL supports

[GitHub] [spark] AmplabJenkins removed a comment on issue #27325: [SPARK-30607][SQL][PYSPARK][SPARKR] Add overlay wrappers for SparkR and PySpark

2020-01-22 Thread GitBox
AmplabJenkins removed a comment on issue #27325: [SPARK-30607][SQL][PYSPARK][SPARKR] Add overlay wrappers for SparkR and PySpark URL: https://github.com/apache/spark/pull/27325#issuecomment-577494674 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #27333: [WIP][DO-NOT-MERGE][SPARK-29438][SS][FOLLOWUP] Add regression tests for Streaming Aggregation and flatMapGroupsWithState

2020-01-22 Thread GitBox
SparkQA commented on issue #27333: [WIP][DO-NOT-MERGE][SPARK-29438][SS][FOLLOWUP] Add regression tests for Streaming Aggregation and flatMapGroupsWithState URL: https://github.com/apache/spark/pull/27333#issuecomment-577494832 **[Test build #117274 has

[GitHub] [spark] SparkQA removed a comment on issue #27325: [SPARK-30607][SQL][PYSPARK][SPARKR] Add overlay wrappers for SparkR and PySpark

2020-01-22 Thread GitBox
SparkQA removed a comment on issue #27325: [SPARK-30607][SQL][PYSPARK][SPARKR] Add overlay wrappers for SparkR and PySpark URL: https://github.com/apache/spark/pull/27325#issuecomment-577483869 **[Test build #117271 has

[GitHub] [spark] AmplabJenkins commented on issue #27325: [SPARK-30607][SQL][PYSPARK][SPARKR] Add overlay wrappers for SparkR and PySpark

2020-01-22 Thread GitBox
AmplabJenkins commented on issue #27325: [SPARK-30607][SQL][PYSPARK][SPARKR] Add overlay wrappers for SparkR and PySpark URL: https://github.com/apache/spark/pull/27325#issuecomment-577494670 Merged build finished. Test PASSed.

  1   2   3   4   5   6   7   8   9   10   >