[GitHub] [spark] henrydavidge commented on issue #24953: [SPARK-28140][MLLIB][PYTHON] Accept DataFrames in RowMatrix and IndexedRowMatrix constructors

henrydavidge commented on issue #24953: [SPARK-28140][MLLIB][PYTHON] Accept DataFrames in RowMatrix and IndexedRowMatrix constructors URL: https://github.com/apache/spark/pull/24953#issuecomment-510606329 Thanks @srowen !

[GitHub] [spark] rdblue commented on issue #25104: [SPARK-28341][SQL] remove session catalog config

rdblue commented on issue #25104: [SPARK-28341][SQL] remove session catalog config URL: https://github.com/apache/spark/pull/25104#issuecomment-510611385 @brkyvz, the description must have been copied by mistake. The session property controls what implementation we use for the v2 session

[GitHub] [spark] SparkQA commented on issue #25118: [SPARK-27878][SQL] Support ARRAY(sub-SELECT) expressions

SparkQA commented on issue #25118: [SPARK-27878][SQL] Support ARRAY(sub-SELECT) expressions URL: https://github.com/apache/spark/pull/25118#issuecomment-510612335 **[Test build #107542 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/107542/testReport)**

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25059: [SPARK-28257][SQL] Use ConfigEntry for hardcoded configs in SQL

dongjoon-hyun commented on a change in pull request #25059: [SPARK-28257][SQL] Use ConfigEntry for hardcoded configs in SQL URL: https://github.com/apache/spark/pull/25059#discussion_r302702361 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/test/TestHive.scala

[GitHub] [spark] AmplabJenkins removed a comment on issue #24817: [SPARK-27963][core] Allow dynamic allocation without a shuffle service.

AmplabJenkins removed a comment on issue #24817: [SPARK-27963][core] Allow dynamic allocation without a shuffle service. URL: https://github.com/apache/spark/pull/24817#issuecomment-510618720 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24817: [SPARK-27963][core] Allow dynamic allocation without a shuffle service.

AmplabJenkins commented on issue #24817: [SPARK-27963][core] Allow dynamic allocation without a shuffle service. URL: https://github.com/apache/spark/pull/24817#issuecomment-510618720 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24817: [SPARK-27963][core] Allow dynamic allocation without a shuffle service.

AmplabJenkins removed a comment on issue #24817: [SPARK-27963][core] Allow dynamic allocation without a shuffle service. URL: https://github.com/apache/spark/pull/24817#issuecomment-510618714 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #24817: [SPARK-27963][core] Allow dynamic allocation without a shuffle service.

SparkQA removed a comment on issue #24817: [SPARK-27963][core] Allow dynamic allocation without a shuffle service. URL: https://github.com/apache/spark/pull/24817#issuecomment-510564843 **[Test build #107543 has

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25059: [SPARK-28257][SQL] Use ConfigEntry for hardcoded configs in SQL

dongjoon-hyun commented on a change in pull request #25059: [SPARK-28257][SQL] Use ConfigEntry for hardcoded configs in SQL URL: https://github.com/apache/spark/pull/25059#discussion_r302704450 ## File path: sql/core/src/test/scala/org/apache/spark/sql/RuntimeConfigSuite.scala

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25059: [SPARK-28257][SQL] Use ConfigEntry for hardcoded configs in SQL

dongjoon-hyun commented on a change in pull request #25059: [SPARK-28257][SQL] Use ConfigEntry for hardcoded configs in SQL URL: https://github.com/apache/spark/pull/25059#discussion_r302704340 ## File path: sql/core/src/test/scala/org/apache/spark/sql/RuntimeConfigSuite.scala

[GitHub] [spark] SparkQA commented on issue #25040: [SPARK-28238][SQL] Implement DESCRIBE TABLE for Data Source V2 Tables.

SparkQA commented on issue #25040: [SPARK-28238][SQL] Implement DESCRIBE TABLE for Data Source V2 Tables. URL: https://github.com/apache/spark/pull/25040#issuecomment-510634300 **[Test build #107546 has

[GitHub] [spark] AmplabJenkins commented on issue #25118: [SPARK-27878][SQL] Support ARRAY(sub-SELECT) expressions

AmplabJenkins commented on issue #25118: [SPARK-27878][SQL] Support ARRAY(sub-SELECT) expressions URL: https://github.com/apache/spark/pull/25118#issuecomment-510612963 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25118: [SPARK-27878][SQL] Support ARRAY(sub-SELECT) expressions

AmplabJenkins removed a comment on issue #25118: [SPARK-27878][SQL] Support ARRAY(sub-SELECT) expressions URL: https://github.com/apache/spark/pull/25118#issuecomment-510612954 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #25118: [SPARK-27878][SQL] Support ARRAY(sub-SELECT) expressions

AmplabJenkins commented on issue #25118: [SPARK-27878][SQL] Support ARRAY(sub-SELECT) expressions URL: https://github.com/apache/spark/pull/25118#issuecomment-510612954 Merged build finished. Test PASSed. This is an

[GitHub] [spark] SparkQA removed a comment on issue #25118: [SPARK-27878][SQL] Support ARRAY(sub-SELECT) expressions

SparkQA removed a comment on issue #25118: [SPARK-27878][SQL] Support ARRAY(sub-SELECT) expressions URL: https://github.com/apache/spark/pull/25118#issuecomment-510529723 **[Test build #107542 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25118: [SPARK-27878][SQL] Support ARRAY(sub-SELECT) expressions

AmplabJenkins removed a comment on issue #25118: [SPARK-27878][SQL] Support ARRAY(sub-SELECT) expressions URL: https://github.com/apache/spark/pull/25118#issuecomment-510612963 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] brkyvz commented on a change in pull request #24937: [SPARK-28139][SQL] Add v2 ALTER TABLE implementation.

brkyvz commented on a change in pull request #24937: [SPARK-28139][SQL] Add v2 ALTER TABLE implementation. URL: https://github.com/apache/spark/pull/24937#discussion_r302683100 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/catalog/v2/utils/CatalogV2Util.scala

[GitHub] [spark] brkyvz commented on a change in pull request #24937: [SPARK-28139][SQL] Add v2 ALTER TABLE implementation.

brkyvz commented on a change in pull request #24937: [SPARK-28139][SQL] Add v2 ALTER TABLE implementation. URL: https://github.com/apache/spark/pull/24937#discussion_r302686447 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala

[GitHub] [spark] brkyvz commented on a change in pull request #24937: [SPARK-28139][SQL] Add v2 ALTER TABLE implementation.

brkyvz commented on a change in pull request #24937: [SPARK-28139][SQL] Add v2 ALTER TABLE implementation. URL: https://github.com/apache/spark/pull/24937#discussion_r302681505 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/catalog/v2/TableChange.java ##

[GitHub] [spark] brkyvz commented on a change in pull request #24937: [SPARK-28139][SQL] Add v2 ALTER TABLE implementation.

brkyvz commented on a change in pull request #24937: [SPARK-28139][SQL] Add v2 ALTER TABLE implementation. URL: https://github.com/apache/spark/pull/24937#discussion_r302684912 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala

[GitHub] [spark] brkyvz commented on a change in pull request #24937: [SPARK-28139][SQL] Add v2 ALTER TABLE implementation.

brkyvz commented on a change in pull request #24937: [SPARK-28139][SQL] Add v2 ALTER TABLE implementation. URL: https://github.com/apache/spark/pull/24937#discussion_r302686124 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala

[GitHub] [spark] brkyvz commented on a change in pull request #24937: [SPARK-28139][SQL] Add v2 ALTER TABLE implementation.

brkyvz commented on a change in pull request #24937: [SPARK-28139][SQL] Add v2 ALTER TABLE implementation. URL: https://github.com/apache/spark/pull/24937#discussion_r302698140 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala

[GitHub] [spark] SparkQA commented on issue #24817: [SPARK-27963][core] Allow dynamic allocation without a shuffle service.

SparkQA commented on issue #24817: [SPARK-27963][core] Allow dynamic allocation without a shuffle service. URL: https://github.com/apache/spark/pull/24817#issuecomment-510618006 **[Test build #107543 has

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25059: [SPARK-28257][SQL] Use ConfigEntry for hardcoded configs in SQL

dongjoon-hyun commented on a change in pull request #25059: [SPARK-28257][SQL] Use ConfigEntry for hardcoded configs in SQL URL: https://github.com/apache/spark/pull/25059#discussion_r302704915 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25059: [SPARK-28257][SQL] Use ConfigEntry for hardcoded configs in SQL

dongjoon-hyun commented on a change in pull request #25059: [SPARK-28257][SQL] Use ConfigEntry for hardcoded configs in SQL URL: https://github.com/apache/spark/pull/25059#discussion_r302704994 ## File path:

[GitHub] [spark] dongjoon-hyun commented on issue #25059: [SPARK-28257][SQL] Use ConfigEntry for hardcoded configs in SQL

dongjoon-hyun commented on issue #25059: [SPARK-28257][SQL] Use ConfigEntry for hardcoded configs in SQL URL: https://github.com/apache/spark/pull/25059#issuecomment-510620613 Thank you for updating, @WangGuangxin . There are a few more remaining nits.

[GitHub] [spark] mgaido91 commented on a change in pull request #25029: [SPARK-28228][SQL] Fix substitution order of nested WITH clauses

mgaido91 commented on a change in pull request #25029: [SPARK-28228][SQL] Fix substitution order of nested WITH clauses URL: https://github.com/apache/spark/pull/25029#discussion_r302704261 ## File path:

[GitHub] [spark] mgaido91 commented on a change in pull request #25029: [SPARK-28228][SQL] Fix substitution order of nested WITH clauses

mgaido91 commented on a change in pull request #25029: [SPARK-28228][SQL] Fix substitution order of nested WITH clauses URL: https://github.com/apache/spark/pull/25029#discussion_r302706377 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala

[GitHub] [spark] mgaido91 commented on a change in pull request #25029: [SPARK-28228][SQL] Fix substitution order of nested WITH clauses

mgaido91 commented on a change in pull request #25029: [SPARK-28228][SQL] Fix substitution order of nested WITH clauses URL: https://github.com/apache/spark/pull/25029#discussion_r302704485 ## File path:

[GitHub] [spark] mgaido91 commented on a change in pull request #25029: [SPARK-28228][SQL] Fix substitution order of nested WITH clauses

mgaido91 commented on a change in pull request #25029: [SPARK-28228][SQL] Fix substitution order of nested WITH clauses URL: https://github.com/apache/spark/pull/25029#discussion_r302705893 ## File path:

[GitHub] [spark] mgaido91 commented on a change in pull request #25029: [SPARK-28228][SQL] Fix substitution order of nested WITH clauses

mgaido91 commented on a change in pull request #25029: [SPARK-28228][SQL] Fix substitution order of nested WITH clauses URL: https://github.com/apache/spark/pull/25029#discussion_r302707772 ## File path:

[GitHub] [spark] rdblue commented on a change in pull request #25040: [SPARK-28238][SQL] Implement DESCRIBE TABLE for Data Source V2 Tables.

rdblue commented on a change in pull request #25040: [SPARK-28238][SQL] Implement DESCRIBE TABLE for Data Source V2 Tables. URL: https://github.com/apache/spark/pull/25040#discussion_r302708265 ## File path:

[GitHub] [spark] nvander1 commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

nvander1 commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-510634527 The build is failing but not at changes I have made: ```

[GitHub] [spark] nvander1 edited a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

nvander1 edited a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-510634527 The build is failing but not at changes I have made: ``` error]

[GitHub] [spark] mccheah commented on a change in pull request #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2

mccheah commented on a change in pull request #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2 URL: https://github.com/apache/spark/pull/24798#discussion_r302721538 ## File path:

[GitHub] [spark] SparkQA commented on issue #25119: [SPARK-28283][SQL][PYTHON][TESTS] Convert and port 'intersect-all.sql' into UDF test base

SparkQA commented on issue #25119: [SPARK-28283][SQL][PYTHON][TESTS] Convert and port 'intersect-all.sql' into UDF test base URL: https://github.com/apache/spark/pull/25119#issuecomment-510636151 **[Test build #107544 has

[GitHub] [spark] SparkQA removed a comment on issue #25119: [SPARK-28283][SQL][PYTHON][TESTS] Convert and port 'intersect-all.sql' into UDF test base

SparkQA removed a comment on issue #25119: [SPARK-28283][SQL][PYTHON][TESTS] Convert and port 'intersect-all.sql' into UDF test base URL: https://github.com/apache/spark/pull/25119#issuecomment-510567611 **[Test build #107544 has

[GitHub] [spark] AmplabJenkins commented on issue #25040: [SPARK-28238][SQL] Implement DESCRIBE TABLE for Data Source V2 Tables.

AmplabJenkins commented on issue #25040: [SPARK-28238][SQL] Implement DESCRIBE TABLE for Data Source V2 Tables. URL: https://github.com/apache/spark/pull/25040#issuecomment-510636286 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #25040: [SPARK-28238][SQL] Implement DESCRIBE TABLE for Data Source V2 Tables.

AmplabJenkins removed a comment on issue #25040: [SPARK-28238][SQL] Implement DESCRIBE TABLE for Data Source V2 Tables. URL: https://github.com/apache/spark/pull/25040#issuecomment-510636286 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25040: [SPARK-28238][SQL] Implement DESCRIBE TABLE for Data Source V2 Tables.

AmplabJenkins commented on issue #25040: [SPARK-28238][SQL] Implement DESCRIBE TABLE for Data Source V2 Tables. URL: https://github.com/apache/spark/pull/25040#issuecomment-510636291 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25040: [SPARK-28238][SQL] Implement DESCRIBE TABLE for Data Source V2 Tables.

AmplabJenkins removed a comment on issue #25040: [SPARK-28238][SQL] Implement DESCRIBE TABLE for Data Source V2 Tables. URL: https://github.com/apache/spark/pull/25040#issuecomment-510636291 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25119: [SPARK-28283][SQL][PYTHON][TESTS] Convert and port 'intersect-all.sql' into UDF test base

AmplabJenkins commented on issue #25119: [SPARK-28283][SQL][PYTHON][TESTS] Convert and port 'intersect-all.sql' into UDF test base URL: https://github.com/apache/spark/pull/25119#issuecomment-510637056 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #25119: [SPARK-28283][SQL][PYTHON][TESTS] Convert and port 'intersect-all.sql' into UDF test base

AmplabJenkins commented on issue #25119: [SPARK-28283][SQL][PYTHON][TESTS] Convert and port 'intersect-all.sql' into UDF test base URL: https://github.com/apache/spark/pull/25119#issuecomment-510637051 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25119: [SPARK-28283][SQL][PYTHON][TESTS] Convert and port 'intersect-all.sql' into UDF test base

AmplabJenkins removed a comment on issue #25119: [SPARK-28283][SQL][PYTHON][TESTS] Convert and port 'intersect-all.sql' into UDF test base URL: https://github.com/apache/spark/pull/25119#issuecomment-510637056 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #25119: [SPARK-28283][SQL][PYTHON][TESTS] Convert and port 'intersect-all.sql' into UDF test base

AmplabJenkins removed a comment on issue #25119: [SPARK-28283][SQL][PYTHON][TESTS] Convert and port 'intersect-all.sql' into UDF test base URL: https://github.com/apache/spark/pull/25119#issuecomment-510637051 Merged build finished. Test PASSed.

[GitHub] [spark] yeshengm opened a new pull request #25039: [WIP][SPARK-28237][SQL] Add an Idempotent batch strategy to catch potential bugs in corresponding rules

yeshengm opened a new pull request #25039: [WIP][SPARK-28237][SQL] Add an Idempotent batch strategy to catch potential bugs in corresponding rules URL: https://github.com/apache/spark/pull/25039 ## What changes were proposed in this pull request? The current RuleExecutor system

[GitHub] [spark] AmplabJenkins commented on issue #25039: [WIP][SPARK-28237][SQL] Add an Idempotent batch strategy to catch potential bugs in corresponding rules

AmplabJenkins commented on issue #25039: [WIP][SPARK-28237][SQL] Add an Idempotent batch strategy to catch potential bugs in corresponding rules URL: https://github.com/apache/spark/pull/25039#issuecomment-510641506 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25039: [WIP][SPARK-28237][SQL] Add an Idempotent batch strategy to catch potential bugs in corresponding rules

AmplabJenkins commented on issue #25039: [WIP][SPARK-28237][SQL] Add an Idempotent batch strategy to catch potential bugs in corresponding rules URL: https://github.com/apache/spark/pull/25039#issuecomment-510641516 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #25039: [WIP][SPARK-28237][SQL] Add an Idempotent batch strategy to catch potential bugs in corresponding rules

AmplabJenkins removed a comment on issue #25039: [WIP][SPARK-28237][SQL] Add an Idempotent batch strategy to catch potential bugs in corresponding rules URL: https://github.com/apache/spark/pull/25039#issuecomment-510641506 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25039: [WIP][SPARK-28237][SQL] Add an Idempotent batch strategy to catch potential bugs in corresponding rules

AmplabJenkins removed a comment on issue #25039: [WIP][SPARK-28237][SQL] Add an Idempotent batch strategy to catch potential bugs in corresponding rules URL: https://github.com/apache/spark/pull/25039#issuecomment-510641516 Test PASSed. Refer to this link for build results (access

[GitHub] [spark] SparkQA commented on issue #25039: [WIP][SPARK-28237][SQL] Add an Idempotent batch strategy to catch potential bugs in corresponding rules

SparkQA commented on issue #25039: [WIP][SPARK-28237][SQL] Add an Idempotent batch strategy to catch potential bugs in corresponding rules URL: https://github.com/apache/spark/pull/25039#issuecomment-510642180 **[Test build #107547 has

[GitHub] [spark] srowen commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

srowen commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-510642430 That doesn't seem to be failing in master. I suspect it is somehow related to this change though it's hard to see how here.

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25041: [SPARK-28133][SQL] Add acosh/asinh/atanh functions to SQL

dongjoon-hyun commented on a change in pull request #25041: [SPARK-28133][SQL] Add acosh/asinh/atanh functions to SQL URL: https://github.com/apache/spark/pull/25041#discussion_r302729675 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #25039: [WIP][SPARK-28237][SQL] Add an Idempotent batch strategy to catch potential bugs in corresponding rules

AmplabJenkins commented on issue #25039: [WIP][SPARK-28237][SQL] Add an Idempotent batch strategy to catch potential bugs in corresponding rules URL: https://github.com/apache/spark/pull/25039#issuecomment-510644017 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #25039: [WIP][SPARK-28237][SQL] Add an Idempotent batch strategy to catch potential bugs in corresponding rules

AmplabJenkins removed a comment on issue #25039: [WIP][SPARK-28237][SQL] Add an Idempotent batch strategy to catch potential bugs in corresponding rules URL: https://github.com/apache/spark/pull/25039#issuecomment-510644017 Test PASSed. Refer to this link for build results (access

[GitHub] [spark] AmplabJenkins removed a comment on issue #25039: [WIP][SPARK-28237][SQL] Add an Idempotent batch strategy to catch potential bugs in corresponding rules

AmplabJenkins removed a comment on issue #25039: [WIP][SPARK-28237][SQL] Add an Idempotent batch strategy to catch potential bugs in corresponding rules URL: https://github.com/apache/spark/pull/25039#issuecomment-510644011 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25039: [WIP][SPARK-28237][SQL] Add an Idempotent batch strategy to catch potential bugs in corresponding rules

AmplabJenkins commented on issue #25039: [WIP][SPARK-28237][SQL] Add an Idempotent batch strategy to catch potential bugs in corresponding rules URL: https://github.com/apache/spark/pull/25039#issuecomment-510644011 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25039: [WIP][SPARK-28237][SQL] Add an Idempotent batch strategy to catch potential bugs in corresponding rules

AmplabJenkins commented on issue #25039: [WIP][SPARK-28237][SQL] Add an Idempotent batch strategy to catch potential bugs in corresponding rules URL: https://github.com/apache/spark/pull/25039#issuecomment-510643667 Can one of the admins verify this patch?

[GitHub] [spark] SparkQA commented on issue #25039: [WIP][SPARK-28237][SQL] Add an Idempotent batch strategy to catch potential bugs in corresponding rules

SparkQA commented on issue #25039: [WIP][SPARK-28237][SQL] Add an Idempotent batch strategy to catch potential bugs in corresponding rules URL: https://github.com/apache/spark/pull/25039#issuecomment-510644592 **[Test build #107548 has

[GitHub] [spark] SparkQA commented on issue #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2

SparkQA commented on issue #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2 URL: https://github.com/apache/spark/pull/24798#issuecomment-510644607 **[Test build #107549 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25039: [WIP][SPARK-28237][SQL] Add an Idempotent batch strategy to catch potential bugs in corresponding rules

AmplabJenkins removed a comment on issue #25039: [WIP][SPARK-28237][SQL] Add an Idempotent batch strategy to catch potential bugs in corresponding rules URL: https://github.com/apache/spark/pull/25039#issuecomment-510643667 Can one of the admins verify this patch?

[GitHub] [spark] dongjoon-hyun commented on issue #25041: [SPARK-28133][SQL] Add acosh/asinh/atanh functions to SQL

dongjoon-hyun commented on issue #25041: [SPARK-28133][SQL] Add acosh/asinh/atanh functions to SQL URL: https://github.com/apache/spark/pull/25041#issuecomment-510644974 Thank you for checking that, @maropu . @Tonix517 . Let's check the input for `asinh` and returns `-Infinity` for

[GitHub] [spark] AmplabJenkins commented on issue #24981: [WIP][SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs- Arrow Stream Impl

AmplabJenkins commented on issue #24981: [WIP][SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs- Arrow Stream Impl URL: https://github.com/apache/spark/pull/24981#issuecomment-510646549 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24981: [WIP][SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs- Arrow Stream Impl

AmplabJenkins commented on issue #24981: [WIP][SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs- Arrow Stream Impl URL: https://github.com/apache/spark/pull/24981#issuecomment-510646541 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2

AmplabJenkins commented on issue #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2 URL: https://github.com/apache/spark/pull/24798#issuecomment-510646510 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2

AmplabJenkins commented on issue #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2 URL: https://github.com/apache/spark/pull/24798#issuecomment-510646522 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] dongjoon-hyun edited a comment on issue #25041: [SPARK-28133][SQL] Add acosh/asinh/atanh functions to SQL

dongjoon-hyun edited a comment on issue #25041: [SPARK-28133][SQL] Add acosh/asinh/atanh functions to SQL URL: https://github.com/apache/spark/pull/25041#issuecomment-510644974 Thank you for checking that, @maropu . @Tonix517 . Let's check the input inside the `asinh` function and

[GitHub] [spark] SparkQA removed a comment on issue #24937: [SPARK-28139][SQL] Add v2 ALTER TABLE implementation.

SparkQA removed a comment on issue #24937: [SPARK-28139][SQL] Add v2 ALTER TABLE implementation. URL: https://github.com/apache/spark/pull/24937#issuecomment-510578278 **[Test build #107545 has

[GitHub] [spark] SparkQA commented on issue #24937: [SPARK-28139][SQL] Add v2 ALTER TABLE implementation.

SparkQA commented on issue #24937: [SPARK-28139][SQL] Add v2 ALTER TABLE implementation. URL: https://github.com/apache/spark/pull/24937#issuecomment-510646646 **[Test build #107545 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/107545/testReport)** for

[GitHub] [spark] AmplabJenkins removed a comment on issue #24981: [WIP][SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs- Arrow Stream Impl

AmplabJenkins removed a comment on issue #24981: [WIP][SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs- Arrow Stream Impl URL: https://github.com/apache/spark/pull/24981#issuecomment-510646541 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2

AmplabJenkins removed a comment on issue #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2 URL: https://github.com/apache/spark/pull/24798#issuecomment-510646522 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24981: [WIP][SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs- Arrow Stream Impl

AmplabJenkins removed a comment on issue #24981: [WIP][SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs- Arrow Stream Impl URL: https://github.com/apache/spark/pull/24981#issuecomment-510646549 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2

AmplabJenkins removed a comment on issue #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2 URL: https://github.com/apache/spark/pull/24798#issuecomment-510646510 Merged build finished. Test PASSed.

[GitHub] [spark] Tonix517 commented on issue #25041: [SPARK-28133][SQL] Add acosh/asinh/atanh functions to SQL

Tonix517 commented on issue #25041: [SPARK-28133][SQL] Add acosh/asinh/atanh functions to SQL URL: https://github.com/apache/spark/pull/25041#issuecomment-510646610 To confirm: we need to handle +Infinity and -Infinity input for asinh, and also +Infinity for acosh correct? > Thank

[GitHub] [spark] AmplabJenkins removed a comment on issue #24937: [SPARK-28139][SQL] Add v2 ALTER TABLE implementation.

AmplabJenkins removed a comment on issue #24937: [SPARK-28139][SQL] Add v2 ALTER TABLE implementation. URL: https://github.com/apache/spark/pull/24937#issuecomment-510647292 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #24937: [SPARK-28139][SQL] Add v2 ALTER TABLE implementation.

AmplabJenkins removed a comment on issue #24937: [SPARK-28139][SQL] Add v2 ALTER TABLE implementation. URL: https://github.com/apache/spark/pull/24937#issuecomment-510647302 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24937: [SPARK-28139][SQL] Add v2 ALTER TABLE implementation.

AmplabJenkins commented on issue #24937: [SPARK-28139][SQL] Add v2 ALTER TABLE implementation. URL: https://github.com/apache/spark/pull/24937#issuecomment-510647302 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #24981: [WIP][SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs- Arrow Stream Impl

SparkQA commented on issue #24981: [WIP][SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs- Arrow Stream Impl URL: https://github.com/apache/spark/pull/24981#issuecomment-510647313 **[Test build #107550 has

[GitHub] [spark] AmplabJenkins commented on issue #24937: [SPARK-28139][SQL] Add v2 ALTER TABLE implementation.

AmplabJenkins commented on issue #24937: [SPARK-28139][SQL] Add v2 ALTER TABLE implementation. URL: https://github.com/apache/spark/pull/24937#issuecomment-510647292 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #24981: [WIP][SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs- Arrow Stream Impl

AmplabJenkins commented on issue #24981: [WIP][SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs- Arrow Stream Impl URL: https://github.com/apache/spark/pull/24981#issuecomment-510647952 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #24981: [WIP][SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs- Arrow Stream Impl

AmplabJenkins commented on issue #24981: [WIP][SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs- Arrow Stream Impl URL: https://github.com/apache/spark/pull/24981#issuecomment-510647956 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #24981: [WIP][SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs- Arrow Stream Impl

SparkQA commented on issue #24981: [WIP][SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs- Arrow Stream Impl URL: https://github.com/apache/spark/pull/24981#issuecomment-510647940 **[Test build #107550 has

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25110: [SPARK-28270][SQL][FOLLOW-UP] Explicitly cast into int/long/decimal in udf-aggregates_part1.sql to avoid Python float limit

dongjoon-hyun commented on a change in pull request #25110: [SPARK-28270][SQL][FOLLOW-UP] Explicitly cast into int/long/decimal in udf-aggregates_part1.sql to avoid Python float limitation URL: https://github.com/apache/spark/pull/25110#discussion_r302735905 ## File path:

[GitHub] [spark] SparkQA removed a comment on issue #24981: [WIP][SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs- Arrow Stream Impl

SparkQA removed a comment on issue #24981: [WIP][SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs- Arrow Stream Impl URL: https://github.com/apache/spark/pull/24981#issuecomment-510647313 **[Test build #107550 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24981: [WIP][SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs- Arrow Stream Impl

AmplabJenkins removed a comment on issue #24981: [WIP][SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs- Arrow Stream Impl URL: https://github.com/apache/spark/pull/24981#issuecomment-510647952 Merged build finished. Test FAILed.

[GitHub] [spark] d80tb7 commented on a change in pull request #24981: [WIP][SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs- Arrow Stream Impl

d80tb7 commented on a change in pull request #24981: [WIP][SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs- Arrow Stream Impl URL: https://github.com/apache/spark/pull/24981#discussion_r302736415 ## File path: python/pyspark/serializers.py ## @@ -401,6

[GitHub] [spark] AmplabJenkins removed a comment on issue #24981: [WIP][SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs- Arrow Stream Impl

AmplabJenkins removed a comment on issue #24981: [WIP][SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs- Arrow Stream Impl URL: https://github.com/apache/spark/pull/24981#issuecomment-510647956 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] d80tb7 commented on a change in pull request #24981: [WIP][SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs- Arrow Stream Impl

d80tb7 commented on a change in pull request #24981: [WIP][SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs- Arrow Stream Impl URL: https://github.com/apache/spark/pull/24981#discussion_r302736698 ## File path: python/pyspark/sql/cogroup.py ## @@ -0,0 +1,45

[GitHub] [spark] d80tb7 commented on a change in pull request #24981: [WIP][SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs- Arrow Stream Impl

d80tb7 commented on a change in pull request #24981: [WIP][SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs- Arrow Stream Impl URL: https://github.com/apache/spark/pull/24981#discussion_r302736639 ## File path: python/pyspark/sql/cogroup.py ## @@ -0,0 +1,45

[GitHub] [spark] AmplabJenkins removed a comment on issue #23767: [SPARK-26329][CORE] Faster polling of executor memory metrics.

AmplabJenkins removed a comment on issue #23767: [SPARK-26329][CORE] Faster polling of executor memory metrics. URL: https://github.com/apache/spark/pull/23767#issuecomment-510649339 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24981: [WIP][SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs- Arrow Stream Impl

AmplabJenkins commented on issue #24981: [WIP][SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs- Arrow Stream Impl URL: https://github.com/apache/spark/pull/24981#issuecomment-510649340 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #23767: [SPARK-26329][CORE] Faster polling of executor memory metrics.

AmplabJenkins commented on issue #23767: [SPARK-26329][CORE] Faster polling of executor memory metrics. URL: https://github.com/apache/spark/pull/23767#issuecomment-510649327 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #24981: [WIP][SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs- Arrow Stream Impl

AmplabJenkins removed a comment on issue #24981: [WIP][SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs- Arrow Stream Impl URL: https://github.com/apache/spark/pull/24981#issuecomment-510649340 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #23767: [SPARK-26329][CORE] Faster polling of executor memory metrics.

AmplabJenkins removed a comment on issue #23767: [SPARK-26329][CORE] Faster polling of executor memory metrics. URL: https://github.com/apache/spark/pull/23767#issuecomment-510649327 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #24981: [WIP][SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs- Arrow Stream Impl

AmplabJenkins removed a comment on issue #24981: [WIP][SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs- Arrow Stream Impl URL: https://github.com/apache/spark/pull/24981#issuecomment-510649332 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #23767: [SPARK-26329][CORE] Faster polling of executor memory metrics.

AmplabJenkins commented on issue #23767: [SPARK-26329][CORE] Faster polling of executor memory metrics. URL: https://github.com/apache/spark/pull/23767#issuecomment-510649339 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24981: [WIP][SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs- Arrow Stream Impl

AmplabJenkins commented on issue #24981: [WIP][SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs- Arrow Stream Impl URL: https://github.com/apache/spark/pull/24981#issuecomment-510649332 Merged build finished. Test PASSed.

[GitHub] [spark] d80tb7 commented on a change in pull request #24981: [WIP][SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs- Arrow Stream Impl

d80tb7 commented on a change in pull request #24981: [WIP][SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs- Arrow Stream Impl URL: https://github.com/apache/spark/pull/24981#discussion_r302737992 ## File path: python/pyspark/sql/tests/test_pandas_udf_cogrouped_map.py

[GitHub] [spark] SparkQA commented on issue #24981: [WIP][SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs- Arrow Stream Impl

SparkQA commented on issue #24981: [WIP][SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs- Arrow Stream Impl URL: https://github.com/apache/spark/pull/24981#issuecomment-510649961 **[Test build #107551 has

[GitHub] [spark] SparkQA commented on issue #23767: [SPARK-26329][CORE] Faster polling of executor memory metrics.

SparkQA commented on issue #23767: [SPARK-26329][CORE] Faster polling of executor memory metrics. URL: https://github.com/apache/spark/pull/23767#issuecomment-510649988 **[Test build #107552 has

  1   2   3   4   5   6   7   8   9   10   >