[GitHub] [spark] AmplabJenkins removed a comment on issue #24784: [SPARK-27938][SQL] Remove feature flag LEGACY_PASS_PARTITION_BY_AS_OPTIONS

AmplabJenkins removed a comment on issue #24784: [SPARK-27938][SQL] Remove feature flag LEGACY_PASS_PARTITION_BY_AS_OPTIONS URL: https://github.com/apache/spark/pull/24784#issuecomment-499706751 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24784: [SPARK-27938][SQL] Remove feature flag LEGACY_PASS_PARTITION_BY_AS_OPTIONS

AmplabJenkins commented on issue #24784: [SPARK-27938][SQL] Remove feature flag LEGACY_PASS_PARTITION_BY_AS_OPTIONS URL: https://github.com/apache/spark/pull/24784#issuecomment-499706739 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24784: [SPARK-27938][SQL] Remove feature flag LEGACY_PASS_PARTITION_BY_AS_OPTIONS

AmplabJenkins commented on issue #24784: [SPARK-27938][SQL] Remove feature flag LEGACY_PASS_PARTITION_BY_AS_OPTIONS URL: https://github.com/apache/spark/pull/24784#issuecomment-499706751 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24734: [SPARK-27870][SQL][PySpark] Flush batch timely for pandas UDF (for improving pandas UDFs pipeline)

AmplabJenkins removed a comment on issue #24734: [SPARK-27870][SQL][PySpark] Flush batch timely for pandas UDF (for improving pandas UDFs pipeline) URL: https://github.com/apache/spark/pull/24734#issuecomment-499730842 Test PASSed. Refer to this link for build results (access rights to

[GitHub] [spark] AmplabJenkins commented on issue #24805: [SPARK-27798][SQL] from_avro shouldn't produces same value when converted to local relation

AmplabJenkins commented on issue #24805: [SPARK-27798][SQL] from_avro shouldn't produces same value when converted to local relation URL: https://github.com/apache/spark/pull/24805#issuecomment-499740154 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #24805: [SPARK-27798][SQL] from_avro shouldn't produces same value when converted to local relation

AmplabJenkins commented on issue #24805: [SPARK-27798][SQL] from_avro shouldn't produces same value when converted to local relation URL: https://github.com/apache/spark/pull/24805#issuecomment-499740151 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24805: [SPARK-27798][SQL] from_avro shouldn't produces same value when converted to local relation

AmplabJenkins removed a comment on issue #24805: [SPARK-27798][SQL] from_avro shouldn't produces same value when converted to local relation URL: https://github.com/apache/spark/pull/24805#issuecomment-499740151 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24805: [SPARK-27798][SQL] from_avro shouldn't produces same value when converted to local relation

AmplabJenkins removed a comment on issue #24805: [SPARK-27798][SQL] from_avro shouldn't produces same value when converted to local relation URL: https://github.com/apache/spark/pull/24805#issuecomment-499740154 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] ketank-new commented on issue #24788: [SPARK-26985] [core]

ketank-new commented on issue #24788: [SPARK-26985] [core] URL: https://github.com/apache/spark/pull/24788#issuecomment-499765576 > Could you please add JIRA number `[SPARK-]` and `[core]` as a prefix of the title? done

[GitHub] [spark] rdblue commented on a change in pull request #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2

rdblue commented on a change in pull request #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2 URL: https://github.com/apache/spark/pull/24798#discussion_r291410750 ## File path:

[GitHub] [spark] SparkQA removed a comment on issue #24784: [SPARK-27938][SQL] Remove feature flag LEGACY_PASS_PARTITION_BY_AS_OPTIONS

SparkQA removed a comment on issue #24784: [SPARK-27938][SQL] Remove feature flag LEGACY_PASS_PARTITION_BY_AS_OPTIONS URL: https://github.com/apache/spark/pull/24784#issuecomment-499655626 **[Test build #106258 has

[GitHub] [spark] rdblue commented on a change in pull request #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2

rdblue commented on a change in pull request #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2 URL: https://github.com/apache/spark/pull/24798#discussion_r291410391 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24815: [SPARK-27961][SQL] DataSourceV2Relation should not have refresh method

dongjoon-hyun commented on a change in pull request #24815: [SPARK-27961][SQL] DataSourceV2Relation should not have refresh method URL: https://github.com/apache/spark/pull/24815#discussion_r291424651 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24335: [SPARK-27425][SQL] Add count_if functions

dongjoon-hyun commented on a change in pull request #24335: [SPARK-27425][SQL] Add count_if functions URL: https://github.com/apache/spark/pull/24335#discussion_r291432774 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/CountIf.scala

[GitHub] [spark] HyukjinKwon commented on issue #24788: s390x specific changes

HyukjinKwon commented on issue #24788: s390x specific changes URL: https://github.com/apache/spark/pull/24788#issuecomment-499741691 @ketank-new, please file a JIRA with error message with problem analysis and describe how this PR fixes in PR description. Otherwise, no one knows what's

[GitHub] [spark] dongjoon-hyun edited a comment on issue #24335: [SPARK-27425][SQL] Add count_if function

dongjoon-hyun edited a comment on issue #24335: [SPARK-27425][SQL] Add count_if function URL: https://github.com/apache/spark/pull/24335#issuecomment-499741465 I also support this feature and @HyukjinKwon . cc @gatorsmile

[GitHub] [spark] dongjoon-hyun commented on issue #24335: [SPARK-27425][SQL] Add count_if function

dongjoon-hyun commented on issue #24335: [SPARK-27425][SQL] Add count_if function URL: https://github.com/apache/spark/pull/24335#issuecomment-499741465 cc @gatorsmile This is an automated message from the Apache Git

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24795: [SPARK-27945][SQL] Minimal changes to support columnar processing

dongjoon-hyun commented on a change in pull request #24795: [SPARK-27945][SQL] Minimal changes to support columnar processing URL: https://github.com/apache/spark/pull/24795#discussion_r291442978 ## File path: NOTICE-binary ## @@ -73,6 +73,10 @@ Copyright 2005-2015 The

[GitHub] [spark] AmplabJenkins removed a comment on issue #24819: [SPARK-27973][MINOR] [EXAMPLES]correct DirectKafkaWordCount usage text with groupId

AmplabJenkins removed a comment on issue #24819: [SPARK-27973][MINOR] [EXAMPLES]correct DirectKafkaWordCount usage text with groupId URL: https://github.com/apache/spark/pull/24819#issuecomment-499757749 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #24819: [SPARK-27973][MINOR] [EXAMPLES]correct DirectKafkaWordCount usage text with groupId

AmplabJenkins commented on issue #24819: [SPARK-27973][MINOR] [EXAMPLES]correct DirectKafkaWordCount usage text with groupId URL: https://github.com/apache/spark/pull/24819#issuecomment-499757749 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #24819: [SPARK-27973][MINOR] [EXAMPLES]correct DirectKafkaWordCount usage text with groupId

AmplabJenkins commented on issue #24819: [SPARK-27973][MINOR] [EXAMPLES]correct DirectKafkaWordCount usage text with groupId URL: https://github.com/apache/spark/pull/24819#issuecomment-499757833 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #24335: [SPARK-27425][SQL] Add count_if function

AmplabJenkins commented on issue #24335: [SPARK-27425][SQL] Add count_if function URL: https://github.com/apache/spark/pull/24335#issuecomment-499764312 Merged build finished. Test PASSed. This is an automated message from

[GitHub] [spark] AmplabJenkins commented on issue #24335: [SPARK-27425][SQL] Add count_if function

AmplabJenkins commented on issue #24335: [SPARK-27425][SQL] Add count_if function URL: https://github.com/apache/spark/pull/24335#issuecomment-499764318 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] dongjoon-hyun commented on issue #24817: [WIP][SPARK-27963][core] Allow dynamic allocation without a shuffle service.

dongjoon-hyun commented on issue #24817: [WIP][SPARK-27963][core] Allow dynamic allocation without a shuffle service. URL: https://github.com/apache/spark/pull/24817#issuecomment-499710502 Retest this please. This is an

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24335: [SPARK-27425][SQL] Add count_if functions

dongjoon-hyun commented on a change in pull request #24335: [SPARK-27425][SQL] Add count_if functions URL: https://github.com/apache/spark/pull/24335#discussion_r291433907 ## File path: sql/core/src/test/scala/org/apache/spark/sql/DataFrameAggregateSuite.scala ## @@

[GitHub] [spark] SparkQA commented on issue #24805: [SPARK-27798][SQL] from_avro shouldn't produces same value when converted to local relation

SparkQA commented on issue #24805: [SPARK-27798][SQL] from_avro shouldn't produces same value when converted to local relation URL: https://github.com/apache/spark/pull/24805#issuecomment-499740453 **[Test build #106266 has

[GitHub] [spark] viirya commented on a change in pull request #24806: [SPARK-27856][SQL] Only allow type upcasting when inserting table

viirya commented on a change in pull request #24806: [SPARK-27856][SQL] Only allow type upcasting when inserting table URL: https://github.com/apache/spark/pull/24806#discussion_r291439699 ## File path:

[GitHub] [spark] viirya commented on a change in pull request #24806: [SPARK-27856][SQL] Only allow type upcasting when inserting table

viirya commented on a change in pull request #24806: [SPARK-27856][SQL] Only allow type upcasting when inserting table URL: https://github.com/apache/spark/pull/24806#discussion_r291441249 ## File path:

[GitHub] [spark] viirya commented on a change in pull request #24806: [SPARK-27856][SQL] Only allow type upcasting when inserting table

viirya commented on a change in pull request #24806: [SPARK-27856][SQL] Only allow type upcasting when inserting table URL: https://github.com/apache/spark/pull/24806#discussion_r291440948 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/rules.scala

[GitHub] [spark] SparkQA commented on issue #24815: [SPARK-27961][SQL] DataSourceV2Relation should not have refresh method

SparkQA commented on issue #24815: [SPARK-27961][SQL] DataSourceV2Relation should not have refresh method URL: https://github.com/apache/spark/pull/24815#issuecomment-499762010 **[Test build #106267 has

[GitHub] [spark] SparkQA commented on issue #24688: [SPARK-27970][SQL] Support Hive 3.0 metastore

SparkQA commented on issue #24688: [SPARK-27970][SQL] Support Hive 3.0 metastore URL: https://github.com/apache/spark/pull/24688#issuecomment-499762009 **[Test build #106268 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106268/testReport)** for PR 24688

[GitHub] [spark] wangyum commented on a change in pull request #24688: [SPARK-27970][SQL] Support Hive 3.0 metastore

wangyum commented on a change in pull request #24688: [SPARK-27970][SQL] Support Hive 3.0 metastore URL: https://github.com/apache/spark/pull/24688#discussion_r291456525 ## File path: docs/sql-data-sources-hive-tables.md ## @@ -130,7 +130,7 @@ The following options can be

[GitHub] [spark] HyukjinKwon commented on issue #24788: s390x specific changes

HyukjinKwon commented on issue #24788: s390x specific changes URL: https://github.com/apache/spark/pull/24788#issuecomment-499762117 If that's the exact same problem, please link that JIRA to the PR title (see https://spark.apache.org/contributing.html). Also, please clarify why

[GitHub] [spark] ketank-new commented on issue #24788: [SPARK-26985] [core]

ketank-new commented on issue #24788: [SPARK-26985] [core] URL: https://github.com/apache/spark/pull/24788#issuecomment-499766766 > If that's the exact same problem, please link that JIRA to the PR title (see https://spark.apache.org/contributing.html). Linked by changing the Title

[GitHub] [spark] SparkQA removed a comment on issue #24816: [SPARK-27968] ArrowEvalPythonExec.evaluate shouldn't eagerly read the first row

SparkQA removed a comment on issue #24816: [SPARK-27968] ArrowEvalPythonExec.evaluate shouldn't eagerly read the first row URL: https://github.com/apache/spark/pull/24816#issuecomment-499625781 **[Test build #106253 has

[GitHub] [spark] SparkQA commented on issue #24816: [SPARK-27968] ArrowEvalPythonExec.evaluate shouldn't eagerly read the first row

SparkQA commented on issue #24816: [SPARK-27968] ArrowEvalPythonExec.evaluate shouldn't eagerly read the first row URL: https://github.com/apache/spark/pull/24816#issuecomment-499684830 **[Test build #106253 has

[GitHub] [spark] vanzin commented on a change in pull request #24554: [SPARK-27622][Core] Avoiding the network when block manager fetches disk persisted RDD blocks from the same host

vanzin commented on a change in pull request #24554: [SPARK-27622][Core] Avoiding the network when block manager fetches disk persisted RDD blocks from the same host URL: https://github.com/apache/spark/pull/24554#discussion_r291390072 ## File path:

[GitHub] [spark] vanzin commented on a change in pull request #24554: [SPARK-27622][Core] Avoiding the network when block manager fetches disk persisted RDD blocks from the same host

vanzin commented on a change in pull request #24554: [SPARK-27622][Core] Avoiding the network when block manager fetches disk persisted RDD blocks from the same host URL: https://github.com/apache/spark/pull/24554#discussion_r291384329 ## File path:

[GitHub] [spark] vanzin commented on a change in pull request #24554: [SPARK-27622][Core] Avoiding the network when block manager fetches disk persisted RDD blocks from the same host

vanzin commented on a change in pull request #24554: [SPARK-27622][Core] Avoiding the network when block manager fetches disk persisted RDD blocks from the same host URL: https://github.com/apache/spark/pull/24554#discussion_r291385871 ## File path:

[GitHub] [spark] dongjoon-hyun commented on issue #24817: [WIP][SPARK-27963][core] Allow dynamic allocation without a shuffle service.

dongjoon-hyun commented on issue #24817: [WIP][SPARK-27963][core] Allow dynamic allocation without a shuffle service. URL: https://github.com/apache/spark/pull/24817#issuecomment-499686687 cc @dbtsai This is an automated

[GitHub] [spark] mccheah commented on a change in pull request #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2

mccheah commented on a change in pull request #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2 URL: https://github.com/apache/spark/pull/24798#discussion_r291395947 ## File path:

[GitHub] [spark] gatorsmile commented on issue #20303: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL

gatorsmile commented on issue #20303: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/20303#issuecomment-499691971 @jerrychenhf This https://github.com/apache/spark/pull/24706 is to implement a framework for adaptive query

[GitHub] [spark] mccheah commented on a change in pull request #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2

mccheah commented on a change in pull request #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2 URL: https://github.com/apache/spark/pull/24798#discussion_r291396403 ## File path:

[GitHub] [spark] mccheah commented on a change in pull request #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2

mccheah commented on a change in pull request #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2 URL: https://github.com/apache/spark/pull/24798#discussion_r291396454 ## File path:

[GitHub] [spark] mccheah commented on a change in pull request #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2

mccheah commented on a change in pull request #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2 URL: https://github.com/apache/spark/pull/24798#discussion_r291396043 ## File path:

[GitHub] [spark] SparkQA commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

SparkQA commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-499692807 **[Test build #106254 has

[GitHub] [spark] AmplabJenkins commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

AmplabJenkins commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-499693211 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

AmplabJenkins commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-499693217 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

SparkQA removed a comment on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-499634293 **[Test build #106254 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

AmplabJenkins removed a comment on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-499693211 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

AmplabJenkins removed a comment on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-499693217 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #24817: [WIP][SPARK-27963][core] Allow dynamic allocation without a shuffle service.

SparkQA commented on issue #24817: [WIP][SPARK-27963][core] Allow dynamic allocation without a shuffle service. URL: https://github.com/apache/spark/pull/24817#issuecomment-499694020 **[Test build #106259 has

[GitHub] [spark] SparkQA removed a comment on issue #24817: [WIP][SPARK-27963][core] Allow dynamic allocation without a shuffle service.

SparkQA removed a comment on issue #24817: [WIP][SPARK-27963][core] Allow dynamic allocation without a shuffle service. URL: https://github.com/apache/spark/pull/24817#issuecomment-49906 **[Test build #106259 has

[GitHub] [spark] mengxr commented on a change in pull request #24643: [SPARK-26412][PySpark][SQL][WIP] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series

mengxr commented on a change in pull request #24643: [SPARK-26412][PySpark][SQL][WIP] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series URL: https://github.com/apache/spark/pull/24643#discussion_r291398385 ## File path:

[GitHub] [spark] mengxr commented on a change in pull request #24643: [SPARK-26412][PySpark][SQL][WIP] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series

mengxr commented on a change in pull request #24643: [SPARK-26412][PySpark][SQL][WIP] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series URL: https://github.com/apache/spark/pull/24643#discussion_r291395710 ## File path: python/pyspark/worker.py

[GitHub] [spark] AmplabJenkins removed a comment on issue #24817: [WIP][SPARK-27963][core] Allow dynamic allocation without a shuffle service.

AmplabJenkins removed a comment on issue #24817: [WIP][SPARK-27963][core] Allow dynamic allocation without a shuffle service. URL: https://github.com/apache/spark/pull/24817#issuecomment-499694221 Merged build finished. Test FAILed.

[GitHub] [spark] mengxr commented on a change in pull request #24643: [SPARK-26412][PySpark][SQL][WIP] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series

mengxr commented on a change in pull request #24643: [SPARK-26412][PySpark][SQL][WIP] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series URL: https://github.com/apache/spark/pull/24643#discussion_r291396018 ## File path: python/pyspark/worker.py

[GitHub] [spark] mengxr commented on a change in pull request #24643: [SPARK-26412][PySpark][SQL][WIP] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series

mengxr commented on a change in pull request #24643: [SPARK-26412][PySpark][SQL][WIP] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series URL: https://github.com/apache/spark/pull/24643#discussion_r291397336 ## File path: python/pyspark/worker.py

[GitHub] [spark] mengxr commented on a change in pull request #24643: [SPARK-26412][PySpark][SQL][WIP] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series

mengxr commented on a change in pull request #24643: [SPARK-26412][PySpark][SQL][WIP] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series URL: https://github.com/apache/spark/pull/24643#discussion_r291393543 ## File path: python/pyspark/worker.py

[GitHub] [spark] AmplabJenkins commented on issue #24817: [WIP][SPARK-27963][core] Allow dynamic allocation without a shuffle service.

AmplabJenkins commented on issue #24817: [WIP][SPARK-27963][core] Allow dynamic allocation without a shuffle service. URL: https://github.com/apache/spark/pull/24817#issuecomment-499694245 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] mengxr commented on a change in pull request #24643: [SPARK-26412][PySpark][SQL][WIP] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series

mengxr commented on a change in pull request #24643: [SPARK-26412][PySpark][SQL][WIP] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series URL: https://github.com/apache/spark/pull/24643#discussion_r291397901 ## File path:

[GitHub] [spark] mengxr commented on a change in pull request #24643: [SPARK-26412][PySpark][SQL][WIP] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series

mengxr commented on a change in pull request #24643: [SPARK-26412][PySpark][SQL][WIP] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series URL: https://github.com/apache/spark/pull/24643#discussion_r291397465 ## File path: python/pyspark/worker.py

[GitHub] [spark] AmplabJenkins commented on issue #24817: [WIP][SPARK-27963][core] Allow dynamic allocation without a shuffle service.

AmplabJenkins commented on issue #24817: [WIP][SPARK-27963][core] Allow dynamic allocation without a shuffle service. URL: https://github.com/apache/spark/pull/24817#issuecomment-499694221 Merged build finished. Test FAILed.

[GitHub] [spark] mengxr commented on a change in pull request #24643: [SPARK-26412][PySpark][SQL][WIP] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series

mengxr commented on a change in pull request #24643: [SPARK-26412][PySpark][SQL][WIP] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series URL: https://github.com/apache/spark/pull/24643#discussion_r291393738 ## File path: python/pyspark/worker.py

[GitHub] [spark] gatorsmile commented on issue #24688: [SPARK-26145][SQL] Support Hive 3.0 metastore

gatorsmile commented on issue #24688: [SPARK-26145][SQL] Support Hive 3.0 metastore URL: https://github.com/apache/spark/pull/24688#issuecomment-499694877 @dongjoon-hyun Do you have any concern about the quality of Hive 3.0 metastore? I think the end users should take their own risk when

[GitHub] [spark] AmplabJenkins removed a comment on issue #24817: [WIP][SPARK-27963][core] Allow dynamic allocation without a shuffle service.

AmplabJenkins removed a comment on issue #24817: [WIP][SPARK-27963][core] Allow dynamic allocation without a shuffle service. URL: https://github.com/apache/spark/pull/24817#issuecomment-499694245 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] gatorsmile commented on a change in pull request #24688: [SPARK-26145][SQL] Support Hive 3.0 metastore

gatorsmile commented on a change in pull request #24688: [SPARK-26145][SQL] Support Hive 3.0 metastore URL: https://github.com/apache/spark/pull/24688#discussion_r291398948 ## File path: docs/sql-data-sources-hive-tables.md ## @@ -130,7 +130,7 @@ The following options can

[GitHub] [spark] mengxr commented on issue #24816: [SPARK-27968] ArrowEvalPythonExec.evaluate shouldn't eagerly read the first row

mengxr commented on issue #24816: [SPARK-27968] ArrowEvalPythonExec.evaluate shouldn't eagerly read the first row URL: https://github.com/apache/spark/pull/24816#issuecomment-499695438 The change was reviewed by @BryanCutler at

[GitHub] [spark] asfgit closed pull request #24816: [SPARK-27968] ArrowEvalPythonExec.evaluate shouldn't eagerly read the first row

asfgit closed pull request #24816: [SPARK-27968] ArrowEvalPythonExec.evaluate shouldn't eagerly read the first row URL: https://github.com/apache/spark/pull/24816 This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on issue #24734: [SPARK-27870][SQL][PySpark] Flush batch timely for pandas UDF (for improving pandas UDFs pipeline)

AmplabJenkins commented on issue #24734: [SPARK-27870][SQL][PySpark] Flush batch timely for pandas UDF (for improving pandas UDFs pipeline) URL: https://github.com/apache/spark/pull/24734#issuecomment-499696726 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24734: [SPARK-27870][SQL][PySpark] Flush batch timely for pandas UDF (for improving pandas UDFs pipeline)

AmplabJenkins removed a comment on issue #24734: [SPARK-27870][SQL][PySpark] Flush batch timely for pandas UDF (for improving pandas UDFs pipeline) URL: https://github.com/apache/spark/pull/24734#issuecomment-499696726 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24734: [SPARK-27870][SQL][PySpark] Flush batch timely for pandas UDF (for improving pandas UDFs pipeline)

AmplabJenkins commented on issue #24734: [SPARK-27870][SQL][PySpark] Flush batch timely for pandas UDF (for improving pandas UDFs pipeline) URL: https://github.com/apache/spark/pull/24734#issuecomment-499696731 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #24734: [SPARK-27870][SQL][PySpark] Flush batch timely for pandas UDF (for improving pandas UDFs pipeline)

AmplabJenkins removed a comment on issue #24734: [SPARK-27870][SQL][PySpark] Flush batch timely for pandas UDF (for improving pandas UDFs pipeline) URL: https://github.com/apache/spark/pull/24734#issuecomment-499696731 Test PASSed. Refer to this link for build results (access rights to

[GitHub] [spark] SparkQA commented on issue #24734: [SPARK-27870][SQL][PySpark] Flush batch timely for pandas UDF (for improving pandas UDFs pipeline)

SparkQA commented on issue #24734: [SPARK-27870][SQL][PySpark] Flush batch timely for pandas UDF (for improving pandas UDFs pipeline) URL: https://github.com/apache/spark/pull/24734#issuecomment-499697138 **[Test build #106262 has

[GitHub] [spark] rdblue commented on a change in pull request #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2

rdblue commented on a change in pull request #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2 URL: https://github.com/apache/spark/pull/24798#discussion_r291404511 ## File path:

[GitHub] [spark] rdblue commented on a change in pull request #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2

rdblue commented on a change in pull request #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2 URL: https://github.com/apache/spark/pull/24798#discussion_r291404335 ## File path:

[GitHub] [spark] rdblue commented on a change in pull request #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2

rdblue commented on a change in pull request #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2 URL: https://github.com/apache/spark/pull/24798#discussion_r291405015 ## File path:

[GitHub] [spark] rdblue commented on a change in pull request #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2

rdblue commented on a change in pull request #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2 URL: https://github.com/apache/spark/pull/24798#discussion_r291404655 ## File path:

[GitHub] [spark] rdblue commented on a change in pull request #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2

rdblue commented on a change in pull request #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2 URL: https://github.com/apache/spark/pull/24798#discussion_r291405527 ## File path:

[GitHub] [spark] rdblue commented on a change in pull request #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2

rdblue commented on a change in pull request #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2 URL: https://github.com/apache/spark/pull/24798#discussion_r291407083 ## File path:

[GitHub] [spark] SparkQA removed a comment on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

SparkQA removed a comment on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-499644558 **[Test build #106257 has

[GitHub] [spark] SparkQA commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

SparkQA commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-499703275 **[Test build #106257 has

[GitHub] [spark] rdblue commented on a change in pull request #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2

rdblue commented on a change in pull request #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2 URL: https://github.com/apache/spark/pull/24798#discussion_r291407852 ## File path:

[GitHub] [spark] rdblue commented on a change in pull request #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2

rdblue commented on a change in pull request #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2 URL: https://github.com/apache/spark/pull/24798#discussion_r291407510 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

AmplabJenkins removed a comment on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-499703679 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

AmplabJenkins commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-499703684 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

AmplabJenkins commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-499703679 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

AmplabJenkins removed a comment on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-499703684 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] rdblue commented on a change in pull request #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2

rdblue commented on a change in pull request #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2 URL: https://github.com/apache/spark/pull/24798#discussion_r291408644 ## File path:

[GitHub] [spark] rdblue commented on a change in pull request #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2

rdblue commented on a change in pull request #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2 URL: https://github.com/apache/spark/pull/24798#discussion_r291408818 ## File path:

[GitHub] [spark] rdblue commented on a change in pull request #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2

rdblue commented on a change in pull request #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2 URL: https://github.com/apache/spark/pull/24798#discussion_r291409228 ## File path:

[GitHub] [spark] rdblue commented on a change in pull request #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2

rdblue commented on a change in pull request #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2 URL: https://github.com/apache/spark/pull/24798#discussion_r291408818 ## File path:

[GitHub] [spark] rdblue commented on a change in pull request #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2

rdblue commented on a change in pull request #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2 URL: https://github.com/apache/spark/pull/24798#discussion_r291409729 ## File path:

[GitHub] [spark] rdblue commented on a change in pull request #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2

rdblue commented on a change in pull request #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2 URL: https://github.com/apache/spark/pull/24798#discussion_r291410079 ## File path:

[GitHub] [spark] SparkQA commented on issue #24784: [SPARK-27938][SQL] Remove feature flag LEGACY_PASS_PARTITION_BY_AS_OPTIONS

SparkQA commented on issue #24784: [SPARK-27938][SQL] Remove feature flag LEGACY_PASS_PARTITION_BY_AS_OPTIONS URL: https://github.com/apache/spark/pull/24784#issuecomment-499706408 **[Test build #106258 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24809: [WIP][SPARK-21136][SQL] Fix confusing parsing error due to problematic antlr grammer for Hive-style single-from statements

AmplabJenkins removed a comment on issue #24809: [WIP][SPARK-21136][SQL] Fix confusing parsing error due to problematic antlr grammer for Hive-style single-from statements URL: https://github.com/apache/spark/pull/24809#issuecomment-499393784 Test PASSed. Refer to this link for build

[GitHub] [spark] AmplabJenkins removed a comment on issue #24809: [WIP][SPARK-21136][SQL] Fix confusing parsing error due to problematic antlr grammer for Hive-style single-from statements

AmplabJenkins removed a comment on issue #24809: [WIP][SPARK-21136][SQL] Fix confusing parsing error due to problematic antlr grammer for Hive-style single-from statements URL: https://github.com/apache/spark/pull/24809#issuecomment-499393776 Merged build finished. Test PASSed.

[GitHub] [spark] WeichenXu123 commented on issue #24734: [SPARK-27870][SQL][PySpark] Flush batch timely for pandas UDF (for improving pandas UDFs pipeline)

WeichenXu123 commented on issue #24734: [SPARK-27870][SQL][PySpark] Flush batch timely for pandas UDF (for improving pandas UDFs pipeline) URL: https://github.com/apache/spark/pull/24734#issuecomment-499393942 @BryanCutler yes, I also consider about tuning "buffer size", but one of my

[GitHub] [spark] SparkQA commented on issue #24749: [SPARK-27890][SQL] Improve SQL parser error message for character-only identifier with hyphens except those in expressions

SparkQA commented on issue #24749: [SPARK-27890][SQL] Improve SQL parser error message for character-only identifier with hyphens except those in expressions URL: https://github.com/apache/spark/pull/24749#issuecomment-499397041 **[Test build #106235 has

[GitHub] [spark] AmplabJenkins commented on issue #24490: [SPARK-27300][GRAPH] Add Spark Graph modules and dependencies

AmplabJenkins commented on issue #24490: [SPARK-27300][GRAPH] Add Spark Graph modules and dependencies URL: https://github.com/apache/spark/pull/24490#issuecomment-499397323 Merged build finished. Test FAILed. This is an

<    1   2   3   4   5   6   7   >