[GitHub] [spark] AmplabJenkins commented on issue #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

2020-02-14 Thread GitBox
AmplabJenkins commented on issue #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource URL: https://github.com/apache/spark/pull/27366#issuecomment-586241118 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

2020-02-14 Thread GitBox
AmplabJenkins commented on issue #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource URL: https://github.com/apache/spark/pull/27366#issuecomment-586241164 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27478: [SPARK-25829][SQL] Add config `spark.sql.deduplicateMapKey.lastWinsPolicy.enabled` and change the default behavior

2020-02-14 Thread GitBox
AmplabJenkins commented on issue #27478: [SPARK-25829][SQL] Add config `spark.sql.deduplicateMapKey.lastWinsPolicy.enabled` and change the default behavior URL: https://github.com/apache/spark/pull/27478#issuecomment-586240967 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #27478: [SPARK-25829][SQL] Add config `spark.sql.deduplicateMapKey.lastWinsPolicy.enabled` and change the default behavior

2020-02-14 Thread GitBox
SparkQA commented on issue #27478: [SPARK-25829][SQL] Add config `spark.sql.deduplicateMapKey.lastWinsPolicy.enabled` and change the default behavior URL: https://github.com/apache/spark/pull/27478#issuecomment-586235313 **[Test build #118423 has

[GitHub] [spark] xuanyuanking commented on a change in pull request #27579: [SPARK-30829][SQL] Define LegacyBehaviorPolicy enumeration as the common value for result change configs

2020-02-14 Thread GitBox
xuanyuanking commented on a change in pull request #27579: [SPARK-30829][SQL] Define LegacyBehaviorPolicy enumeration as the common value for result change configs URL: https://github.com/apache/spark/pull/27579#discussion_r379385520 ## File path:

[GitHub] [spark] zero323 commented on issue #27571: [SPARK-30819][SPARKR][ML] Add FMRegressor wrapper to SparkR

2020-02-14 Thread GitBox
zero323 commented on issue #27571: [SPARK-30819][SPARKR][ML] Add FMRegressor wrapper to SparkR URL: https://github.com/apache/spark/pull/27571#issuecomment-586230212 Jenkins, retest this please. This is an automated message

[GitHub] [spark] xuanyuanking commented on issue #27478: [SPARK-25829][SQL] Add config `spark.sql.deduplicateMapKey.lastWinsPolicy.enabled` and change the default behavior

2020-02-14 Thread GitBox
xuanyuanking commented on issue #27478: [SPARK-25829][SQL] Add config `spark.sql.deduplicateMapKey.lastWinsPolicy.enabled` and change the default behavior URL: https://github.com/apache/spark/pull/27478#issuecomment-586224976 Thanks Gengliang, as the config still related to legacy

[GitHub] [spark] cloud-fan commented on a change in pull request #27574: [SPARK-30826][SQL] Respect reference case in `StringStartsWith` pushed down to parquet

2020-02-14 Thread GitBox
cloud-fan commented on a change in pull request #27574: [SPARK-30826][SQL] Respect reference case in `StringStartsWith` pushed down to parquet URL: https://github.com/apache/spark/pull/27574#discussion_r379377508 ## File path:

[GitHub] [spark] WeichenXu123 commented on a change in pull request #27565: [WIP][SPARK-30791][SQL][PYTHON] Add 'sameSemantics' and 'sementicHash' methods in Dataset

2020-02-14 Thread GitBox
WeichenXu123 commented on a change in pull request #27565: [WIP][SPARK-30791][SQL][PYTHON] Add 'sameSemantics' and 'sementicHash' methods in Dataset URL: https://github.com/apache/spark/pull/27565#discussion_r379374685 ## File path: python/pyspark/sql/dataframe.py ## @@

[GitHub] [spark] AmplabJenkins commented on issue #27565: [WIP][SPARK-30791][SQL][PYTHON] Add 'sameSemantics' and 'sementicHash' methods in Dataset

2020-02-14 Thread GitBox
AmplabJenkins commented on issue #27565: [WIP][SPARK-30791][SQL][PYTHON] Add 'sameSemantics' and 'sementicHash' methods in Dataset URL: https://github.com/apache/spark/pull/27565#issuecomment-586215401 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27572: [SPARK-30825][SQL][DOC] Update documents information for window function.

2020-02-14 Thread GitBox
AmplabJenkins commented on issue #27572: [SPARK-30825][SQL][DOC] Update documents information for window function. URL: https://github.com/apache/spark/pull/27572#issuecomment-586215331 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27565: [WIP][SPARK-30791][SQL][PYTHON] Add 'sameSemantics' and 'sementicHash' methods in Dataset

2020-02-14 Thread GitBox
AmplabJenkins commented on issue #27565: [WIP][SPARK-30791][SQL][PYTHON] Add 'sameSemantics' and 'sementicHash' methods in Dataset URL: https://github.com/apache/spark/pull/27565#issuecomment-586215408 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #27565: [WIP][SPARK-30791][SQL][PYTHON] Add 'sameSemantics' and 'sementicHash' methods in Dataset

2020-02-14 Thread GitBox
AmplabJenkins removed a comment on issue #27565: [WIP][SPARK-30791][SQL][PYTHON] Add 'sameSemantics' and 'sementicHash' methods in Dataset URL: https://github.com/apache/spark/pull/27565#issuecomment-586215401 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27565: [WIP][SPARK-30791][SQL][PYTHON] Add 'sameSemantics' and 'sementicHash' methods in Dataset

2020-02-14 Thread GitBox
AmplabJenkins removed a comment on issue #27565: [WIP][SPARK-30791][SQL][PYTHON] Add 'sameSemantics' and 'sementicHash' methods in Dataset URL: https://github.com/apache/spark/pull/27565#issuecomment-586215408 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #27572: [SPARK-30825][SQL][DOC] Update documents information for window function.

2020-02-14 Thread GitBox
AmplabJenkins commented on issue #27572: [SPARK-30825][SQL][DOC] Update documents information for window function. URL: https://github.com/apache/spark/pull/27572#issuecomment-586215321 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #27565: [WIP][SPARK-30791][SQL][PYTHON] Add 'sameSemantics' and 'sementicHash' methods in Dataset

2020-02-14 Thread GitBox
SparkQA commented on issue #27565: [WIP][SPARK-30791][SQL][PYTHON] Add 'sameSemantics' and 'sementicHash' methods in Dataset URL: https://github.com/apache/spark/pull/27565#issuecomment-586214562 **[Test build #118421 has

[GitHub] [spark] SparkQA commented on issue #27572: [SPARK-30825][SQL][DOC] Update documents information for window function.

2020-02-14 Thread GitBox
SparkQA commented on issue #27572: [SPARK-30825][SQL][DOC] Update documents information for window function. URL: https://github.com/apache/spark/pull/27572#issuecomment-586214528 **[Test build #118420 has

[GitHub] [spark] SparkQA commented on issue #27550: [SPARK-30799][SQL] "spark_catalog.t" should not be resolved to temp view

2020-02-14 Thread GitBox
SparkQA commented on issue #27550: [SPARK-30799][SQL] "spark_catalog.t" should not be resolved to temp view URL: https://github.com/apache/spark/pull/27550#issuecomment-586214553 **[Test build #118422 has

[GitHub] [spark] WeichenXu123 commented on a change in pull request #27565: [WIP][SPARK-30791][SQL][PYTHON] Add 'sameSemantics' and 'sementicHash' methods in Dataset

2020-02-14 Thread GitBox
WeichenXu123 commented on a change in pull request #27565: [WIP][SPARK-30791][SQL][PYTHON] Add 'sameSemantics' and 'sementicHash' methods in Dataset URL: https://github.com/apache/spark/pull/27565#discussion_r379374685 ## File path: python/pyspark/sql/dataframe.py ## @@

[GitHub] [spark] AmplabJenkins removed a comment on issue #27577: [DOC] add config naming guideline

2020-02-14 Thread GitBox
AmplabJenkins removed a comment on issue #27577: [DOC] add config naming guideline URL: https://github.com/apache/spark/pull/27577#issuecomment-586213500 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27577: [DOC] add config naming guideline

2020-02-14 Thread GitBox
AmplabJenkins removed a comment on issue #27577: [DOC] add config naming guideline URL: https://github.com/apache/spark/pull/27577#issuecomment-586213487 Merged build finished. Test PASSed. This is an automated message from

[GitHub] [spark] beliefer commented on issue #27572: [SPARK-30825][SQL][DOC] Update documents information for window function.

2020-02-14 Thread GitBox
beliefer commented on issue #27572: [SPARK-30825][SQL][DOC] Update documents information for window function. URL: https://github.com/apache/spark/pull/27572#issuecomment-586213423 retest this please This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #27577: [DOC] add config naming guideline

2020-02-14 Thread GitBox
AmplabJenkins commented on issue #27577: [DOC] add config naming guideline URL: https://github.com/apache/spark/pull/27577#issuecomment-586213500 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27577: [DOC] add config naming guideline

2020-02-14 Thread GitBox
AmplabJenkins commented on issue #27577: [DOC] add config naming guideline URL: https://github.com/apache/spark/pull/27577#issuecomment-586213487 Merged build finished. Test PASSed. This is an automated message from the

[GitHub] [spark] SparkQA removed a comment on issue #27577: [DOC] add config naming guideline

2020-02-14 Thread GitBox
SparkQA removed a comment on issue #27577: [DOC] add config naming guideline URL: https://github.com/apache/spark/pull/27577#issuecomment-586150981 **[Test build #118404 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/118404/testReport)** for PR 27577 at

[GitHub] [spark] cloud-fan commented on a change in pull request #27550: [SPARK-30799][SQL] "spark_catalog.t" should not be resolved to temp view

2020-02-14 Thread GitBox
cloud-fan commented on a change in pull request #27550: [SPARK-30799][SQL] "spark_catalog.t" should not be resolved to temp view URL: https://github.com/apache/spark/pull/27550#discussion_r379233286 ## File path:

[GitHub] [spark] SparkQA commented on issue #27577: [DOC] add config naming guideline

2020-02-14 Thread GitBox
SparkQA commented on issue #27577: [DOC] add config naming guideline URL: https://github.com/apache/spark/pull/27577#issuecomment-586212290 **[Test build #118404 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/118404/testReport)** for PR 27577 at commit

[GitHub] [spark] cloud-fan commented on a change in pull request #27550: [SPARK-30799][SQL] "spark_catalog.t" should not be resolved to temp view

2020-02-14 Thread GitBox
cloud-fan commented on a change in pull request #27550: [SPARK-30799][SQL] "spark_catalog.t" should not be resolved to temp view URL: https://github.com/apache/spark/pull/27550#discussion_r379371879 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #27550: [SPARK-30799][SQL] "spark_catalog.t" should not be resolved to temp view

2020-02-14 Thread GitBox
AmplabJenkins commented on issue #27550: [SPARK-30799][SQL] "spark_catalog.t" should not be resolved to temp view URL: https://github.com/apache/spark/pull/27550#issuecomment-586210853 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27550: [SPARK-30799][SQL] "spark_catalog.t" should not be resolved to temp view

2020-02-14 Thread GitBox
AmplabJenkins removed a comment on issue #27550: [SPARK-30799][SQL] "spark_catalog.t" should not be resolved to temp view URL: https://github.com/apache/spark/pull/27550#issuecomment-586210843 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27550: [SPARK-30799][SQL] "spark_catalog.t" should not be resolved to temp view

2020-02-14 Thread GitBox
AmplabJenkins removed a comment on issue #27550: [SPARK-30799][SQL] "spark_catalog.t" should not be resolved to temp view URL: https://github.com/apache/spark/pull/27550#issuecomment-586210853 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27550: [SPARK-30799][SQL] "spark_catalog.t" should not be resolved to temp view

2020-02-14 Thread GitBox
AmplabJenkins commented on issue #27550: [SPARK-30799][SQL] "spark_catalog.t" should not be resolved to temp view URL: https://github.com/apache/spark/pull/27550#issuecomment-586210843 Merged build finished. Test PASSed.

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27565: [WIP][SPARK-30791][SQL][PYTHON] Add 'sameSemantics' and 'sementicHash' methods in Dataset

2020-02-14 Thread GitBox
HyukjinKwon commented on a change in pull request #27565: [WIP][SPARK-30791][SQL][PYTHON] Add 'sameSemantics' and 'sementicHash' methods in Dataset URL: https://github.com/apache/spark/pull/27565#discussion_r379368127 ## File path: python/pyspark/sql/dataframe.py ## @@

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27565: [WIP][SPARK-30791][SQL][PYTHON] Add 'sameSemantics' and 'sementicHash' methods in Dataset

2020-02-14 Thread GitBox
HyukjinKwon commented on a change in pull request #27565: [WIP][SPARK-30791][SQL][PYTHON] Add 'sameSemantics' and 'sementicHash' methods in Dataset URL: https://github.com/apache/spark/pull/27565#discussion_r379367247 ## File path: python/pyspark/sql/dataframe.py ## @@

[GitHub] [spark] liangz1 commented on a change in pull request #27565: [WIP][SPARK-30791][SQL][PYTHON] Add 'sameSemantics' and 'sementicHash' methods in Dataset

2020-02-14 Thread GitBox
liangz1 commented on a change in pull request #27565: [WIP][SPARK-30791][SQL][PYTHON] Add 'sameSemantics' and 'sementicHash' methods in Dataset URL: https://github.com/apache/spark/pull/27565#discussion_r379364408 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy

2020-02-14 Thread GitBox
AmplabJenkins removed a comment on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy URL: https://github.com/apache/spark/pull/27563#issuecomment-586205592 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy

2020-02-14 Thread GitBox
AmplabJenkins removed a comment on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy URL: https://github.com/apache/spark/pull/27563#issuecomment-586205602 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy

2020-02-14 Thread GitBox
AmplabJenkins commented on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy URL: https://github.com/apache/spark/pull/27563#issuecomment-586205602 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy

2020-02-14 Thread GitBox
AmplabJenkins commented on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy URL: https://github.com/apache/spark/pull/27563#issuecomment-586205592 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy

2020-02-14 Thread GitBox
SparkQA removed a comment on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy URL: https://github.com/apache/spark/pull/27563#issuecomment-586146035 **[Test build #118402 has

[GitHub] [spark] liangz1 commented on a change in pull request #27565: [WIP][SPARK-30791][SQL][PYTHON] Add 'sameSemantics' and 'sementicHash' methods in Dataset

2020-02-14 Thread GitBox
liangz1 commented on a change in pull request #27565: [WIP][SPARK-30791][SQL][PYTHON] Add 'sameSemantics' and 'sementicHash' methods in Dataset URL: https://github.com/apache/spark/pull/27565#discussion_r379362763 ## File path: python/pyspark/sql/dataframe.py ## @@

[GitHub] [spark] HyukjinKwon commented on issue #27561: [SPARK-30810][SQL] Parses and convert a CSV Dataset having different column from 'value' in csv(dataset) API

2020-02-14 Thread GitBox
HyukjinKwon commented on issue #27561: [SPARK-30810][SQL] Parses and convert a CSV Dataset having different column from 'value' in csv(dataset) API URL: https://github.com/apache/spark/pull/27561#issuecomment-586204573 Thanks!

[GitHub] [spark] liangz1 commented on a change in pull request #27565: [WIP][SPARK-30791][SQL][PYTHON] Add 'sameSemantics' and 'sementicHash' methods in Dataset

2020-02-14 Thread GitBox
liangz1 commented on a change in pull request #27565: [WIP][SPARK-30791][SQL][PYTHON] Add 'sameSemantics' and 'sementicHash' methods in Dataset URL: https://github.com/apache/spark/pull/27565#discussion_r379362550 ## File path: python/pyspark/sql/dataframe.py ## @@

[GitHub] [spark] SparkQA commented on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy

2020-02-14 Thread GitBox
SparkQA commented on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy URL: https://github.com/apache/spark/pull/27563#issuecomment-586204139 **[Test build #118402 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27565: [WIP][SPARK-30791][SQL][PYTHON] Add 'sameSemantics' and 'sementicHash' methods in Dataset

2020-02-14 Thread GitBox
AmplabJenkins removed a comment on issue #27565: [WIP][SPARK-30791][SQL][PYTHON] Add 'sameSemantics' and 'sementicHash' methods in Dataset URL: https://github.com/apache/spark/pull/27565#issuecomment-586203267 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #27565: [WIP][SPARK-30791][SQL][PYTHON] Add 'sameSemantics' and 'sementicHash' methods in Dataset

2020-02-14 Thread GitBox
AmplabJenkins removed a comment on issue #27565: [WIP][SPARK-30791][SQL][PYTHON] Add 'sameSemantics' and 'sementicHash' methods in Dataset URL: https://github.com/apache/spark/pull/27565#issuecomment-586203260 Build finished. Test PASSed.

[GitHub] [spark] HyukjinKwon commented on issue #27565: [WIP][SPARK-30791] Dataframe add sameSemantics and sementicHash method

2020-02-14 Thread GitBox
HyukjinKwon commented on issue #27565: [WIP][SPARK-30791] Dataframe add sameSemantics and sementicHash method URL: https://github.com/apache/spark/pull/27565#issuecomment-586203075 @liangz1 seems your branch here is not synced against the current master. You should probably rebase or

[GitHub] [spark] AmplabJenkins commented on issue #27565: [WIP][SPARK-30791] Dataframe add sameSemantics and sementicHash method

2020-02-14 Thread GitBox
AmplabJenkins commented on issue #27565: [WIP][SPARK-30791] Dataframe add sameSemantics and sementicHash method URL: https://github.com/apache/spark/pull/27565#issuecomment-586203260 Build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #27565: [WIP][SPARK-30791] Dataframe add sameSemantics and sementicHash method

2020-02-14 Thread GitBox
AmplabJenkins commented on issue #27565: [WIP][SPARK-30791] Dataframe add sameSemantics and sementicHash method URL: https://github.com/apache/spark/pull/27565#issuecomment-586203267 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #27565: [WIP][SPARK-30791] Dataframe add sameSemantics and sementicHash method

2020-02-14 Thread GitBox
SparkQA commented on issue #27565: [WIP][SPARK-30791] Dataframe add sameSemantics and sementicHash method URL: https://github.com/apache/spark/pull/27565#issuecomment-586202370 **[Test build #118419 has

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27565: [WIP][SPARK-30791] Dataframe add sameSemantics and sementicHash method

2020-02-14 Thread GitBox
HyukjinKwon commented on a change in pull request #27565: [WIP][SPARK-30791] Dataframe add sameSemantics and sementicHash method URL: https://github.com/apache/spark/pull/27565#discussion_r379359352 ## File path: python/pyspark/sql/dataframe.py ## @@ -2153,6 +2153,45 @@

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27565: [WIP][SPARK-30791] Dataframe add sameSemantics and sementicHash method

2020-02-14 Thread GitBox
HyukjinKwon commented on a change in pull request #27565: [WIP][SPARK-30791] Dataframe add sameSemantics and sementicHash method URL: https://github.com/apache/spark/pull/27565#discussion_r379358950 ## File path: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27565: [WIP][SPARK-30791] Dataframe add sameSemantics and sementicHash method

2020-02-14 Thread GitBox
HyukjinKwon commented on a change in pull request #27565: [WIP][SPARK-30791] Dataframe add sameSemantics and sementicHash method URL: https://github.com/apache/spark/pull/27565#discussion_r379356166 ## File path: python/pyspark/sql/dataframe.py ## @@ -2153,6 +2153,45 @@

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27565: [WIP][SPARK-30791] Dataframe add sameSemantics and sementicHash method

2020-02-14 Thread GitBox
HyukjinKwon commented on a change in pull request #27565: [WIP][SPARK-30791] Dataframe add sameSemantics and sementicHash method URL: https://github.com/apache/spark/pull/27565#discussion_r379354632 ## File path: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala

[GitHub] [spark] cloud-fan closed pull request #27561: [SPARK-30810][SQL] Parses and convert a CSV Dataset having different column from 'value' in csv(dataset) API

2020-02-14 Thread GitBox
cloud-fan closed pull request #27561: [SPARK-30810][SQL] Parses and convert a CSV Dataset having different column from 'value' in csv(dataset) API URL: https://github.com/apache/spark/pull/27561 This is an automated message

[GitHub] [spark] cloud-fan commented on issue #27561: [SPARK-30810][SQL] Parses and convert a CSV Dataset having different column from 'value' in csv(dataset) API

2020-02-14 Thread GitBox
cloud-fan commented on issue #27561: [SPARK-30810][SQL] Parses and convert a CSV Dataset having different column from 'value' in csv(dataset) API URL: https://github.com/apache/spark/pull/27561#issuecomment-586196442 LGTM, merging to master/3.0!

[GitHub] [spark] AmplabJenkins removed a comment on issue #27565: [WIP][SPARK-30791] Dataframe add sameSemantics and sementicHash method

2020-02-14 Thread GitBox
AmplabJenkins removed a comment on issue #27565: [WIP][SPARK-30791] Dataframe add sameSemantics and sementicHash method URL: https://github.com/apache/spark/pull/27565#issuecomment-586193899 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27565: [WIP][SPARK-30791] Dataframe add sameSemantics and sementicHash method

2020-02-14 Thread GitBox
AmplabJenkins removed a comment on issue #27565: [WIP][SPARK-30791] Dataframe add sameSemantics and sementicHash method URL: https://github.com/apache/spark/pull/27565#issuecomment-586193885 Build finished. Test FAILed. This

[GitHub] [spark] SparkQA commented on issue #27565: [WIP][SPARK-30791] Dataframe add sameSemantics and sementicHash method

2020-02-14 Thread GitBox
SparkQA commented on issue #27565: [WIP][SPARK-30791] Dataframe add sameSemantics and sementicHash method URL: https://github.com/apache/spark/pull/27565#issuecomment-586193873 **[Test build #118417 has

[GitHub] [spark] AmplabJenkins commented on issue #27565: [WIP][SPARK-30791] Dataframe add sameSemantics and sementicHash method

2020-02-14 Thread GitBox
AmplabJenkins commented on issue #27565: [WIP][SPARK-30791] Dataframe add sameSemantics and sementicHash method URL: https://github.com/apache/spark/pull/27565#issuecomment-586193899 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27565: [WIP][SPARK-30791] Dataframe add sameSemantics and sementicHash method

2020-02-14 Thread GitBox
AmplabJenkins commented on issue #27565: [WIP][SPARK-30791] Dataframe add sameSemantics and sementicHash method URL: https://github.com/apache/spark/pull/27565#issuecomment-586193885 Build finished. Test FAILed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #27539: [SPARK-30786] [CORE] Fix Block replication failure propogation issue in BlockManager

2020-02-14 Thread GitBox
AmplabJenkins removed a comment on issue #27539: [SPARK-30786] [CORE] Fix Block replication failure propogation issue in BlockManager URL: https://github.com/apache/spark/pull/27539#issuecomment-586193708 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27539: [SPARK-30786] [CORE] Fix Block replication failure propogation issue in BlockManager

2020-02-14 Thread GitBox
AmplabJenkins commented on issue #27539: [SPARK-30786] [CORE] Fix Block replication failure propogation issue in BlockManager URL: https://github.com/apache/spark/pull/27539#issuecomment-586193708 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27539: [SPARK-30786] [CORE] Fix Block replication failure propogation issue in BlockManager

2020-02-14 Thread GitBox
AmplabJenkins commented on issue #27539: [SPARK-30786] [CORE] Fix Block replication failure propogation issue in BlockManager URL: https://github.com/apache/spark/pull/27539#issuecomment-586193720 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #27565: [WIP][SPARK-30791] Dataframe add sameSemantics and sementicHash method

2020-02-14 Thread GitBox
SparkQA removed a comment on issue #27565: [WIP][SPARK-30791] Dataframe add sameSemantics and sementicHash method URL: https://github.com/apache/spark/pull/27565#issuecomment-586192634 **[Test build #118417 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27539: [SPARK-30786] [CORE] Fix Block replication failure propogation issue in BlockManager

2020-02-14 Thread GitBox
AmplabJenkins removed a comment on issue #27539: [SPARK-30786] [CORE] Fix Block replication failure propogation issue in BlockManager URL: https://github.com/apache/spark/pull/27539#issuecomment-586193720 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] liangz1 commented on a change in pull request #27565: [WIP][SPARK-30791] Dataframe add sameSemantics and sementicHash method

2020-02-14 Thread GitBox
liangz1 commented on a change in pull request #27565: [WIP][SPARK-30791] Dataframe add sameSemantics and sementicHash method URL: https://github.com/apache/spark/pull/27565#discussion_r379349637 ## File path: python/pyspark/sql/dataframe.py ## @@ -2153,6 +2153,45 @@ def

[GitHub] [spark] SparkQA commented on issue #27577: [DOC] add config naming policy

2020-02-14 Thread GitBox
SparkQA commented on issue #27577: [DOC] add config naming policy URL: https://github.com/apache/spark/pull/27577#issuecomment-586192550 **[Test build #118416 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/118416/testReport)** for PR 27577 at commit

[GitHub] [spark] SparkQA commented on issue #27539: [SPARK-30786] [CORE] Fix Block replication failure propogation issue in BlockManager

2020-02-14 Thread GitBox
SparkQA commented on issue #27539: [SPARK-30786] [CORE] Fix Block replication failure propogation issue in BlockManager URL: https://github.com/apache/spark/pull/27539#issuecomment-586192549 **[Test build #118418 has

[GitHub] [spark] SparkQA commented on issue #27565: [WIP][SPARK-30791] Dataframe add sameSemantics and sementicHash method

2020-02-14 Thread GitBox
SparkQA commented on issue #27565: [WIP][SPARK-30791] Dataframe add sameSemantics and sementicHash method URL: https://github.com/apache/spark/pull/27565#issuecomment-586192634 **[Test build #118417 has

[GitHub] [spark] viirya commented on issue #27579: [SPARK-30829][SQL] Define LegacyBehaviorPolicy enumeration as the common value for result change configs

2020-02-14 Thread GitBox
viirya commented on issue #27579: [SPARK-30829][SQL] Define LegacyBehaviorPolicy enumeration as the common value for result change configs URL: https://github.com/apache/spark/pull/27579#issuecomment-586190532 +1 this is better.

[GitHub] [spark] viirya commented on a change in pull request #27579: [SPARK-30829][SQL] Define LegacyBehaviorPolicy enumeration as the common value for result change configs

2020-02-14 Thread GitBox
viirya commented on a change in pull request #27579: [SPARK-30829][SQL] Define LegacyBehaviorPolicy enumeration as the common value for result change configs URL: https://github.com/apache/spark/pull/27579#discussion_r379344993 ## File path:

[GitHub] [spark] kiszk commented on issue #27577: [DOC] add config naming policy

2020-02-14 Thread GitBox
kiszk commented on issue #27577: [DOC] add config naming policy URL: https://github.com/apache/spark/pull/27577#issuecomment-586189702 Looks good This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] viirya commented on a change in pull request #27579: [SPARK-30829][SQL] Define LegacyBehaviorPolicy enumeration as the common value for result change configs

2020-02-14 Thread GitBox
viirya commented on a change in pull request #27579: [SPARK-30829][SQL] Define LegacyBehaviorPolicy enumeration as the common value for result change configs URL: https://github.com/apache/spark/pull/27579#discussion_r379345161 ## File path:

[GitHub] [spark] viirya commented on a change in pull request #27579: [SPARK-30829][SQL] Define LegacyBehaviorPolicy enumeration as the common value for result change configs

2020-02-14 Thread GitBox
viirya commented on a change in pull request #27579: [SPARK-30829][SQL] Define LegacyBehaviorPolicy enumeration as the common value for result change configs URL: https://github.com/apache/spark/pull/27579#discussion_r379344993 ## File path:

[GitHub] [spark] cloud-fan commented on issue #27579: [SPARK-30829][SQL] Define LegacyBehaviorPolicy enumeration as the common value for result change configs

2020-02-14 Thread GitBox
cloud-fan commented on issue #27579: [SPARK-30829][SQL] Define LegacyBehaviorPolicy enumeration as the common value for result change configs URL: https://github.com/apache/spark/pull/27579#issuecomment-586188485 yea this looks clearer, +1

[GitHub] [spark] AmplabJenkins removed a comment on issue #27579: [SPARK-30829][SQL] Define LegacyBehaviorPolicy enumeration as the common value for result change configs

2020-02-14 Thread GitBox
AmplabJenkins removed a comment on issue #27579: [SPARK-30829][SQL] Define LegacyBehaviorPolicy enumeration as the common value for result change configs URL: https://github.com/apache/spark/pull/27579#issuecomment-586187945 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27577: [DOC] add config naming policy

2020-02-14 Thread GitBox
AmplabJenkins removed a comment on issue #27577: [DOC] add config naming policy URL: https://github.com/apache/spark/pull/27577#issuecomment-586187991 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27565: [WIP][SPARK-30791] Dataframe add sameSemantics and sementicHash method

2020-02-14 Thread GitBox
AmplabJenkins commented on issue #27565: [WIP][SPARK-30791] Dataframe add sameSemantics and sementicHash method URL: https://github.com/apache/spark/pull/27565#issuecomment-586188210 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27576: [SPARK-28869][DOCS][FOLLOWUP] Add direct relationship between configs for rolling event log

2020-02-14 Thread GitBox
AmplabJenkins commented on issue #27576: [SPARK-28869][DOCS][FOLLOWUP] Add direct relationship between configs for rolling event log URL: https://github.com/apache/spark/pull/27576#issuecomment-586187999 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27579: [SPARK-30829][SQL] Define LegacyBehaviorPolicy enumeration as the common value for result change configs

2020-02-14 Thread GitBox
AmplabJenkins commented on issue #27579: [SPARK-30829][SQL] Define LegacyBehaviorPolicy enumeration as the common value for result change configs URL: https://github.com/apache/spark/pull/27579#issuecomment-586187945 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27577: [DOC] add config naming policy

2020-02-14 Thread GitBox
AmplabJenkins commented on issue #27577: [DOC] add config naming policy URL: https://github.com/apache/spark/pull/27577#issuecomment-586187991 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27576: [SPARK-28869][DOCS][FOLLOWUP] Add direct relationship between configs for rolling event log

2020-02-14 Thread GitBox
AmplabJenkins removed a comment on issue #27576: [SPARK-28869][DOCS][FOLLOWUP] Add direct relationship between configs for rolling event log URL: https://github.com/apache/spark/pull/27576#issuecomment-586187999 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27579: [SPARK-30829][SQL] Define LegacyBehaviorPolicy enumeration as the common value for result change configs

2020-02-14 Thread GitBox
AmplabJenkins removed a comment on issue #27579: [SPARK-30829][SQL] Define LegacyBehaviorPolicy enumeration as the common value for result change configs URL: https://github.com/apache/spark/pull/27579#issuecomment-586187951 Test PASSed. Refer to this link for build results (access

[GitHub] [spark] AmplabJenkins commented on issue #27579: [SPARK-30829][SQL] Define LegacyBehaviorPolicy enumeration as the common value for result change configs

2020-02-14 Thread GitBox
AmplabJenkins commented on issue #27579: [SPARK-30829][SQL] Define LegacyBehaviorPolicy enumeration as the common value for result change configs URL: https://github.com/apache/spark/pull/27579#issuecomment-586187951 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #27565: [WIP][SPARK-30791] Dataframe add sameSemantics and sementicHash method

2020-02-14 Thread GitBox
AmplabJenkins commented on issue #27565: [WIP][SPARK-30791] Dataframe add sameSemantics and sementicHash method URL: https://github.com/apache/spark/pull/27565#issuecomment-586188200 Build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #27576: [SPARK-28869][DOCS][FOLLOWUP] Add direct relationship between configs for rolling event log

2020-02-14 Thread GitBox
AmplabJenkins removed a comment on issue #27576: [SPARK-28869][DOCS][FOLLOWUP] Add direct relationship between configs for rolling event log URL: https://github.com/apache/spark/pull/27576#issuecomment-586188012 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #27565: [WIP][SPARK-30791] Dataframe add sameSemantics and sementicHash method

2020-02-14 Thread GitBox
AmplabJenkins removed a comment on issue #27565: [WIP][SPARK-30791] Dataframe add sameSemantics and sementicHash method URL: https://github.com/apache/spark/pull/27565#issuecomment-586188210 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27577: [DOC] add config naming policy

2020-02-14 Thread GitBox
AmplabJenkins commented on issue #27577: [DOC] add config naming policy URL: https://github.com/apache/spark/pull/27577#issuecomment-586187982 Merged build finished. Test PASSed. This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins commented on issue #27576: [SPARK-28869][DOCS][FOLLOWUP] Add direct relationship between configs for rolling event log

2020-02-14 Thread GitBox
AmplabJenkins commented on issue #27576: [SPARK-28869][DOCS][FOLLOWUP] Add direct relationship between configs for rolling event log URL: https://github.com/apache/spark/pull/27576#issuecomment-586188012 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #27565: [WIP][SPARK-30791] Dataframe add sameSemantics and sementicHash method

2020-02-14 Thread GitBox
AmplabJenkins removed a comment on issue #27565: [WIP][SPARK-30791] Dataframe add sameSemantics and sementicHash method URL: https://github.com/apache/spark/pull/27565#issuecomment-586188200 Build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #27577: [DOC] add config naming policy

2020-02-14 Thread GitBox
AmplabJenkins removed a comment on issue #27577: [DOC] add config naming policy URL: https://github.com/apache/spark/pull/27577#issuecomment-586187982 Merged build finished. Test PASSed. This is an automated message from the

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27565: [WIP][SPARK-30791] Dataframe add sameSemantics and sementicHash method

2020-02-14 Thread GitBox
HyukjinKwon commented on a change in pull request #27565: [WIP][SPARK-30791] Dataframe add sameSemantics and sementicHash method URL: https://github.com/apache/spark/pull/27565#discussion_r379342918 ## File path: python/pyspark/sql/dataframe.py ## @@ -2153,6 +2153,45 @@

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27565: [WIP][SPARK-30791] Dataframe add sameSemantics and sementicHash method

2020-02-14 Thread GitBox
HyukjinKwon commented on a change in pull request #27565: [WIP][SPARK-30791] Dataframe add sameSemantics and sementicHash method URL: https://github.com/apache/spark/pull/27565#discussion_r379342918 ## File path: python/pyspark/sql/dataframe.py ## @@ -2153,6 +2153,45 @@

[GitHub] [spark] SparkQA commented on issue #27576: [SPARK-28869][DOCS][FOLLOWUP] Add direct relationship between configs for rolling event log

2020-02-14 Thread GitBox
SparkQA commented on issue #27576: [SPARK-28869][DOCS][FOLLOWUP] Add direct relationship between configs for rolling event log URL: https://github.com/apache/spark/pull/27576#issuecomment-586186841 **[Test build #118415 has

[GitHub] [spark] SparkQA commented on issue #27579: [SPARK-30829][SQL] Define LegacyBehaviorPolicy enumeration as the common value for result change configs

2020-02-14 Thread GitBox
SparkQA commented on issue #27579: [SPARK-30829][SQL] Define LegacyBehaviorPolicy enumeration as the common value for result change configs URL: https://github.com/apache/spark/pull/27579#issuecomment-586186789 **[Test build #118414 has

[GitHub] [spark] xuanyuanking commented on issue #27579: [SPARK-30829][SQL] Define LegacyBehaviorPolicy enumeration as the common value for result change configs

2020-02-14 Thread GitBox
xuanyuanking commented on issue #27579: [SPARK-30829][SQL] Define LegacyBehaviorPolicy enumeration as the common value for result change configs URL: https://github.com/apache/spark/pull/27579#issuecomment-586185277 cc @viirya @dongjoon-hyun @cloud-fan After further thinking, it's

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27576: [SPARK-28869][DOCS][FOLLOWUP] Add direct relationship between configs for rolling event log

2020-02-14 Thread GitBox
HyukjinKwon commented on a change in pull request #27576: [SPARK-28869][DOCS][FOLLOWUP] Add direct relationship between configs for rolling event log URL: https://github.com/apache/spark/pull/27576#discussion_r379339872 ## File path:

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27575: [SPARK-30827][DOCS] Document direct relationship among configurations in "spark.history.*" namespace

2020-02-14 Thread GitBox
HyukjinKwon commented on a change in pull request #27575: [SPARK-30827][DOCS] Document direct relationship among configurations in "spark.history.*" namespace URL: https://github.com/apache/spark/pull/27575#discussion_r379338701 ## File path: docs/monitoring.md ## @@

[GitHub] [spark] xuanyuanking opened a new pull request #27579: [SPARK-30829][SQL] Define LegacyBehaviorPolicy enumeration as the common value for result change configs

2020-02-14 Thread GitBox
xuanyuanking opened a new pull request #27579: [SPARK-30829][SQL] Define LegacyBehaviorPolicy enumeration as the common value for result change configs URL: https://github.com/apache/spark/pull/27579 ### What changes were proposed in this pull request? Define a new enumeration

<    3   4   5   6   7   8   9   10   >