[GitHub] [spark] AmplabJenkins removed a comment on issue #27561: [SPARK-30810][SQL] Parses and convert a CSV Dataset having different column from 'value' in csv(dataset) API

2020-02-13 Thread GitBox
AmplabJenkins removed a comment on issue #27561: [SPARK-30810][SQL] Parses and convert a CSV Dataset having different column from 'value' in csv(dataset) API URL: https://github.com/apache/spark/pull/27561#issuecomment-586072578 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27561: [SPARK-30810][SQL] Parses and convert a CSV Dataset having different column from 'value' in csv(dataset) API

2020-02-13 Thread GitBox
AmplabJenkins commented on issue #27561: [SPARK-30810][SQL] Parses and convert a CSV Dataset having different column from 'value' in csv(dataset) API URL: https://github.com/apache/spark/pull/27561#issuecomment-586072585 Test PASSed. Refer to this link for build results (access rights

[GitHub] [spark] AmplabJenkins commented on issue #27561: [SPARK-30810][SQL] Parses and convert a CSV Dataset having different column from 'value' in csv(dataset) API

2020-02-13 Thread GitBox
AmplabJenkins commented on issue #27561: [SPARK-30810][SQL] Parses and convert a CSV Dataset having different column from 'value' in csv(dataset) API URL: https://github.com/apache/spark/pull/27561#issuecomment-586072578 Merged build finished. Test PASSed.

[GitHub] [spark] cloud-fan commented on issue #24902: [SPARK-28093][SQL] Fix TRIM/LTRIM/RTRIM function parameter order issue

2020-02-13 Thread GitBox
cloud-fan commented on issue #24902: [SPARK-28093][SQL] Fix TRIM/LTRIM/RTRIM function parameter order issue URL: https://github.com/apache/spark/pull/24902#issuecomment-586072349 Thanks @marmbrus for pointing out that this is already discussed officially on the mailing list. I'm trying to

[GitHub] [spark] SparkQA commented on issue #27561: [SPARK-30810][SQL] Parses and convert a CSV Dataset having different column from 'value' in csv(dataset) API

2020-02-13 Thread GitBox
SparkQA commented on issue #27561: [SPARK-30810][SQL] Parses and convert a CSV Dataset having different column from 'value' in csv(dataset) API URL: https://github.com/apache/spark/pull/27561#issuecomment-586071737 **[Test build #118386 has

[GitHub] [spark] liangz1 commented on a change in pull request #27565: [SPARK-30791] Dataframe add sameSemantics and sementicHash method

2020-02-13 Thread GitBox
liangz1 commented on a change in pull request #27565: [SPARK-30791] Dataframe add sameSemantics and sementicHash method URL: https://github.com/apache/spark/pull/27565#discussion_r379226694 ## File path: python/pyspark/sql/dataframe.py ## @@ -2153,6 +2153,22 @@ def

[GitHub] [spark] liangz1 commented on a change in pull request #27565: [SPARK-30791] Dataframe add sameSemantics and sementicHash method

2020-02-13 Thread GitBox
liangz1 commented on a change in pull request #27565: [SPARK-30791] Dataframe add sameSemantics and sementicHash method URL: https://github.com/apache/spark/pull/27565#discussion_r379226303 ## File path: python/pyspark/sql/dataframe.py ## @@ -2153,6 +2153,22 @@ def

[GitHub] [spark] WeichenXu123 edited a comment on issue #27565: [SPARK-30791] Dataframe add sameSemantics and sementicHash method

2020-02-13 Thread GitBox
WeichenXu123 edited a comment on issue #27565: [SPARK-30791] Dataframe add sameSemantics and sementicHash method URL: https://github.com/apache/spark/pull/27565#issuecomment-586069714 @cloud-fan @HyukjinKwon Any comments ?

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27561: [SPARK-30810][SQL] Parses and convert a CSV Dataset having different column from 'value' in csv(dataset) API

2020-02-13 Thread GitBox
HyukjinKwon commented on a change in pull request #27561: [SPARK-30810][SQL] Parses and convert a CSV Dataset having different column from 'value' in csv(dataset) API URL: https://github.com/apache/spark/pull/27561#discussion_r379225857 ## File path:

[GitHub] [spark] WeichenXu123 commented on issue #27565: [SPARK-30791] Dataframe add sameSemantics and sementicHash method

2020-02-13 Thread GitBox
WeichenXu123 commented on issue #27565: [SPARK-30791] Dataframe add sameSemantics and sementicHash method URL: https://github.com/apache/spark/pull/27565#issuecomment-586069714 @cloud-fan Any comments ? This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #27565: [SPARK-30791] Dataframe add sameSemantics and sementicHash method

2020-02-13 Thread GitBox
AmplabJenkins removed a comment on issue #27565: [SPARK-30791] Dataframe add sameSemantics and sementicHash method URL: https://github.com/apache/spark/pull/27565#issuecomment-586069483 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27565: [SPARK-30791] Dataframe add sameSemantics and sementicHash method

2020-02-13 Thread GitBox
AmplabJenkins removed a comment on issue #27565: [SPARK-30791] Dataframe add sameSemantics and sementicHash method URL: https://github.com/apache/spark/pull/27565#issuecomment-586069480 Build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #27565: [SPARK-30791] Dataframe add sameSemantics and sementicHash method

2020-02-13 Thread GitBox
AmplabJenkins commented on issue #27565: [SPARK-30791] Dataframe add sameSemantics and sementicHash method URL: https://github.com/apache/spark/pull/27565#issuecomment-586069480 Build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #27565: [SPARK-30791] Dataframe add sameSemantics and sementicHash method

2020-02-13 Thread GitBox
AmplabJenkins commented on issue #27565: [SPARK-30791] Dataframe add sameSemantics and sementicHash method URL: https://github.com/apache/spark/pull/27565#issuecomment-586069483 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] WeichenXu123 commented on a change in pull request #27565: [SPARK-30791] Dataframe add sameSemantics and sementicHash method

2020-02-13 Thread GitBox
WeichenXu123 commented on a change in pull request #27565: [SPARK-30791] Dataframe add sameSemantics and sementicHash method URL: https://github.com/apache/spark/pull/27565#discussion_r379225187 ## File path: python/pyspark/sql/dataframe.py ## @@ -2153,6 +2153,22 @@ def

[GitHub] [spark] WeichenXu123 commented on a change in pull request #27565: [SPARK-30791] Dataframe add sameSemantics and sementicHash method

2020-02-13 Thread GitBox
WeichenXu123 commented on a change in pull request #27565: [SPARK-30791] Dataframe add sameSemantics and sementicHash method URL: https://github.com/apache/spark/pull/27565#discussion_r379225118 ## File path: python/pyspark/sql/dataframe.py ## @@ -2153,6 +2153,22 @@ def

[GitHub] [spark] SparkQA commented on issue #27565: [SPARK-30791] Dataframe add sameSemantics and sementicHash method

2020-02-13 Thread GitBox
SparkQA commented on issue #27565: [SPARK-30791] Dataframe add sameSemantics and sementicHash method URL: https://github.com/apache/spark/pull/27565#issuecomment-586068918 **[Test build #118385 has

[GitHub] [spark] AmplabJenkins commented on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

2020-02-13 Thread GitBox
AmplabJenkins commented on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#issuecomment-586062873 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

2020-02-13 Thread GitBox
AmplabJenkins removed a comment on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#issuecomment-586062883 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

2020-02-13 Thread GitBox
AmplabJenkins commented on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#issuecomment-586062883 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

2020-02-13 Thread GitBox
AmplabJenkins removed a comment on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#issuecomment-586062873 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

2020-02-13 Thread GitBox
SparkQA removed a comment on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#issuecomment-586019235 **[Test build #118380 has

[GitHub] [spark] SparkQA commented on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

2020-02-13 Thread GitBox
SparkQA commented on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#issuecomment-586062402 **[Test build #118380 has

[GitHub] [spark] HeartSaVioR commented on issue #27002: [SPARK-30346][CORE]Improve logging when events dropped

2020-02-13 Thread GitBox
HeartSaVioR commented on issue #27002: [SPARK-30346][CORE]Improve logging when events dropped URL: https://github.com/apache/spark/pull/27002#issuecomment-586061828 @liupc Any update here? This is an automated message from

[GitHub] [spark] HyukjinKwon commented on issue #27553: [PYSPARK][DOCS] [MINOR]Changed `:func:` to `:attr:` Sphinx roles, fixed links in documentation of `Data{Frame, Stream}{Reader, Writer}`.

2020-02-13 Thread GitBox
HyukjinKwon commented on issue #27553: [PYSPARK][DOCS] [MINOR]Changed `:func:` to `:attr:` Sphinx roles, fixed links in documentation of `Data{Frame,Stream}{Reader,Writer}`. URL: https://github.com/apache/spark/pull/27553#issuecomment-586061374 Merged to master, branch-3.0 and branch-2.4.

[GitHub] [spark] HyukjinKwon closed pull request #27553: [PYSPARK][DOCS] [MINOR]Changed `:func:` to `:attr:` Sphinx roles, fixed links in documentation of `Data{Frame, Stream}{Reader, Writer}`.

2020-02-13 Thread GitBox
HyukjinKwon closed pull request #27553: [PYSPARK][DOCS] [MINOR]Changed `:func:` to `:attr:` Sphinx roles, fixed links in documentation of `Data{Frame,Stream}{Reader,Writer}`. URL: https://github.com/apache/spark/pull/27553

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27553: [PYSPARK][DOCS] [MINOR]Changed `:func:` to `:attr:` Sphinx roles, fixed links in documentation of `Data{Frame, Stream}{Reader

2020-02-13 Thread GitBox
HyukjinKwon commented on a change in pull request #27553: [PYSPARK][DOCS] [MINOR]Changed `:func:` to `:attr:` Sphinx roles, fixed links in documentation of `Data{Frame,Stream}{Reader,Writer}`. URL: https://github.com/apache/spark/pull/27553#discussion_r379217246 ## File path:

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27553: [PYSPARK][DOCS] [MINOR]Changed `:func:` to `:attr:` Sphinx roles, fixed links in documentation of `Data{Frame, Stream}{Reader

2020-02-13 Thread GitBox
HyukjinKwon commented on a change in pull request #27553: [PYSPARK][DOCS] [MINOR]Changed `:func:` to `:attr:` Sphinx roles, fixed links in documentation of `Data{Frame,Stream}{Reader,Writer}`. URL: https://github.com/apache/spark/pull/27553#discussion_r379217221 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy

2020-02-13 Thread GitBox
AmplabJenkins removed a comment on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy URL: https://github.com/apache/spark/pull/27563#issuecomment-586060123 Test FAILed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #27395: [SPARK-30667][CORE] Add allGather method to BarrierTaskContext

2020-02-13 Thread GitBox
AmplabJenkins removed a comment on issue #27395: [SPARK-30667][CORE] Add allGather method to BarrierTaskContext URL: https://github.com/apache/spark/pull/27395#issuecomment-586059906 Can one of the admins verify this patch?

[GitHub] [spark] SparkQA removed a comment on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy

2020-02-13 Thread GitBox
SparkQA removed a comment on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy URL: https://github.com/apache/spark/pull/27563#issuecomment-586056733 **[Test build #118384 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy

2020-02-13 Thread GitBox
AmplabJenkins removed a comment on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy URL: https://github.com/apache/spark/pull/27563#issuecomment-586057489 Test FAILed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy

2020-02-13 Thread GitBox
AmplabJenkins removed a comment on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy URL: https://github.com/apache/spark/pull/27563#issuecomment-586060117 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #27395: [SPARK-30667][CORE] Add allGather method to BarrierTaskContext

2020-02-13 Thread GitBox
AmplabJenkins commented on issue #27395: [SPARK-30667][CORE] Add allGather method to BarrierTaskContext URL: https://github.com/apache/spark/pull/27395#issuecomment-586060284 Can one of the admins verify this patch? This is

[GitHub] [spark] AmplabJenkins commented on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy

2020-02-13 Thread GitBox
AmplabJenkins commented on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy URL: https://github.com/apache/spark/pull/27563#issuecomment-586060123 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy

2020-02-13 Thread GitBox
AmplabJenkins commented on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy URL: https://github.com/apache/spark/pull/27563#issuecomment-586060117 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA commented on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy

2020-02-13 Thread GitBox
SparkQA commented on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy URL: https://github.com/apache/spark/pull/27563#issuecomment-586060101 **[Test build #118384 has

[GitHub] [spark] AmplabJenkins commented on issue #27395: [SPARK-30667][CORE] Add allGather method to BarrierTaskContext

2020-02-13 Thread GitBox
AmplabJenkins commented on issue #27395: [SPARK-30667][CORE] Add allGather method to BarrierTaskContext URL: https://github.com/apache/spark/pull/27395#issuecomment-586059906 Can one of the admins verify this patch? This is

[GitHub] [spark] jiangxb1987 commented on issue #27395: [SPARK-30667][CORE] Add allGather method to BarrierTaskContext

2020-02-13 Thread GitBox
jiangxb1987 commented on issue #27395: [SPARK-30667][CORE] Add allGather method to BarrierTaskContext URL: https://github.com/apache/spark/pull/27395#issuecomment-586059445 retest this please This is an automated message

[GitHub] [spark] Ngone51 commented on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy

2020-02-13 Thread GitBox
Ngone51 commented on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy URL: https://github.com/apache/spark/pull/27563#issuecomment-586059347 > Oh, is this backward compatible, @Ngone51 ? I'm wondering all of these are new

[GitHub] [spark] HyukjinKwon commented on a change in pull request #26496: [SPARK-29748][PYTHON][SQL] Remove Row field sorting in PySpark for version 3.6+

2020-02-13 Thread GitBox
HyukjinKwon commented on a change in pull request #26496: [SPARK-29748][PYTHON][SQL] Remove Row field sorting in PySpark for version 3.6+ URL: https://github.com/apache/spark/pull/26496#discussion_r379215351 ## File path: docs/pyspark-migration-guide.md ## @@ -87,6 +87,8

[GitHub] [spark] jiangxb1987 commented on issue #27395: [SPARK-30667][CORE] Add allGather method to BarrierTaskContext

2020-02-13 Thread GitBox
jiangxb1987 commented on issue #27395: [SPARK-30667][CORE] Add allGather method to BarrierTaskContext URL: https://github.com/apache/spark/pull/27395#issuecomment-586057810 Jenkins retest please This is an automated message

[GitHub] [spark] AmplabJenkins removed a comment on issue #27495: [SPARK-28880][SQL] Support ANSI nested bracketed comments

2020-02-13 Thread GitBox
AmplabJenkins removed a comment on issue #27495: [SPARK-28880][SQL] Support ANSI nested bracketed comments URL: https://github.com/apache/spark/pull/27495#issuecomment-586057296 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] jiangxb1987 commented on issue #27395: [SPARK-30667][CORE] Add allGather method to BarrierTaskContext

2020-02-13 Thread GitBox
jiangxb1987 commented on issue #27395: [SPARK-30667][CORE] Add allGather method to BarrierTaskContext URL: https://github.com/apache/spark/pull/27395#issuecomment-586057657 I'm reverting this commit because the jenkins test is not triggered. We can merge it again after the test passes.

[GitHub] [spark] sarthfrey opened a new pull request #27395: [SPARK-30667][CORE] Add allGather method to BarrierTaskContext

2020-02-13 Thread GitBox
sarthfrey opened a new pull request #27395: [SPARK-30667][CORE] Add allGather method to BarrierTaskContext URL: https://github.com/apache/spark/pull/27395 ### What changes were proposed in this pull request? The `allGather` method is added to the `BarrierTaskContext`. This method

[GitHub] [spark] jiangxb1987 commented on issue #27395: [SPARK-30667][CORE] Add allGather method to BarrierTaskContext

2020-02-13 Thread GitBox
jiangxb1987 commented on issue #27395: [SPARK-30667][CORE] Add allGather method to BarrierTaskContext URL: https://github.com/apache/spark/pull/27395#issuecomment-586057720 add to whitelist This is an automated message from

[GitHub] [spark] AmplabJenkins removed a comment on issue #27395: [SPARK-30667][CORE] Add allGather method to BarrierTaskContext

2020-02-13 Thread GitBox
AmplabJenkins removed a comment on issue #27395: [SPARK-30667][CORE] Add allGather method to BarrierTaskContext URL: https://github.com/apache/spark/pull/27395#issuecomment-580106541 Can one of the admins verify this patch?

[GitHub] [spark] HyukjinKwon commented on issue #27529: [SPARK-30777][PYTHON][TESTS] Fix test failures for Pandas >= 1.0.0

2020-02-13 Thread GitBox
HyukjinKwon commented on issue #27529: [SPARK-30777][PYTHON][TESTS] Fix test failures for Pandas >= 1.0.0 URL: https://github.com/apache/spark/pull/27529#issuecomment-586057499 Oh, I thought it's single env. If this is the case, I think it's fine to don't backport.

[GitHub] [spark] AmplabJenkins commented on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy

2020-02-13 Thread GitBox
AmplabJenkins commented on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy URL: https://github.com/apache/spark/pull/27563#issuecomment-586057489 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #27495: [SPARK-28880][SQL] Support ANSI nested bracketed comments

2020-02-13 Thread GitBox
AmplabJenkins removed a comment on issue #27495: [SPARK-28880][SQL] Support ANSI nested bracketed comments URL: https://github.com/apache/spark/pull/27495#issuecomment-586057292 Merged build finished. Test FAILed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy

2020-02-13 Thread GitBox
AmplabJenkins removed a comment on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy URL: https://github.com/apache/spark/pull/27563#issuecomment-586057483 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy

2020-02-13 Thread GitBox
AmplabJenkins commented on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy URL: https://github.com/apache/spark/pull/27563#issuecomment-586057483 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #27495: [SPARK-28880][SQL] Support ANSI nested bracketed comments

2020-02-13 Thread GitBox
SparkQA removed a comment on issue #27495: [SPARK-28880][SQL] Support ANSI nested bracketed comments URL: https://github.com/apache/spark/pull/27495#issuecomment-586052972 **[Test build #118383 has

[GitHub] [spark] SparkQA commented on issue #27495: [SPARK-28880][SQL] Support ANSI nested bracketed comments

2020-02-13 Thread GitBox
SparkQA commented on issue #27495: [SPARK-28880][SQL] Support ANSI nested bracketed comments URL: https://github.com/apache/spark/pull/27495#issuecomment-586057216 **[Test build #118383 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/118383/testReport)**

[GitHub] [spark] shaneknapp edited a comment on issue #27529: [SPARK-30777][PYTHON][TESTS] Fix test failures for Pandas >= 1.0.0

2020-02-13 Thread GitBox
shaneknapp edited a comment on issue #27529: [SPARK-30777][PYTHON][TESTS] Fix test failures for Pandas >= 1.0.0 URL: https://github.com/apache/spark/pull/27529#issuecomment-586056059 for 2.4, python 3.6.8: ``` -bash-4.1$ python -c "import pandas; import pyarrow; print('pandas:

[GitHub] [spark] AmplabJenkins commented on issue #27495: [SPARK-28880][SQL] Support ANSI nested bracketed comments

2020-02-13 Thread GitBox
AmplabJenkins commented on issue #27495: [SPARK-28880][SQL] Support ANSI nested bracketed comments URL: https://github.com/apache/spark/pull/27495#issuecomment-586057296 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27495: [SPARK-28880][SQL] Support ANSI nested bracketed comments

2020-02-13 Thread GitBox
AmplabJenkins commented on issue #27495: [SPARK-28880][SQL] Support ANSI nested bracketed comments URL: https://github.com/apache/spark/pull/27495#issuecomment-586057292 Merged build finished. Test FAILed. This is an

[GitHub] [spark] SparkQA commented on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy

2020-02-13 Thread GitBox
SparkQA commented on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy URL: https://github.com/apache/spark/pull/27563#issuecomment-586056733 **[Test build #118384 has

[GitHub] [spark] shaneknapp edited a comment on issue #27529: [SPARK-30777][PYTHON][TESTS] Fix test failures for Pandas >= 1.0.0

2020-02-13 Thread GitBox
shaneknapp edited a comment on issue #27529: [SPARK-30777][PYTHON][TESTS] Fix test failures for Pandas >= 1.0.0 URL: https://github.com/apache/spark/pull/27529#issuecomment-586056059 for 2.4, python 3.6.8: ``` -bash-4.1$ python -c "import pandas; import pyarrow; print('pandas:

[GitHub] [spark] shaneknapp commented on issue #27529: [SPARK-30777][PYTHON][TESTS] Fix test failures for Pandas >= 1.0.0

2020-02-13 Thread GitBox
shaneknapp commented on issue #27529: [SPARK-30777][PYTHON][TESTS] Fix test failures for Pandas >= 1.0.0 URL: https://github.com/apache/spark/pull/27529#issuecomment-586056059 for 2.4, python 3.6.8: ''' -bash-4.1$ python -c "import pandas; import pyarrow; print('pandas: %s' %

[GitHub] [spark] jiangxb1987 commented on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy

2020-02-13 Thread GitBox
jiangxb1987 commented on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy URL: https://github.com/apache/spark/pull/27563#issuecomment-586053686 retest this please

[GitHub] [spark] AmplabJenkins removed a comment on issue #27495: [SPARK-28880][SQL] Support ANSI nested bracketed comments

2020-02-13 Thread GitBox
AmplabJenkins removed a comment on issue #27495: [SPARK-28880][SQL] Support ANSI nested bracketed comments URL: https://github.com/apache/spark/pull/27495#issuecomment-586053606 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #27571: [SPARK-30819][SPARKR][ML] Add FMRegressor wrapper to SparkR

2020-02-13 Thread GitBox
AmplabJenkins removed a comment on issue #27571: [SPARK-30819][SPARKR][ML] Add FMRegressor wrapper to SparkR URL: https://github.com/apache/spark/pull/27571#issuecomment-586053538 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27571: [SPARK-30819][SPARKR][ML] Add FMRegressor wrapper to SparkR

2020-02-13 Thread GitBox
AmplabJenkins removed a comment on issue #27571: [SPARK-30819][SPARKR][ML] Add FMRegressor wrapper to SparkR URL: https://github.com/apache/spark/pull/27571#issuecomment-586053535 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins removed a comment on issue #27495: [SPARK-28880][SQL] Support ANSI nested bracketed comments

2020-02-13 Thread GitBox
AmplabJenkins removed a comment on issue #27495: [SPARK-28880][SQL] Support ANSI nested bracketed comments URL: https://github.com/apache/spark/pull/27495#issuecomment-586053611 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27495: [SPARK-28880][SQL] Support ANSI nested bracketed comments

2020-02-13 Thread GitBox
AmplabJenkins commented on issue #27495: [SPARK-28880][SQL] Support ANSI nested bracketed comments URL: https://github.com/apache/spark/pull/27495#issuecomment-586053611 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27495: [SPARK-28880][SQL] Support ANSI nested bracketed comments

2020-02-13 Thread GitBox
AmplabJenkins commented on issue #27495: [SPARK-28880][SQL] Support ANSI nested bracketed comments URL: https://github.com/apache/spark/pull/27495#issuecomment-586053606 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #27571: [SPARK-30819][SPARKR][ML] Add FMRegressor wrapper to SparkR

2020-02-13 Thread GitBox
AmplabJenkins commented on issue #27571: [SPARK-30819][SPARKR][ML] Add FMRegressor wrapper to SparkR URL: https://github.com/apache/spark/pull/27571#issuecomment-586053538 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27571: [SPARK-30819][SPARKR][ML] Add FMRegressor wrapper to SparkR

2020-02-13 Thread GitBox
AmplabJenkins commented on issue #27571: [SPARK-30819][SPARKR][ML] Add FMRegressor wrapper to SparkR URL: https://github.com/apache/spark/pull/27571#issuecomment-586053535 Merged build finished. Test PASSed. This is an

[GitHub] [spark] SparkQA removed a comment on issue #27571: [SPARK-30819][SPARKR][ML] Add FMRegressor wrapper to SparkR

2020-02-13 Thread GitBox
SparkQA removed a comment on issue #27571: [SPARK-30819][SPARKR][ML] Add FMRegressor wrapper to SparkR URL: https://github.com/apache/spark/pull/27571#issuecomment-586030807 **[Test build #118382 has

[GitHub] [spark] SparkQA commented on issue #27571: [SPARK-30819][SPARKR][ML] Add FMRegressor wrapper to SparkR

2020-02-13 Thread GitBox
SparkQA commented on issue #27571: [SPARK-30819][SPARKR][ML] Add FMRegressor wrapper to SparkR URL: https://github.com/apache/spark/pull/27571#issuecomment-586053288 **[Test build #118382 has

[GitHub] [spark] SparkQA commented on issue #27495: [SPARK-28880][SQL] Support ANSI nested bracketed comments

2020-02-13 Thread GitBox
SparkQA commented on issue #27495: [SPARK-28880][SQL] Support ANSI nested bracketed comments URL: https://github.com/apache/spark/pull/27495#issuecomment-586052972 **[Test build #118383 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/118383/testReport)**

[GitHub] [spark] viirya commented on issue #26929: [SPARK-30289][SQL] Partitioned by Nested Column for `InMemoryTable`

2020-02-13 Thread GitBox
viirya commented on issue #26929: [SPARK-30289][SQL] Partitioned by Nested Column for `InMemoryTable` URL: https://github.com/apache/spark/pull/26929#issuecomment-586052696 Looks good and thanks for working on this. This is

[GitHub] [spark] jiangxb1987 commented on a change in pull request #27002: [SPARK-30346][CORE]Improve logging when events dropped

2020-02-13 Thread GitBox
jiangxb1987 commented on a change in pull request #27002: [SPARK-30346][CORE]Improve logging when events dropped URL: https://github.com/apache/spark/pull/27002#discussion_r379206377 ## File path: core/src/main/scala/org/apache/spark/scheduler/AsyncEventQueue.scala ## @@

[GitHub] [spark] xuanyuanking commented on issue #27560: [SPARK-30809][SQL] Review and fix issues in SQL API docs

2020-02-13 Thread GitBox
xuanyuanking commented on issue #27560: [SPARK-30809][SQL] Review and fix issues in SQL API docs URL: https://github.com/apache/spark/pull/27560#issuecomment-586050561 cc @cloud-fan This is an automated message from the

[GitHub] [spark] xuanyuanking edited a comment on issue #27560: [SPARK-30809][SQL] Review and fix issues in SQL API docs

2020-02-13 Thread GitBox
xuanyuanking edited a comment on issue #27560: [SPARK-30809][SQL] Review and fix issues in SQL API docs URL: https://github.com/apache/spark/pull/27560#issuecomment-586050561 cc @cloud-fan @gatorsmile This is an automated

[GitHub] [spark] viirya commented on a change in pull request #26929: [SPARK-30289][SQL] Partitioned by Nested Column for `InMemoryTable`

2020-02-13 Thread GitBox
viirya commented on a change in pull request #26929: [SPARK-30289][SQL] Partitioned by Nested Column for `InMemoryTable` URL: https://github.com/apache/spark/pull/26929#discussion_r379204978 ## File path:

[GitHub] [spark] jiangxb1987 commented on a change in pull request #27002: [SPARK-30346][CORE]Improve logging when events dropped

2020-02-13 Thread GitBox
jiangxb1987 commented on a change in pull request #27002: [SPARK-30346][CORE]Improve logging when events dropped URL: https://github.com/apache/spark/pull/27002#discussion_r379206377 ## File path: core/src/main/scala/org/apache/spark/scheduler/AsyncEventQueue.scala ## @@

[GitHub] [spark] AmplabJenkins removed a comment on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

2020-02-13 Thread GitBox
AmplabJenkins removed a comment on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#issuecomment-586040107 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

2020-02-13 Thread GitBox
AmplabJenkins removed a comment on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#issuecomment-586040115 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

2020-02-13 Thread GitBox
AmplabJenkins commented on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#issuecomment-586040107 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

2020-02-13 Thread GitBox
AmplabJenkins commented on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#issuecomment-586040115 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

2020-02-13 Thread GitBox
SparkQA commented on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#issuecomment-586039212 Kubernetes integration test status success URL:

[GitHub] [spark] zsxwing commented on a change in pull request #26496: [SPARK-29748][PYTHON][SQL] Remove Row field sorting in PySpark for version 3.6+

2020-02-13 Thread GitBox
zsxwing commented on a change in pull request #26496: [SPARK-29748][PYTHON][SQL] Remove Row field sorting in PySpark for version 3.6+ URL: https://github.com/apache/spark/pull/26496#discussion_r379194091 ## File path: docs/pyspark-migration-guide.md ## @@ -87,6 +87,8 @@

[GitHub] [spark] mengxr commented on issue #27395: [SPARK-30667][CORE] Add allGather method to BarrierTaskContext

2020-02-13 Thread GitBox
mengxr commented on issue #27395: [SPARK-30667][CORE] Add allGather method to BarrierTaskContext URL: https://github.com/apache/spark/pull/27395#issuecomment-586035904 Merged into master and branch-3.0. Thanks! This is an

[GitHub] [spark] asfgit closed pull request #27395: [SPARK-30667][CORE] Add allGather method to BarrierTaskContext

2020-02-13 Thread GitBox
asfgit closed pull request #27395: [SPARK-30667][CORE] Add allGather method to BarrierTaskContext URL: https://github.com/apache/spark/pull/27395 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] jiangxb1987 commented on a change in pull request #26971: [SPARK-30320][SQL] Fix insert overwrite to DataSource table with dynamic partition error

2020-02-13 Thread GitBox
jiangxb1987 commented on a change in pull request #26971: [SPARK-30320][SQL] Fix insert overwrite to DataSource table with dynamic partition error URL: https://github.com/apache/spark/pull/26971#discussion_r379190648 ## File path:

[GitHub] [spark] SparkQA commented on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

2020-02-13 Thread GitBox
SparkQA commented on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#issuecomment-586033832 Kubernetes integration test starting URL:

[GitHub] [spark] jiangxb1987 commented on issue #27222: [SPARK-30519][CORE] Use spark.executorEnv.HADOOP_USER_NAME to set executor's hadoop user

2020-02-13 Thread GitBox
jiangxb1987 commented on issue #27222: [SPARK-30519][CORE] Use spark.executorEnv.HADOOP_USER_NAME to set executor's hadoop user URL: https://github.com/apache/spark/pull/27222#issuecomment-586033002 This is a behavior change, and I don't think we should introduce this change by the

[GitHub] [spark] rdblue commented on issue #26929: [SPARK-30289][SQL] Partitioned by Nested Column for `InMemoryTable`

2020-02-13 Thread GitBox
rdblue commented on issue #26929: [SPARK-30289][SQL] Partitioned by Nested Column for `InMemoryTable` URL: https://github.com/apache/spark/pull/26929#issuecomment-586032685 +1 Thanks for updating tests, @dbtsai. This looks good to me and it's great to have cases for partitioning by

[GitHub] [spark] AmplabJenkins removed a comment on issue #27571: [SPARK-30819][SPARKR][ML] Add FMRegressor wrapper to SparkR

2020-02-13 Thread GitBox
AmplabJenkins removed a comment on issue #27571: [SPARK-30819][SPARKR][ML] Add FMRegressor wrapper to SparkR URL: https://github.com/apache/spark/pull/27571#issuecomment-586031351 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27571: [SPARK-30819][SPARKR][ML] Add FMRegressor wrapper to SparkR

2020-02-13 Thread GitBox
AmplabJenkins removed a comment on issue #27571: [SPARK-30819][SPARKR][ML] Add FMRegressor wrapper to SparkR URL: https://github.com/apache/spark/pull/27571#issuecomment-586031345 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #27571: [SPARK-30819][SPARKR][ML] Add FMRegressor wrapper to SparkR

2020-02-13 Thread GitBox
AmplabJenkins commented on issue #27571: [SPARK-30819][SPARKR][ML] Add FMRegressor wrapper to SparkR URL: https://github.com/apache/spark/pull/27571#issuecomment-586031351 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27571: [SPARK-30819][SPARKR][ML] Add FMRegressor wrapper to SparkR

2020-02-13 Thread GitBox
AmplabJenkins commented on issue #27571: [SPARK-30819][SPARKR][ML] Add FMRegressor wrapper to SparkR URL: https://github.com/apache/spark/pull/27571#issuecomment-586031345 Merged build finished. Test PASSed. This is an

[GitHub] [spark] jiangxb1987 commented on a change in pull request #27050: [SPARK-30388][Core] Mark running map stages of finished job as finished, and cancel running tasks

2020-02-13 Thread GitBox
jiangxb1987 commented on a change in pull request #27050: [SPARK-30388][Core] Mark running map stages of finished job as finished, and cancel running tasks URL: https://github.com/apache/spark/pull/27050#discussion_r379186506 ## File path:

[GitHub] [spark] SparkQA commented on issue #27571: [SPARK-30819][SPARKR][ML] Add FMRegressor wrapper to SparkR

2020-02-13 Thread GitBox
SparkQA commented on issue #27571: [SPARK-30819][SPARKR][ML] Add FMRegressor wrapper to SparkR URL: https://github.com/apache/spark/pull/27571#issuecomment-586030807 **[Test build #118382 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/118382/testReport)**

[GitHub] [spark] jiangxb1987 commented on a change in pull request #27050: [SPARK-30388][Core] Mark running map stages of finished job as finished, and cancel running tasks

2020-02-13 Thread GitBox
jiangxb1987 commented on a change in pull request #27050: [SPARK-30388][Core] Mark running map stages of finished job as finished, and cancel running tasks URL: https://github.com/apache/spark/pull/27050#discussion_r379184969 ## File path:

[GitHub] [spark] jiangxb1987 commented on issue #27419: [WIP][SPARK-30694][SHUFFLE]If exception occured while fetching blocks by ExternalBlockClient, fail early when External Shuffle Service is not al

2020-02-13 Thread GitBox
jiangxb1987 commented on issue #27419: [WIP][SPARK-30694][SHUFFLE]If exception occured while fetching blocks by ExternalBlockClient, fail early when External Shuffle Service is not alive URL: https://github.com/apache/spark/pull/27419#issuecomment-586026054 If you skip retry, how can you

[GitHub] [spark] marmbrus commented on issue #24902: [SPARK-28093][SQL] Fix TRIM/LTRIM/RTRIM function parameter order issue

2020-02-13 Thread GitBox
marmbrus commented on issue #24902: [SPARK-28093][SQL] Fix TRIM/LTRIM/RTRIM function parameter order issue URL: https://github.com/apache/spark/pull/24902#issuecomment-586025104 Reordering function parameters to match another system, for a method that is otherwise working correctly,

[GitHub] [spark] jiangxb1987 commented on issue #26984: [SPARK-27641][CORE] Fix MetricsSystem to remove metrics of the specific source by exactly match

2020-02-13 Thread GitBox
jiangxb1987 commented on issue #26984: [SPARK-27641][CORE] Fix MetricsSystem to remove metrics of the specific source by exactly match URL: https://github.com/apache/spark/pull/26984#issuecomment-586024740 What's the behavior change you are proposing? Your new test case passes under

<    1   2   3   4   5   6   7   8   9   10   >