[GitHub] [spark] ueshin commented on a change in pull request #24981: [SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs

2019-08-27 Thread GitBox
ueshin commented on a change in pull request #24981: [SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs URL: https://github.com/apache/spark/pull/24981#discussion_r318269916 ## File path: python/pyspark/sql/cogroup.py ## @@ -0,0 +1,99 @@ +# +# Licensed to the

[GitHub] [spark] ueshin commented on a change in pull request #24981: [SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs

2019-08-27 Thread GitBox
ueshin commented on a change in pull request #24981: [SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs URL: https://github.com/apache/spark/pull/24981#discussion_r318286004 ## File path:

[GitHub] [spark] ueshin commented on a change in pull request #24981: [SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs

2019-08-27 Thread GitBox
ueshin commented on a change in pull request #24981: [SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs URL: https://github.com/apache/spark/pull/24981#discussion_r318282371 ## File path:

[GitHub] [spark] ueshin commented on a change in pull request #24981: [SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs

2019-08-27 Thread GitBox
ueshin commented on a change in pull request #24981: [SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs URL: https://github.com/apache/spark/pull/24981#discussion_r318286994 ## File path:

[GitHub] [spark] ueshin commented on a change in pull request #24981: [SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs

2019-08-27 Thread GitBox
ueshin commented on a change in pull request #24981: [SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs URL: https://github.com/apache/spark/pull/24981#discussion_r318283008 ## File path:

[GitHub] [spark] ueshin commented on a change in pull request #24981: [SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs

2019-08-27 Thread GitBox
ueshin commented on a change in pull request #24981: [SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs URL: https://github.com/apache/spark/pull/24981#discussion_r318279104 ## File path: python/pyspark/worker.py ## @@ -343,6 +377,30 @@ def map_batch(batch):

[GitHub] [spark] ueshin commented on a change in pull request #24981: [SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs

2019-08-27 Thread GitBox
ueshin commented on a change in pull request #24981: [SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs URL: https://github.com/apache/spark/pull/24981#discussion_r318268488 ## File path: python/pyspark/serializers.py ## @@ -401,6 +401,35 @@ def

[GitHub] [spark] ueshin commented on a change in pull request #24981: [SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs

2019-08-27 Thread GitBox
ueshin commented on a change in pull request #24981: [SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs URL: https://github.com/apache/spark/pull/24981#discussion_r318282766 ## File path:

[GitHub] [spark] ueshin commented on a change in pull request #24981: [SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs

2019-08-27 Thread GitBox
ueshin commented on a change in pull request #24981: [SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs URL: https://github.com/apache/spark/pull/24981#discussion_r318277545 ## File path: python/pyspark/worker.py ## @@ -282,11 +313,14 @@ def

[GitHub] [spark] ueshin commented on a change in pull request #24981: [SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs

2019-08-27 Thread GitBox
ueshin commented on a change in pull request #24981: [SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs URL: https://github.com/apache/spark/pull/24981#discussion_r318274755 ## File path: python/pyspark/sql/tests/test_pandas_udf_cogrouped_map.py ## @@ -0,0

[GitHub] [spark] ueshin commented on a change in pull request #24981: [SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs

2019-08-27 Thread GitBox
ueshin commented on a change in pull request #24981: [SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs URL: https://github.com/apache/spark/pull/24981#discussion_r318285064 ## File path:

[GitHub] [spark] ueshin commented on a change in pull request #24981: [SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs

2019-08-27 Thread GitBox
ueshin commented on a change in pull request #24981: [SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs URL: https://github.com/apache/spark/pull/24981#discussion_r318282915 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #25502: [SPARK-28668][SQL][WIP] Support V2SessionCatalog for ALTER TABLE

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #25502: [SPARK-28668][SQL][WIP] Support V2SessionCatalog for ALTER TABLE URL: https://github.com/apache/spark/pull/25502#issuecomment-525478493 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25502: [SPARK-28668][SQL][WIP] Support V2SessionCatalog for ALTER TABLE

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #25502: [SPARK-28668][SQL][WIP] Support V2SessionCatalog for ALTER TABLE URL: https://github.com/apache/spark/pull/25502#issuecomment-525478503 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25502: [SPARK-28668][SQL][WIP] Support V2SessionCatalog for ALTER TABLE

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #25502: [SPARK-28668][SQL][WIP] Support V2SessionCatalog for ALTER TABLE URL: https://github.com/apache/spark/pull/25502#issuecomment-525478493 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #25502: [SPARK-28668][SQL][WIP] Support V2SessionCatalog for ALTER TABLE

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #25502: [SPARK-28668][SQL][WIP] Support V2SessionCatalog for ALTER TABLE URL: https://github.com/apache/spark/pull/25502#issuecomment-525478503 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] brkyvz commented on a change in pull request #25502: [SPARK-28668][SQL][WIP] Support V2SessionCatalog for ALTER TABLE

2019-08-27 Thread GitBox
brkyvz commented on a change in pull request #25502: [SPARK-28668][SQL][WIP] Support V2SessionCatalog for ALTER TABLE URL: https://github.com/apache/spark/pull/25502#discussion_r318290575 ## File path:

[GitHub] [spark] brkyvz commented on issue #25507: [SPARK-28667][SQL] Support InsertInto through the V2SessionCatalog

2019-08-27 Thread GitBox
brkyvz commented on issue #25507: [SPARK-28667][SQL] Support InsertInto through the V2SessionCatalog URL: https://github.com/apache/spark/pull/25507#issuecomment-525476569 Thanks for the review @cloud-fan ! This is an

[GitHub] [spark] SparkQA commented on issue #25502: [SPARK-28668][SQL][WIP] Support V2SessionCatalog for ALTER TABLE

2019-08-27 Thread GitBox
SparkQA commented on issue #25502: [SPARK-28668][SQL][WIP] Support V2SessionCatalog for ALTER TABLE URL: https://github.com/apache/spark/pull/25502#issuecomment-525476483 **[Test build #109831 has

[GitHub] [spark] dilipbiswal edited a comment on issue #25525: [SPARK-28786][DOC][SQL]Document INSERT statement in SQL Reference

2019-08-27 Thread GitBox
dilipbiswal edited a comment on issue #25525: [SPARK-28786][DOC][SQL]Document INSERT statement in SQL Reference URL: https://github.com/apache/spark/pull/25525#issuecomment-525473055 @huaxingao Is there a way we can delete the old screen shots ? We could also move the new screen-shots to

[GitHub] [spark] dilipbiswal commented on issue #25525: [SPARK-28786][DOC][SQL]Document INSERT statement in SQL Reference

2019-08-27 Thread GitBox
dilipbiswal commented on issue #25525: [SPARK-28786][DOC][SQL]Document INSERT statement in SQL Reference URL: https://github.com/apache/spark/pull/25525#issuecomment-525473055 @huaxingao Is there a way we can delete the old screen shots ?

[GitHub] [spark] AmplabJenkins commented on issue #25502: [SPARK-28668][SQL][WIP] Support V2SessionCatalog for ALTER TABLE

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #25502: [SPARK-28668][SQL][WIP] Support V2SessionCatalog for ALTER TABLE URL: https://github.com/apache/spark/pull/25502#issuecomment-525471881 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25502: [SPARK-28668][SQL][WIP] Support V2SessionCatalog for ALTER TABLE

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #25502: [SPARK-28668][SQL][WIP] Support V2SessionCatalog for ALTER TABLE URL: https://github.com/apache/spark/pull/25502#issuecomment-525471881 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25502: [SPARK-28668][SQL][WIP] Support V2SessionCatalog for ALTER TABLE

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #25502: [SPARK-28668][SQL][WIP] Support V2SessionCatalog for ALTER TABLE URL: https://github.com/apache/spark/pull/25502#issuecomment-525471876 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25502: [SPARK-28668][SQL][WIP] Support V2SessionCatalog for ALTER TABLE

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #25502: [SPARK-28668][SQL][WIP] Support V2SessionCatalog for ALTER TABLE URL: https://github.com/apache/spark/pull/25502#issuecomment-525471876 Merged build finished. Test PASSed. This is an

[GitHub] [spark] SparkQA removed a comment on issue #25502: [SPARK-28668][SQL][WIP] Support V2SessionCatalog for ALTER TABLE

2019-08-27 Thread GitBox
SparkQA removed a comment on issue #25502: [SPARK-28668][SQL][WIP] Support V2SessionCatalog for ALTER TABLE URL: https://github.com/apache/spark/pull/25502#issuecomment-525387616 **[Test build #109824 has

[GitHub] [spark] dilipbiswal commented on issue #25525: [SPARK-28786][DOC][SQL]Document INSERT statement in SQL Reference

2019-08-27 Thread GitBox
dilipbiswal commented on issue #25525: [SPARK-28786][DOC][SQL]Document INSERT statement in SQL Reference URL: https://github.com/apache/spark/pull/25525#issuecomment-525471454 @huaxingao Thanks.. this looks much better. I will follow your format :-)

[GitHub] [spark] SparkQA commented on issue #25502: [SPARK-28668][SQL][WIP] Support V2SessionCatalog for ALTER TABLE

2019-08-27 Thread GitBox
SparkQA commented on issue #25502: [SPARK-28668][SQL][WIP] Support V2SessionCatalog for ALTER TABLE URL: https://github.com/apache/spark/pull/25502#issuecomment-525471151 **[Test build #109824 has

[GitHub] [spark] dilipbiswal commented on a change in pull request #25525: [SPARK-28786][DOC][SQL]Document INSERT statement in SQL Reference

2019-08-27 Thread GitBox
dilipbiswal commented on a change in pull request #25525: [SPARK-28786][DOC][SQL]Document INSERT statement in SQL Reference URL: https://github.com/apache/spark/pull/25525#discussion_r318283421 ## File path: docs/sql-ref-syntax-dml-insert-into.md ## @@ -0,0 +1,199 @@ +---

[GitHub] [spark] dilipbiswal commented on a change in pull request #25525: [SPARK-28786][DOC][SQL]Document INSERT statement in SQL Reference

2019-08-27 Thread GitBox
dilipbiswal commented on a change in pull request #25525: [SPARK-28786][DOC][SQL]Document INSERT statement in SQL Reference URL: https://github.com/apache/spark/pull/25525#discussion_r318282884 ## File path: docs/sql-ref-syntax-dml-insert-into.md ## @@ -0,0 +1,199 @@ +---

[GitHub] [spark] hem1891 commented on a change in pull request #25570: [SPARK-23519][SQL] create view should work from query with duplicate output columns

2019-08-27 Thread GitBox
hem1891 commented on a change in pull request #25570: [SPARK-23519][SQL] create view should work from query with duplicate output columns URL: https://github.com/apache/spark/pull/25570#discussion_r318280255 ## File path:

[GitHub] [spark] dilipbiswal commented on a change in pull request #25525: [SPARK-28786][DOC][SQL]Document INSERT statement in SQL Reference

2019-08-27 Thread GitBox
dilipbiswal commented on a change in pull request #25525: [SPARK-28786][DOC][SQL]Document INSERT statement in SQL Reference URL: https://github.com/apache/spark/pull/25525#discussion_r318277263 ## File path: docs/sql-ref-syntax-dml-insert-overwrite-directory-hive.md ## @@

[GitHub] [spark] dilipbiswal commented on a change in pull request #25525: [SPARK-28786][DOC][SQL]Document INSERT statement in SQL Reference

2019-08-27 Thread GitBox
dilipbiswal commented on a change in pull request #25525: [SPARK-28786][DOC][SQL]Document INSERT statement in SQL Reference URL: https://github.com/apache/spark/pull/25525#discussion_r318272870 ## File path: docs/sql-ref-syntax-dml-insert-into.md ## @@ -0,0 +1,199 @@ +---

[GitHub] [spark] AmplabJenkins removed a comment on issue #25502: [SPARK-28668][SQL][WIP] Support V2SessionCatalog for ALTER TABLE

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #25502: [SPARK-28668][SQL][WIP] Support V2SessionCatalog for ALTER TABLE URL: https://github.com/apache/spark/pull/25502#issuecomment-525460755 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25502: [SPARK-28668][SQL][WIP] Support V2SessionCatalog for ALTER TABLE

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #25502: [SPARK-28668][SQL][WIP] Support V2SessionCatalog for ALTER TABLE URL: https://github.com/apache/spark/pull/25502#issuecomment-525460762 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25502: [SPARK-28668][SQL][WIP] Support V2SessionCatalog for ALTER TABLE

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #25502: [SPARK-28668][SQL][WIP] Support V2SessionCatalog for ALTER TABLE URL: https://github.com/apache/spark/pull/25502#issuecomment-525460755 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #25502: [SPARK-28668][SQL][WIP] Support V2SessionCatalog for ALTER TABLE

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #25502: [SPARK-28668][SQL][WIP] Support V2SessionCatalog for ALTER TABLE URL: https://github.com/apache/spark/pull/25502#issuecomment-525460762 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #25502: [SPARK-28668][SQL][WIP] Support V2SessionCatalog for ALTER TABLE

2019-08-27 Thread GitBox
SparkQA removed a comment on issue #25502: [SPARK-28668][SQL][WIP] Support V2SessionCatalog for ALTER TABLE URL: https://github.com/apache/spark/pull/25502#issuecomment-525381614 **[Test build #109823 has

[GitHub] [spark] SparkQA commented on issue #25502: [SPARK-28668][SQL][WIP] Support V2SessionCatalog for ALTER TABLE

2019-08-27 Thread GitBox
SparkQA commented on issue #25502: [SPARK-28668][SQL][WIP] Support V2SessionCatalog for ALTER TABLE URL: https://github.com/apache/spark/pull/25502#issuecomment-525460119 **[Test build #109823 has

[GitHub] [spark] SparkQA commented on issue #25342: [SPARK-28571][CORE][SHUFFLE] Use the shuffle writer plugin for the SortShuffleWriter

2019-08-27 Thread GitBox
SparkQA commented on issue #25342: [SPARK-28571][CORE][SHUFFLE] Use the shuffle writer plugin for the SortShuffleWriter URL: https://github.com/apache/spark/pull/25342#issuecomment-525456341 **[Test build #109829 has

[GitHub] [spark] SparkQA commented on issue #25458: [SPARK-27931][SQL] Accept "true", "yes", "1", "false", "no", "0", and unique prefixes as input and trim input for the boolean data type.

2019-08-27 Thread GitBox
SparkQA commented on issue #25458: [SPARK-27931][SQL] Accept "true", "yes", "1", "false", "no", "0", and unique prefixes as input and trim input for the boolean data type. URL: https://github.com/apache/spark/pull/25458#issuecomment-525456314 **[Test build #109830 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25342: [SPARK-28571][CORE][SHUFFLE] Use the shuffle writer plugin for the SortShuffleWriter

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #25342: [SPARK-28571][CORE][SHUFFLE] Use the shuffle writer plugin for the SortShuffleWriter URL: https://github.com/apache/spark/pull/25342#issuecomment-52541 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25342: [SPARK-28571][CORE][SHUFFLE] Use the shuffle writer plugin for the SortShuffleWriter

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #25342: [SPARK-28571][CORE][SHUFFLE] Use the shuffle writer plugin for the SortShuffleWriter URL: https://github.com/apache/spark/pull/25342#issuecomment-52548 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #25586: [SPARK-28878[SQL][WIP] Remove extra project for DSv2 reads with columnar batches.

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #25586: [SPARK-28878[SQL][WIP] Remove extra project for DSv2 reads with columnar batches. URL: https://github.com/apache/spark/pull/25586#issuecomment-525455535 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #25586: [SPARK-28878[SQL][WIP] Remove extra project for DSv2 reads with columnar batches.

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #25586: [SPARK-28878[SQL][WIP] Remove extra project for DSv2 reads with columnar batches. URL: https://github.com/apache/spark/pull/25586#issuecomment-525455525 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25458: [SPARK-27931][SQL] Accept "true", "yes", "1", "false", "no", "0", and unique prefixes as input and trim input for the boolean data typ

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #25458: [SPARK-27931][SQL] Accept "true", "yes", "1", "false", "no", "0", and unique prefixes as input and trim input for the boolean data type. URL: https://github.com/apache/spark/pull/25458#issuecomment-525455498 Test PASSed. Refer to this

[GitHub] [spark] AmplabJenkins removed a comment on issue #25458: [SPARK-27931][SQL] Accept "true", "yes", "1", "false", "no", "0", and unique prefixes as input and trim input for the boolean data typ

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #25458: [SPARK-27931][SQL] Accept "true", "yes", "1", "false", "no", "0", and unique prefixes as input and trim input for the boolean data type. URL: https://github.com/apache/spark/pull/25458#issuecomment-525455491 Merged build finished. Test

[GitHub] [spark] AmplabJenkins commented on issue #25342: [SPARK-28571][CORE][SHUFFLE] Use the shuffle writer plugin for the SortShuffleWriter

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #25342: [SPARK-28571][CORE][SHUFFLE] Use the shuffle writer plugin for the SortShuffleWriter URL: https://github.com/apache/spark/pull/25342#issuecomment-52548 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25458: [SPARK-27931][SQL] Accept "true", "yes", "1", "false", "no", "0", and unique prefixes as input and trim input for the boolean data type.

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #25458: [SPARK-27931][SQL] Accept "true", "yes", "1", "false", "no", "0", and unique prefixes as input and trim input for the boolean data type. URL: https://github.com/apache/spark/pull/25458#issuecomment-525455498 Test PASSed. Refer to this link for

[GitHub] [spark] AmplabJenkins commented on issue #25342: [SPARK-28571][CORE][SHUFFLE] Use the shuffle writer plugin for the SortShuffleWriter

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #25342: [SPARK-28571][CORE][SHUFFLE] Use the shuffle writer plugin for the SortShuffleWriter URL: https://github.com/apache/spark/pull/25342#issuecomment-52541 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25586: [SPARK-28878[SQL][WIP] Remove extra project for DSv2 reads with columnar batches.

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #25586: [SPARK-28878[SQL][WIP] Remove extra project for DSv2 reads with columnar batches. URL: https://github.com/apache/spark/pull/25586#issuecomment-525455525 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25586: [SPARK-28878[SQL][WIP] Remove extra project for DSv2 reads with columnar batches.

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #25586: [SPARK-28878[SQL][WIP] Remove extra project for DSv2 reads with columnar batches. URL: https://github.com/apache/spark/pull/25586#issuecomment-525455535 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25458: [SPARK-27931][SQL] Accept "true", "yes", "1", "false", "no", "0", and unique prefixes as input and trim input for the boolean data type.

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #25458: [SPARK-27931][SQL] Accept "true", "yes", "1", "false", "no", "0", and unique prefixes as input and trim input for the boolean data type. URL: https://github.com/apache/spark/pull/25458#issuecomment-525455491 Merged build finished. Test PASSed.

[GitHub] [spark] younggyuchun edited a comment on issue #25458: [SPARK-27931][SQL] Accept "true", "yes", "1", "false", "no", "0", and unique prefixes as input and trim input for the boolean data type.

2019-08-27 Thread GitBox
younggyuchun edited a comment on issue #25458: [SPARK-27931][SQL] Accept "true", "yes", "1", "false", "no", "0", and unique prefixes as input and trim input for the boolean data type. URL: https://github.com/apache/spark/pull/25458#issuecomment-525454816 Hi @dongjoon-hyun, Sorry for

[GitHub] [spark] younggyuchun commented on a change in pull request #25458: [SPARK-27931][SQL] Accept "true", "yes", "1", "false", "no", "0", and unique prefixes as input and trim input for the boolea

2019-08-27 Thread GitBox
younggyuchun commented on a change in pull request #25458: [SPARK-27931][SQL] Accept "true", "yes", "1", "false", "no", "0", and unique prefixes as input and trim input for the boolean data type. URL: https://github.com/apache/spark/pull/25458#discussion_r318264418 ## File path:

[GitHub] [spark] younggyuchun commented on issue #25458: [SPARK-27931][SQL] Accept "true", "yes", "1", "false", "no", "0", and unique prefixes as input and trim input for the boolean data type.

2019-08-27 Thread GitBox
younggyuchun commented on issue #25458: [SPARK-27931][SQL] Accept "true", "yes", "1", "false", "no", "0", and unique prefixes as input and trim input for the boolean data type. URL: https://github.com/apache/spark/pull/25458#issuecomment-525454816 Hi @dongjoon-hyun, PR title and

[GitHub] [spark] younggyuchun commented on a change in pull request #25458: [SPARK-27931][SQL] Accept "true", "yes", "1", "false", "no", "0", and unique prefixes as input and trim input for the boolea

2019-08-27 Thread GitBox
younggyuchun commented on a change in pull request #25458: [SPARK-27931][SQL] Accept "true", "yes", "1", "false", "no", "0", and unique prefixes as input and trim input for the boolean data type. URL: https://github.com/apache/spark/pull/25458#discussion_r318264418 ## File path:

[GitHub] [spark] SparkQA commented on issue #25586: [SPARK-28878[SQL][WIP] Remove extra project for DSv2 reads with columnar batches.

2019-08-27 Thread GitBox
SparkQA commented on issue #25586: [SPARK-28878[SQL][WIP] Remove extra project for DSv2 reads with columnar batches. URL: https://github.com/apache/spark/pull/25586#issuecomment-525453498 **[Test build #109828 has

[GitHub] [spark] rdblue commented on issue #25586: [SPARK-28878[SQL][WIP] Remove extra project for DSv2 reads with columnar batches.

2019-08-27 Thread GitBox
rdblue commented on issue #25586: [SPARK-28878[SQL][WIP] Remove extra project for DSv2 reads with columnar batches. URL: https://github.com/apache/spark/pull/25586#issuecomment-525452683 Retest this please. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #23531: [SPARK-24497][SQL] Support recursive SQL query

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #23531: [SPARK-24497][SQL] Support recursive SQL query URL: https://github.com/apache/spark/pull/23531#issuecomment-525450143 Build finished. Test PASSed. This is an automated message

[GitHub] [spark] AmplabJenkins removed a comment on issue #23531: [SPARK-24497][SQL] Support recursive SQL query

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #23531: [SPARK-24497][SQL] Support recursive SQL query URL: https://github.com/apache/spark/pull/23531#issuecomment-525450149 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #23531: [SPARK-24497][SQL] Support recursive SQL query

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #23531: [SPARK-24497][SQL] Support recursive SQL query URL: https://github.com/apache/spark/pull/23531#issuecomment-525450143 Build finished. Test PASSed. This is an automated message from

[GitHub] [spark] AmplabJenkins commented on issue #23531: [SPARK-24497][SQL] Support recursive SQL query

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #23531: [SPARK-24497][SQL] Support recursive SQL query URL: https://github.com/apache/spark/pull/23531#issuecomment-525450149 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #23531: [SPARK-24497][SQL] Support recursive SQL query

2019-08-27 Thread GitBox
SparkQA commented on issue #23531: [SPARK-24497][SQL] Support recursive SQL query URL: https://github.com/apache/spark/pull/23531#issuecomment-525448226 **[Test build #109827 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109827/testReport)** for PR 23531

[GitHub] [spark] AmplabJenkins removed a comment on issue #25559: [WIP][DO-NOT-MERGE] Test updating Kinesis deps and current state of Kinesis Python tests

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #25559: [WIP][DO-NOT-MERGE] Test updating Kinesis deps and current state of Kinesis Python tests URL: https://github.com/apache/spark/pull/25559#issuecomment-525444887 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25559: [WIP][DO-NOT-MERGE] Test updating Kinesis deps and current state of Kinesis Python tests

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #25559: [WIP][DO-NOT-MERGE] Test updating Kinesis deps and current state of Kinesis Python tests URL: https://github.com/apache/spark/pull/25559#issuecomment-525444895 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] SparkQA commented on issue #25559: [WIP][DO-NOT-MERGE] Test updating Kinesis deps and current state of Kinesis Python tests

2019-08-27 Thread GitBox
SparkQA commented on issue #25559: [WIP][DO-NOT-MERGE] Test updating Kinesis deps and current state of Kinesis Python tests URL: https://github.com/apache/spark/pull/25559#issuecomment-525445603 **[Test build #109826 has

[GitHub] [spark] AmplabJenkins commented on issue #25559: [WIP][DO-NOT-MERGE] Test updating Kinesis deps and current state of Kinesis Python tests

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #25559: [WIP][DO-NOT-MERGE] Test updating Kinesis deps and current state of Kinesis Python tests URL: https://github.com/apache/spark/pull/25559#issuecomment-525444887 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25559: [WIP][DO-NOT-MERGE] Test updating Kinesis deps and current state of Kinesis Python tests

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #25559: [WIP][DO-NOT-MERGE] Test updating Kinesis deps and current state of Kinesis Python tests URL: https://github.com/apache/spark/pull/25559#issuecomment-525444895 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25342: [SPARK-28571][CORE][SHUFFLE] Use the shuffle writer plugin for the SortShuffleWriter

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #25342: [SPARK-28571][CORE][SHUFFLE] Use the shuffle writer plugin for the SortShuffleWriter URL: https://github.com/apache/spark/pull/25342#issuecomment-525442402 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #25342: [SPARK-28571][CORE][SHUFFLE] Use the shuffle writer plugin for the SortShuffleWriter

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #25342: [SPARK-28571][CORE][SHUFFLE] Use the shuffle writer plugin for the SortShuffleWriter URL: https://github.com/apache/spark/pull/25342#issuecomment-525442394 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #25342: [SPARK-28571][CORE][SHUFFLE] Use the shuffle writer plugin for the SortShuffleWriter

2019-08-27 Thread GitBox
SparkQA removed a comment on issue #25342: [SPARK-28571][CORE][SHUFFLE] Use the shuffle writer plugin for the SortShuffleWriter URL: https://github.com/apache/spark/pull/25342#issuecomment-525440135 **[Test build #109825 has

[GitHub] [spark] AmplabJenkins commented on issue #25342: [SPARK-28571][CORE][SHUFFLE] Use the shuffle writer plugin for the SortShuffleWriter

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #25342: [SPARK-28571][CORE][SHUFFLE] Use the shuffle writer plugin for the SortShuffleWriter URL: https://github.com/apache/spark/pull/25342#issuecomment-525442402 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] srowen commented on issue #25559: [WIP][DO-NOT-MERGE] Test updating Kinesis deps and current state of Kinesis Python tests

2019-08-27 Thread GitBox
srowen commented on issue #25559: [WIP][DO-NOT-MERGE] Test updating Kinesis deps and current state of Kinesis Python tests URL: https://github.com/apache/spark/pull/25559#issuecomment-525442571 That's good that this passes. Now going to try the less drastic change at

[GitHub] [spark] SparkQA commented on issue #25342: [SPARK-28571][CORE][SHUFFLE] Use the shuffle writer plugin for the SortShuffleWriter

2019-08-27 Thread GitBox
SparkQA commented on issue #25342: [SPARK-28571][CORE][SHUFFLE] Use the shuffle writer plugin for the SortShuffleWriter URL: https://github.com/apache/spark/pull/25342#issuecomment-525442380 **[Test build #109825 has

[GitHub] [spark] AmplabJenkins commented on issue #25342: [SPARK-28571][CORE][SHUFFLE] Use the shuffle writer plugin for the SortShuffleWriter

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #25342: [SPARK-28571][CORE][SHUFFLE] Use the shuffle writer plugin for the SortShuffleWriter URL: https://github.com/apache/spark/pull/25342#issuecomment-525442394 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #25588: [SPARK-28000][SQL][TEST] Port comments.sql

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #25588: [SPARK-28000][SQL][TEST] Port comments.sql URL: https://github.com/apache/spark/pull/25588#issuecomment-525441582 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25588: [SPARK-28000][SQL][TEST] Port comments.sql

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #25588: [SPARK-28000][SQL][TEST] Port comments.sql URL: https://github.com/apache/spark/pull/25588#issuecomment-525441582 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25588: [SPARK-28000][SQL][TEST] Port comments.sql

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #25588: [SPARK-28000][SQL][TEST] Port comments.sql URL: https://github.com/apache/spark/pull/25588#issuecomment-525441576 Merged build finished. Test PASSed. This is an automated message from

[GitHub] [spark] AmplabJenkins removed a comment on issue #25588: [SPARK-28000][SQL][TEST] Port comments.sql

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #25588: [SPARK-28000][SQL][TEST] Port comments.sql URL: https://github.com/apache/spark/pull/25588#issuecomment-525441576 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] dongjoon-hyun closed pull request #25593: [SPARK-27992][SPARK-28881][PYTHON][2.4] Allow Python to join with connection thread to propagate errors

2019-08-27 Thread GitBox
dongjoon-hyun closed pull request #25593: [SPARK-27992][SPARK-28881][PYTHON][2.4] Allow Python to join with connection thread to propagate errors URL: https://github.com/apache/spark/pull/25593 This is an automated message

[GitHub] [spark] dongjoon-hyun commented on issue #25593: [SPARK-27992][SPARK-28881][PYTHON][2.4] Allow Python to join with connection thread to propagate errors

2019-08-27 Thread GitBox
dongjoon-hyun commented on issue #25593: [SPARK-27992][SPARK-28881][PYTHON][2.4] Allow Python to join with connection thread to propagate errors URL: https://github.com/apache/spark/pull/25593#issuecomment-525441174 Thank you, @HyukjinKwon , @cloud-fan , @BryanCutler . Merged to

[GitHub] [spark] SparkQA removed a comment on issue #25588: [SPARK-28000][SQL][TEST] Port comments.sql

2019-08-27 Thread GitBox
SparkQA removed a comment on issue #25588: [SPARK-28000][SQL][TEST] Port comments.sql URL: https://github.com/apache/spark/pull/25588#issuecomment-525358126 **[Test build #109821 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109821/testReport)** for PR

[GitHub] [spark] SparkQA commented on issue #25588: [SPARK-28000][SQL][TEST] Port comments.sql

2019-08-27 Thread GitBox
SparkQA commented on issue #25588: [SPARK-28000][SQL][TEST] Port comments.sql URL: https://github.com/apache/spark/pull/25588#issuecomment-525440943 **[Test build #109821 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109821/testReport)** for PR 25588 at

[GitHub] [spark] AmplabJenkins removed a comment on issue #25593: [SPARK-27992][SPARK-28881][PYTHON][2.4] Allow Python to join with connection thread to propagate errors

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #25593: [SPARK-27992][SPARK-28881][PYTHON][2.4] Allow Python to join with connection thread to propagate errors URL: https://github.com/apache/spark/pull/25593#issuecomment-525440471 Test PASSed. Refer to this link for build results (access

[GitHub] [spark] AmplabJenkins removed a comment on issue #25593: [SPARK-27992][SPARK-28881][PYTHON][2.4] Allow Python to join with connection thread to propagate errors

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #25593: [SPARK-27992][SPARK-28881][PYTHON][2.4] Allow Python to join with connection thread to propagate errors URL: https://github.com/apache/spark/pull/25593#issuecomment-525440454 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25593: [SPARK-27992][SPARK-28881][PYTHON][2.4] Allow Python to join with connection thread to propagate errors

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #25593: [SPARK-27992][SPARK-28881][PYTHON][2.4] Allow Python to join with connection thread to propagate errors URL: https://github.com/apache/spark/pull/25593#issuecomment-525440471 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #25593: [SPARK-27992][SPARK-28881][PYTHON][2.4] Allow Python to join with connection thread to propagate errors

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #25593: [SPARK-27992][SPARK-28881][PYTHON][2.4] Allow Python to join with connection thread to propagate errors URL: https://github.com/apache/spark/pull/25593#issuecomment-525440454 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #25342: [SPARK-28571][CORE][SHUFFLE] Use the shuffle writer plugin for the SortShuffleWriter

2019-08-27 Thread GitBox
SparkQA commented on issue #25342: [SPARK-28571][CORE][SHUFFLE] Use the shuffle writer plugin for the SortShuffleWriter URL: https://github.com/apache/spark/pull/25342#issuecomment-525440135 **[Test build #109825 has

[GitHub] [spark] SparkQA removed a comment on issue #25593: [SPARK-27992][SPARK-28881][PYTHON][2.4] Allow Python to join with connection thread to propagate errors

2019-08-27 Thread GitBox
SparkQA removed a comment on issue #25593: [SPARK-27992][SPARK-28881][PYTHON][2.4] Allow Python to join with connection thread to propagate errors URL: https://github.com/apache/spark/pull/25593#issuecomment-525324586 **[Test build #109817 has

[GitHub] [spark] SparkQA commented on issue #25593: [SPARK-27992][SPARK-28881][PYTHON][2.4] Allow Python to join with connection thread to propagate errors

2019-08-27 Thread GitBox
SparkQA commented on issue #25593: [SPARK-27992][SPARK-28881][PYTHON][2.4] Allow Python to join with connection thread to propagate errors URL: https://github.com/apache/spark/pull/25593#issuecomment-525439952 **[Test build #109817 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25342: [SPARK-28571][CORE][SHUFFLE] Use the shuffle writer plugin for the SortShuffleWriter

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #25342: [SPARK-28571][CORE][SHUFFLE] Use the shuffle writer plugin for the SortShuffleWriter URL: https://github.com/apache/spark/pull/25342#issuecomment-525439236 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #25342: [SPARK-28571][CORE][SHUFFLE] Use the shuffle writer plugin for the SortShuffleWriter

2019-08-27 Thread GitBox
AmplabJenkins removed a comment on issue #25342: [SPARK-28571][CORE][SHUFFLE] Use the shuffle writer plugin for the SortShuffleWriter URL: https://github.com/apache/spark/pull/25342#issuecomment-525439232 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25342: [SPARK-28571][CORE][SHUFFLE] Use the shuffle writer plugin for the SortShuffleWriter

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #25342: [SPARK-28571][CORE][SHUFFLE] Use the shuffle writer plugin for the SortShuffleWriter URL: https://github.com/apache/spark/pull/25342#issuecomment-525439236 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25342: [SPARK-28571][CORE][SHUFFLE] Use the shuffle writer plugin for the SortShuffleWriter

2019-08-27 Thread GitBox
AmplabJenkins commented on issue #25342: [SPARK-28571][CORE][SHUFFLE] Use the shuffle writer plugin for the SortShuffleWriter URL: https://github.com/apache/spark/pull/25342#issuecomment-525439232 Merged build finished. Test PASSed.

[GitHub] [spark] vanzin commented on a change in pull request #25299: [SPARK-27651][Core] Avoid the network when shuffle blocks are fetched from the same host

2019-08-27 Thread GitBox
vanzin commented on a change in pull request #25299: [SPARK-27651][Core] Avoid the network when shuffle blocks are fetched from the same host URL: https://github.com/apache/spark/pull/25299#discussion_r318239195 ## File path:

[GitHub] [spark] SparkQA removed a comment on issue #25559: [WIP][DO-NOT-MERGE] Test updating Kinesis deps and current state of Kinesis Python tests

2019-08-27 Thread GitBox
SparkQA removed a comment on issue #25559: [WIP][DO-NOT-MERGE] Test updating Kinesis deps and current state of Kinesis Python tests URL: https://github.com/apache/spark/pull/25559#issuecomment-525363913 **[Test build #4844 has

[GitHub] [spark] SparkQA commented on issue #25559: [WIP][DO-NOT-MERGE] Test updating Kinesis deps and current state of Kinesis Python tests

2019-08-27 Thread GitBox
SparkQA commented on issue #25559: [WIP][DO-NOT-MERGE] Test updating Kinesis deps and current state of Kinesis Python tests URL: https://github.com/apache/spark/pull/25559#issuecomment-525428525 **[Test build #4844 has

[GitHub] [spark] vanzin commented on a change in pull request #25477: [SPARK-28760][SS][TESTS] Add Kafka delegation token end-to-end test with mini KDC

2019-08-27 Thread GitBox
vanzin commented on a change in pull request #25477: [SPARK-28760][SS][TESTS] Add Kafka delegation token end-to-end test with mini KDC URL: https://github.com/apache/spark/pull/25477#discussion_r318231242 ## File path:

[GitHub] [spark] vanzin commented on a change in pull request #25342: [SPARK-28571][CORE][SHUFFLE] Use the shuffle writer plugin for the SortShuffleWriter

2019-08-27 Thread GitBox
vanzin commented on a change in pull request #25342: [SPARK-28571][CORE][SHUFFLE] Use the shuffle writer plugin for the SortShuffleWriter URL: https://github.com/apache/spark/pull/25342#discussion_r318225275 ## File path:

<    1   2   3   4   5   6   7   8   9   10   >