[GitHub] [spark] SparkQA removed a comment on issue #25993: [DO-NOT-MERGE][R] Install Arrow and test Arrow optimization in AppVeyor build

2019-10-01 Thread GitBox
SparkQA removed a comment on issue #25993: [DO-NOT-MERGE][R] Install Arrow and test Arrow optimization in AppVeyor build URL: https://github.com/apache/spark/pull/25993#issuecomment-537347523 **[Test build #111673 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25993: [DO-NOT-MERGE][R] Install Arrow and test Arrow optimization in AppVeyor build

2019-10-01 Thread GitBox
AmplabJenkins removed a comment on issue #25993: [DO-NOT-MERGE][R] Install Arrow and test Arrow optimization in AppVeyor build URL: https://github.com/apache/spark/pull/25993#issuecomment-537347956 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #25993: [DO-NOT-MERGE][R] Install Arrow and test Arrow optimization in AppVeyor build

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #25993: [DO-NOT-MERGE][R] Install Arrow and test Arrow optimization in AppVeyor build URL: https://github.com/apache/spark/pull/25993#issuecomment-537347960 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25993: [DO-NOT-MERGE][R] Install Arrow and test Arrow optimization in AppVeyor build

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #25993: [DO-NOT-MERGE][R] Install Arrow and test Arrow optimization in AppVeyor build URL: https://github.com/apache/spark/pull/25993#issuecomment-537347956 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #25993: [DO-NOT-MERGE][R] Install Arrow and test Arrow optimization in AppVeyor build

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #25993: [DO-NOT-MERGE][R] Install Arrow and test Arrow optimization in AppVeyor build URL: https://github.com/apache/spark/pull/25993#issuecomment-537347882 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25993: [DO-NOT-MERGE][R] Install Arrow and test Arrow optimization in AppVeyor build

2019-10-01 Thread GitBox
AmplabJenkins removed a comment on issue #25993: [DO-NOT-MERGE][R] Install Arrow and test Arrow optimization in AppVeyor build URL: https://github.com/apache/spark/pull/25993#issuecomment-537347886 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25993: [DO-NOT-MERGE][R] Install Arrow and test Arrow optimization in AppVeyor build

2019-10-01 Thread GitBox
AmplabJenkins removed a comment on issue #25993: [DO-NOT-MERGE][R] Install Arrow and test Arrow optimization in AppVeyor build URL: https://github.com/apache/spark/pull/25993#issuecomment-537347882 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #25993: [DO-NOT-MERGE][R] Install Arrow and test Arrow optimization in AppVeyor build

2019-10-01 Thread GitBox
SparkQA commented on issue #25993: [DO-NOT-MERGE][R] Install Arrow and test Arrow optimization in AppVeyor build URL: https://github.com/apache/spark/pull/25993#issuecomment-537347950 **[Test build #111673 has

[GitHub] [spark] AmplabJenkins commented on issue #25993: [DO-NOT-MERGE][R] Install Arrow and test Arrow optimization in AppVeyor build

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #25993: [DO-NOT-MERGE][R] Install Arrow and test Arrow optimization in AppVeyor build URL: https://github.com/apache/spark/pull/25993#issuecomment-537347886 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #25993: [DO-NOT-MERGE][R] Install Arrow and test Arrow optimization in AppVeyor build

2019-10-01 Thread GitBox
SparkQA commented on issue #25993: [DO-NOT-MERGE][R] Install Arrow and test Arrow optimization in AppVeyor build URL: https://github.com/apache/spark/pull/25993#issuecomment-537347523 **[Test build #111673 has

[GitHub] [spark] SparkQA commented on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT)

2019-10-01 Thread GitBox
SparkQA commented on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT) URL: https://github.com/apache/spark/pull/16478#issuecomment-537345896 **[Test build #111672 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/111672/testReport)** for PR

[GitHub] [spark] AmplabJenkins removed a comment on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT)

2019-10-01 Thread GitBox
AmplabJenkins removed a comment on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT) URL: https://github.com/apache/spark/pull/16478#issuecomment-537344688 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT)

2019-10-01 Thread GitBox
AmplabJenkins removed a comment on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT) URL: https://github.com/apache/spark/pull/16478#issuecomment-537344682 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT)

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT) URL: https://github.com/apache/spark/pull/16478#issuecomment-537344688 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT)

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT) URL: https://github.com/apache/spark/pull/16478#issuecomment-537344682 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] ueshin commented on a change in pull request #25666: [SPARK-28962][SQL] Provide index argument to filter lambda functions

2019-10-01 Thread GitBox
ueshin commented on a change in pull request #25666: [SPARK-28962][SQL] Provide index argument to filter lambda functions URL: https://github.com/apache/spark/pull/25666#discussion_r330375481 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

2019-10-01 Thread GitBox
AmplabJenkins removed a comment on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#issuecomment-537338604 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

2019-10-01 Thread GitBox
AmplabJenkins removed a comment on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#issuecomment-537338610 Test PASSed. Refer to this link for build results (access rights to

[GitHub] [spark] AmplabJenkins commented on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#issuecomment-537338610 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#issuecomment-537338604 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

2019-10-01 Thread GitBox
SparkQA commented on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#issuecomment-537338309 **[Test build #111671 has

[GitHub] [spark] sujith71955 commented on a change in pull request #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

2019-10-01 Thread GitBox
sujith71955 commented on a change in pull request #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#discussion_r330373508 ## File path:

[GitHub] [spark] sujith71955 commented on a change in pull request #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

2019-10-01 Thread GitBox
sujith71955 commented on a change in pull request #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#discussion_r330373167 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #25995: SPARK-29324: Fix overwrite behaviour for saveAsTable

2019-10-01 Thread GitBox
AmplabJenkins removed a comment on issue #25995: SPARK-29324: Fix overwrite behaviour for saveAsTable URL: https://github.com/apache/spark/pull/25995#issuecomment-537336729 Can one of the admins verify this patch? This is

[GitHub] [spark] AmplabJenkins commented on issue #25995: SPARK-29324: Fix overwrite behaviour for saveAsTable

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #25995: SPARK-29324: Fix overwrite behaviour for saveAsTable URL: https://github.com/apache/spark/pull/25995#issuecomment-537336969 Can one of the admins verify this patch? This is an

[GitHub] [spark] AmplabJenkins commented on issue #25995: SPARK-29324: Fix overwrite behaviour for saveAsTable

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #25995: SPARK-29324: Fix overwrite behaviour for saveAsTable URL: https://github.com/apache/spark/pull/25995#issuecomment-537336729 Can one of the admins verify this patch? This is an

[GitHub] [spark] karuppayya opened a new pull request #25995: SPARK-29324: Fix overwrite behaviour for saveAsTable

2019-10-01 Thread GitBox
karuppayya opened a new pull request #25995: SPARK-29324: Fix overwrite behaviour for saveAsTable URL: https://github.com/apache/spark/pull/25995 ### What changes were proposed in this pull request? When saveAstable is used in overwrite mode, the metadata of the table gets

[GitHub] [spark] AmplabJenkins removed a comment on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

2019-10-01 Thread GitBox
AmplabJenkins removed a comment on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#issuecomment-537332388 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] imback82 commented on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

2019-10-01 Thread GitBox
imback82 commented on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#issuecomment-537332401 I just resolved the conflicts. Thanks @cloud-fan!

[GitHub] [spark] AmplabJenkins commented on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#issuecomment-537332385 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

2019-10-01 Thread GitBox
AmplabJenkins removed a comment on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#issuecomment-537332385 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#issuecomment-537332388 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

2019-10-01 Thread GitBox
AmplabJenkins removed a comment on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#issuecomment-536642091 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

2019-10-01 Thread GitBox
SparkQA commented on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#issuecomment-537332117 **[Test build #111670 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25670: [SPARK-28869][CORE] Roll over event log files

2019-10-01 Thread GitBox
AmplabJenkins removed a comment on issue #25670: [SPARK-28869][CORE] Roll over event log files URL: https://github.com/apache/spark/pull/25670#issuecomment-537331195 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25670: [SPARK-28869][CORE] Roll over event log files

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #25670: [SPARK-28869][CORE] Roll over event log files URL: https://github.com/apache/spark/pull/25670#issuecomment-537331195 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25670: [SPARK-28869][CORE] Roll over event log files

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #25670: [SPARK-28869][CORE] Roll over event log files URL: https://github.com/apache/spark/pull/25670#issuecomment-537331186 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] AmplabJenkins removed a comment on issue #25670: [SPARK-28869][CORE] Roll over event log files

2019-10-01 Thread GitBox
AmplabJenkins removed a comment on issue #25670: [SPARK-28869][CORE] Roll over event log files URL: https://github.com/apache/spark/pull/25670#issuecomment-537331186 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#issuecomment-537330979 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

2019-10-01 Thread GitBox
AmplabJenkins removed a comment on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#issuecomment-537330973 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

2019-10-01 Thread GitBox
AmplabJenkins removed a comment on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#issuecomment-537330979 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#issuecomment-537330973 Merged build finished. Test PASSed. This

[GitHub] [spark] SparkQA removed a comment on issue #25670: [SPARK-28869][CORE] Roll over event log files

2019-10-01 Thread GitBox
SparkQA removed a comment on issue #25670: [SPARK-28869][CORE] Roll over event log files URL: https://github.com/apache/spark/pull/25670#issuecomment-537305903 **[Test build #111663 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/111663/testReport)** for

[GitHub] [spark] SparkQA commented on issue #25670: [SPARK-28869][CORE] Roll over event log files

2019-10-01 Thread GitBox
SparkQA commented on issue #25670: [SPARK-28869][CORE] Roll over event log files URL: https://github.com/apache/spark/pull/25670#issuecomment-537330819 **[Test build #111663 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/111663/testReport)** for PR 25670

[GitHub] [spark] AmplabJenkins commented on issue #25994: [SPARK-29323][WEBUI] Add tooltip for The Executors Tab's column names in the Spark history server Page

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #25994: [SPARK-29323][WEBUI] Add tooltip for The Executors Tab's column names in the Spark history server Page URL: https://github.com/apache/spark/pull/25994#issuecomment-537329652 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins removed a comment on issue #25994: [SPARK-29323][WEBUI] Add tooltip for The Executors Tab's column names in the Spark history server Page

2019-10-01 Thread GitBox
AmplabJenkins removed a comment on issue #25994: [SPARK-29323][WEBUI] Add tooltip for The Executors Tab's column names in the Spark history server Page URL: https://github.com/apache/spark/pull/25994#issuecomment-537329412 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #25994: [SPARK-29323][WEBUI] Add tooltip for The Executors Tab's column names in the Spark history server Page

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #25994: [SPARK-29323][WEBUI] Add tooltip for The Executors Tab's column names in the Spark history server Page URL: https://github.com/apache/spark/pull/25994#issuecomment-537329412 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #24898: [SPARK-22340][PYTHON] Add a mode to pin Python thread into JVM's

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #24898: [SPARK-22340][PYTHON] Add a mode to pin Python thread into JVM's URL: https://github.com/apache/spark/pull/24898#issuecomment-537328712 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #24898: [SPARK-22340][PYTHON] Add a mode to pin Python thread into JVM's

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #24898: [SPARK-22340][PYTHON] Add a mode to pin Python thread into JVM's URL: https://github.com/apache/spark/pull/24898#issuecomment-537328716 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24898: [SPARK-22340][PYTHON] Add a mode to pin Python thread into JVM's

2019-10-01 Thread GitBox
AmplabJenkins removed a comment on issue #24898: [SPARK-22340][PYTHON] Add a mode to pin Python thread into JVM's URL: https://github.com/apache/spark/pull/24898#issuecomment-537328716 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24898: [SPARK-22340][PYTHON] Add a mode to pin Python thread into JVM's

2019-10-01 Thread GitBox
AmplabJenkins removed a comment on issue #24898: [SPARK-22340][PYTHON] Add a mode to pin Python thread into JVM's URL: https://github.com/apache/spark/pull/24898#issuecomment-537328712 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #24898: [SPARK-22340][PYTHON] Add a mode to pin Python thread into JVM's

2019-10-01 Thread GitBox
SparkQA removed a comment on issue #24898: [SPARK-22340][PYTHON] Add a mode to pin Python thread into JVM's URL: https://github.com/apache/spark/pull/24898#issuecomment-537301414 **[Test build #111662 has

[GitHub] [spark] liucht-inspur opened a new pull request #25994: [SPARK-29323][WEBUI] Add tooltip for The Executors Tab's column names in the Spark history server Page

2019-10-01 Thread GitBox
liucht-inspur opened a new pull request #25994: [SPARK-29323][WEBUI] Add tooltip for The Executors Tab's column names in the Spark history server Page URL: https://github.com/apache/spark/pull/25994 ### What changes were proposed in this pull request? This PR is Adding tooltip for

[GitHub] [spark] SparkQA commented on issue #24898: [SPARK-22340][PYTHON] Add a mode to pin Python thread into JVM's

2019-10-01 Thread GitBox
SparkQA commented on issue #24898: [SPARK-22340][PYTHON] Add a mode to pin Python thread into JVM's URL: https://github.com/apache/spark/pull/24898#issuecomment-537328365 **[Test build #111662 has

[GitHub] [spark] ueshin commented on a change in pull request #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-10-01 Thread GitBox
ueshin commented on a change in pull request #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#discussion_r330365006 ## File path: sql/core/src/test/java/test/org/apache/spark/sql/JavaHigherOrderFunctionsSuite.java

[GitHub] [spark] dongjoon-hyun commented on issue #25988: [SPARK-29313][SQL] Fix failure on writing to `noop` in benchmarks

2019-10-01 Thread GitBox
dongjoon-hyun commented on issue #25988: [SPARK-29313][SQL] Fix failure on writing to `noop` in benchmarks URL: https://github.com/apache/spark/pull/25988#issuecomment-537325767 Thank you, @MaxGekk , @cloud-fan , @srowen .

[GitHub] [spark] dongjoon-hyun closed pull request #25988: [SPARK-29313][SQL] Fix failure on writing to `noop` in benchmarks

2019-10-01 Thread GitBox
dongjoon-hyun closed pull request #25988: [SPARK-29313][SQL] Fix failure on writing to `noop` in benchmarks URL: https://github.com/apache/spark/pull/25988 This is an automated message from the Apache Git Service. To

[GitHub] [spark] dongjoon-hyun commented on issue #25988: [SPARK-29313][SQL] Fix failure on writing to `noop` in benchmarks

2019-10-01 Thread GitBox
dongjoon-hyun commented on issue #25988: [SPARK-29313][SQL] Fix failure on writing to `noop` in benchmarks URL: https://github.com/apache/spark/pull/25988#issuecomment-537325531 Thanks. Then, I'll merge this. This will unblock the benchmarks.

[GitHub] [spark] dongjoon-hyun commented on issue #25988: [SPARK-29313][SQL] Fix failure on writing to `noop` in benchmarks

2019-10-01 Thread GitBox
dongjoon-hyun commented on issue #25988: [SPARK-29313][SQL] Fix failure on writing to `noop` in benchmarks URL: https://github.com/apache/spark/pull/25988#issuecomment-537325559 Merged to master. This is an automated message

[GitHub] [spark] dongjoon-hyun closed pull request #25992: [SPARK-29320][TESTS] Compare `sql/core` module in JDK8/11 (Part 1)

2019-10-01 Thread GitBox
dongjoon-hyun closed pull request #25992: [SPARK-29320][TESTS] Compare `sql/core` module in JDK8/11 (Part 1) URL: https://github.com/apache/spark/pull/25992 This is an automated message from the Apache Git Service. To

[GitHub] [spark] dongjoon-hyun commented on issue #25992: [SPARK-29320][TESTS] Compare `sql/core` module in JDK8/11 (Part 1)

2019-10-01 Thread GitBox
dongjoon-hyun commented on issue #25992: [SPARK-29320][TESTS] Compare `sql/core` module in JDK8/11 (Part 1) URL: https://github.com/apache/spark/pull/25992#issuecomment-537324686 After resolve the conflicts, I'll regenerate the result and reopen this.

[GitHub] [spark] cloud-fan commented on issue #25988: [SPARK-29313][SQL] Fix failure on writing to `noop` in benchmarks

2019-10-01 Thread GitBox
cloud-fan commented on issue #25988: [SPARK-29313][SQL] Fix failure on writing to `noop` in benchmarks URL: https://github.com/apache/spark/pull/25988#issuecomment-537324573 we are going to support all save modes in `DataFrameWriter`. For now this change is OK to me to unblock benchmark

[GitHub] [spark] maropu commented on a change in pull request #25992: [SPARK-29320][TESTS] Compare `sql/core` module in JDK8/11 (Part 1)

2019-10-01 Thread GitBox
maropu commented on a change in pull request #25992: [SPARK-29320][TESTS] Compare `sql/core` module in JDK8/11 (Part 1) URL: https://github.com/apache/spark/pull/25992#discussion_r330362889 ## File path: sql/core/benchmarks/CSVBenchmark-results.txt ## @@ -2,58 +2,3 @@

[GitHub] [spark] maropu commented on a change in pull request #25666: [SPARK-28962][SQL] Provide index argument to filter lambda functions

2019-10-01 Thread GitBox
maropu commented on a change in pull request #25666: [SPARK-28962][SQL] Provide index argument to filter lambda functions URL: https://github.com/apache/spark/pull/25666#discussion_r330362826 ## File path:

[GitHub] [spark] henrydavidge commented on a change in pull request #25666: [SPARK-28962][SQL] Provide index argument to filter lambda functions

2019-10-01 Thread GitBox
henrydavidge commented on a change in pull request #25666: [SPARK-28962][SQL] Provide index argument to filter lambda functions URL: https://github.com/apache/spark/pull/25666#discussion_r330362364 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25992: [SPARK-29320][TESTS] Compare `sql/core` module in JDK8/11 (Part 1)

2019-10-01 Thread GitBox
dongjoon-hyun commented on a change in pull request #25992: [SPARK-29320][TESTS] Compare `sql/core` module in JDK8/11 (Part 1) URL: https://github.com/apache/spark/pull/25992#discussion_r330361985 ## File path: sql/core/benchmarks/CSVBenchmark-results.txt ## @@ -2,58 +2,3

[GitHub] [spark] AmplabJenkins removed a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-10-01 Thread GitBox
AmplabJenkins removed a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-537322311 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins removed a comment on issue #25993: [DO-NOT-MERGE][R] Install Arrow and test Arrow optimization in AppVeyor build

2019-10-01 Thread GitBox
AmplabJenkins removed a comment on issue #25993: [DO-NOT-MERGE][R] Install Arrow and test Arrow optimization in AppVeyor build URL: https://github.com/apache/spark/pull/25993#issuecomment-537322290 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-10-01 Thread GitBox
AmplabJenkins removed a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-537322317 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25993: [DO-NOT-MERGE][R] Install Arrow and test Arrow optimization in AppVeyor build

2019-10-01 Thread GitBox
AmplabJenkins removed a comment on issue #25993: [DO-NOT-MERGE][R] Install Arrow and test Arrow optimization in AppVeyor build URL: https://github.com/apache/spark/pull/25993#issuecomment-537322294 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25993: [DO-NOT-MERGE][R] Install Arrow and test Arrow optimization in AppVeyor build

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #25993: [DO-NOT-MERGE][R] Install Arrow and test Arrow optimization in AppVeyor build URL: https://github.com/apache/spark/pull/25993#issuecomment-537322290 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-537322311 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-537322317 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25993: [DO-NOT-MERGE][R] Install Arrow and test Arrow optimization in AppVeyor build

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #25993: [DO-NOT-MERGE][R] Install Arrow and test Arrow optimization in AppVeyor build URL: https://github.com/apache/spark/pull/25993#issuecomment-537322294 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #25993: [DO-NOT-MERGE][R] Install Arrow and test Arrow optimization in AppVeyor build

2019-10-01 Thread GitBox
SparkQA commented on issue #25993: [DO-NOT-MERGE][R] Install Arrow and test Arrow optimization in AppVeyor build URL: https://github.com/apache/spark/pull/25993#issuecomment-537322064 **[Test build #111667 has

[GitHub] [spark] SparkQA commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-10-01 Thread GitBox
SparkQA commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-537322074 **[Test build #111669 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/111669/testReport)**

[GitHub] [spark] SparkQA commented on issue #25760: [SPARK-29054][SS] Invalidate Kafka consumer when new delegation token available

2019-10-01 Thread GitBox
SparkQA commented on issue #25760: [SPARK-29054][SS] Invalidate Kafka consumer when new delegation token available URL: https://github.com/apache/spark/pull/25760#issuecomment-537322067 **[Test build #111668 has

[GitHub] [spark] maropu commented on a change in pull request #25992: [SPARK-29320][TESTS] Compare `sql/core` module in JDK8/11 (Part 1)

2019-10-01 Thread GitBox
maropu commented on a change in pull request #25992: [SPARK-29320][TESTS] Compare `sql/core` module in JDK8/11 (Part 1) URL: https://github.com/apache/spark/pull/25992#discussion_r330361486 ## File path: sql/core/benchmarks/CSVBenchmark-results.txt ## @@ -2,58 +2,3 @@

[GitHub] [spark] HyukjinKwon opened a new pull request #25993: [DO-NOT-MERGE][R] Install Arrow and test Arrow optimization in AppVeyor build

2019-10-01 Thread GitBox
HyukjinKwon opened a new pull request #25993: [DO-NOT-MERGE][R] Install Arrow and test Arrow optimization in AppVeyor build URL: https://github.com/apache/spark/pull/25993 ### What changes were proposed in this pull request? This PR proposes to install Arrow and test Arrow

[GitHub] [spark] cloud-fan commented on a change in pull request #25990: [SPARK-29248][SQL][WIP] Pass in number of partitions to WriteBuilder

2019-10-01 Thread GitBox
cloud-fan commented on a change in pull request #25990: [SPARK-29248][SQL][WIP] Pass in number of partitions to WriteBuilder URL: https://github.com/apache/spark/pull/25990#discussion_r330361239 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #25990: [SPARK-29248][SQL][WIP] Pass in number of partitions to WriteBuilder

2019-10-01 Thread GitBox
cloud-fan commented on a change in pull request #25990: [SPARK-29248][SQL][WIP] Pass in number of partitions to WriteBuilder URL: https://github.com/apache/spark/pull/25990#discussion_r330361189 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #25990: [SPARK-29248][SQL][WIP] Pass in number of partitions to WriteBuilder

2019-10-01 Thread GitBox
cloud-fan commented on a change in pull request #25990: [SPARK-29248][SQL][WIP] Pass in number of partitions to WriteBuilder URL: https://github.com/apache/spark/pull/25990#discussion_r330361054 ## File path:

[GitHub] [spark] dongjoon-hyun commented on issue #25988: [SPARK-29313][SQL] Fix failure on writing to `noop` in benchmarks

2019-10-01 Thread GitBox
dongjoon-hyun commented on issue #25988: [SPARK-29313][SQL] Fix failure on writing to `noop` in benchmarks URL: https://github.com/apache/spark/pull/25988#issuecomment-537321407 @brkyvz and @cloud-fan . Is this change intentional?

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #25760: [SPARK-29054][SS] Invalidate Kafka consumer when new delegation token available

2019-10-01 Thread GitBox
gaborgsomogyi commented on a change in pull request #25760: [SPARK-29054][SS] Invalidate Kafka consumer when new delegation token available URL: https://github.com/apache/spark/pull/25760#discussion_r330360852 ## File path:

[GitHub] [spark] dongjoon-hyun commented on issue #25988: [SPARK-29313][SQL] Fix failure on writing to `noop` in benchmarks

2019-10-01 Thread GitBox
dongjoon-hyun commented on issue #25988: [SPARK-29313][SQL] Fix failure on writing to `noop` in benchmarks URL: https://github.com/apache/spark/pull/25988#issuecomment-537321016 I'm not sure about this. For me, we need to fix the root cause inside DSv2.

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #25760: [SPARK-29054][SS] Invalidate Kafka consumer when new delegation token available

2019-10-01 Thread GitBox
gaborgsomogyi commented on a change in pull request #25760: [SPARK-29054][SS] Invalidate Kafka consumer when new delegation token available URL: https://github.com/apache/spark/pull/25760#discussion_r330360862 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #25955: [SPARK-29277][SQL] Add early DSv2 filter and projection pushdown (WIP)

2019-10-01 Thread GitBox
cloud-fan commented on a change in pull request #25955: [SPARK-29277][SQL] Add early DSv2 filter and projection pushdown (WIP) URL: https://github.com/apache/spark/pull/25955#discussion_r330360645 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #25955: [SPARK-29277][SQL] Add early DSv2 filter and projection pushdown (WIP)

2019-10-01 Thread GitBox
cloud-fan commented on a change in pull request #25955: [SPARK-29277][SQL] Add early DSv2 filter and projection pushdown (WIP) URL: https://github.com/apache/spark/pull/25955#discussion_r330360144 ## File path:

[GitHub] [spark] viirya commented on a change in pull request #25600: [SPARK-11150][SQL] Dynamic Partition Pruning

2019-10-01 Thread GitBox
viirya commented on a change in pull request #25600: [SPARK-11150][SQL] Dynamic Partition Pruning URL: https://github.com/apache/spark/pull/25600#discussion_r330359786 ## File path: sql/core/src/main/scala/org/apache/spark/sql/dynamicpruning/PartitionPruning.scala ## @@

[GitHub] [spark] maropu commented on a change in pull request #25666: [SPARK-28962][SQL] Provide index argument to filter lambda functions

2019-10-01 Thread GitBox
maropu commented on a change in pull request #25666: [SPARK-28962][SQL] Provide index argument to filter lambda functions URL: https://github.com/apache/spark/pull/25666#discussion_r330358827 ## File path:

[GitHub] [spark] cloud-fan commented on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

2019-10-01 Thread GitBox
cloud-fan commented on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#issuecomment-537316802 I think it's ready to go. @imback82 can you fix the conflict? thanks!

[GitHub] [spark] cloud-fan commented on a change in pull request #25600: [SPARK-11150][SQL] Dynamic Partition Pruning

2019-10-01 Thread GitBox
cloud-fan commented on a change in pull request #25600: [SPARK-11150][SQL] Dynamic Partition Pruning URL: https://github.com/apache/spark/pull/25600#discussion_r330356993 ## File path: sql/core/src/main/scala/org/apache/spark/sql/dynamicpruning/PartitionPruning.scala ##

[GitHub] [spark] cloud-fan closed pull request #25985: [SPARK-29310][CORE][TESTS] TestMemoryManager should implement getExecutionMemoryUsageForTask()

2019-10-01 Thread GitBox
cloud-fan closed pull request #25985: [SPARK-29310][CORE][TESTS] TestMemoryManager should implement getExecutionMemoryUsageForTask() URL: https://github.com/apache/spark/pull/25985 This is an automated message from the

[GitHub] [spark] cloud-fan commented on issue #25985: [SPARK-29310][CORE][TESTS] TestMemoryManager should implement getExecutionMemoryUsageForTask()

2019-10-01 Thread GitBox
cloud-fan commented on issue #25985: [SPARK-29310][CORE][TESTS] TestMemoryManager should implement getExecutionMemoryUsageForTask() URL: https://github.com/apache/spark/pull/25985#issuecomment-537315968 thanks, merging to master!

[GitHub] [spark] AmplabJenkins commented on issue #25960: [SPARK-29283][SQL] Error message is hidden when query from JDBC, especially enabled adaptive execution

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #25960: [SPARK-29283][SQL] Error message is hidden when query from JDBC, especially enabled adaptive execution URL: https://github.com/apache/spark/pull/25960#issuecomment-537311371 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] SparkQA commented on issue #25960: [SPARK-29283][SQL] Error message is hidden when query from JDBC, especially enabled adaptive execution

2019-10-01 Thread GitBox
SparkQA commented on issue #25960: [SPARK-29283][SQL] Error message is hidden when query from JDBC, especially enabled adaptive execution URL: https://github.com/apache/spark/pull/25960#issuecomment-537311325 **[Test build #111664 has

[GitHub] [spark] SparkQA removed a comment on issue #25960: [SPARK-29283][SQL] Error message is hidden when query from JDBC, especially enabled adaptive execution

2019-10-01 Thread GitBox
SparkQA removed a comment on issue #25960: [SPARK-29283][SQL] Error message is hidden when query from JDBC, especially enabled adaptive execution URL: https://github.com/apache/spark/pull/25960#issuecomment-537307379 **[Test build #111664 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25960: [SPARK-29283][SQL] Error message is hidden when query from JDBC, especially enabled adaptive execution

2019-10-01 Thread GitBox
AmplabJenkins removed a comment on issue #25960: [SPARK-29283][SQL] Error message is hidden when query from JDBC, especially enabled adaptive execution URL: https://github.com/apache/spark/pull/25960#issuecomment-537311371 Test PASSed. Refer to this link for build results (access rights

[GitHub] [spark] AmplabJenkins commented on issue #25960: [SPARK-29283][SQL] Error message is hidden when query from JDBC, especially enabled adaptive execution

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #25960: [SPARK-29283][SQL] Error message is hidden when query from JDBC, especially enabled adaptive execution URL: https://github.com/apache/spark/pull/25960#issuecomment-537311369 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25960: [SPARK-29283][SQL] Error message is hidden when query from JDBC, especially enabled adaptive execution

2019-10-01 Thread GitBox
AmplabJenkins removed a comment on issue #25960: [SPARK-29283][SQL] Error message is hidden when query from JDBC, especially enabled adaptive execution URL: https://github.com/apache/spark/pull/25960#issuecomment-537311369 Merged build finished. Test PASSed.

  1   2   3   4   5   6   >