[GitHub] [spark] AmplabJenkins removed a comment on issue #24565: [SPARK-27665][Core] Split fetch shuffle blocks protocol from OpenBlocks

2019-05-15 Thread GitBox
AmplabJenkins removed a comment on issue #24565: [SPARK-27665][Core] Split fetch shuffle blocks protocol from OpenBlocks URL: https://github.com/apache/spark/pull/24565#issuecomment-492680039 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24565: [SPARK-27665][Core] Split fetch shuffle blocks protocol from OpenBlocks

2019-05-15 Thread GitBox
AmplabJenkins removed a comment on issue #24565: [SPARK-27665][Core] Split fetch shuffle blocks protocol from OpenBlocks URL: https://github.com/apache/spark/pull/24565#issuecomment-492680048 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24612: [SPARK-27718][Examples] fixed the error of pagerank

2019-05-15 Thread GitBox
AmplabJenkins removed a comment on issue #24612: [SPARK-27718][Examples] fixed the error of pagerank URL: https://github.com/apache/spark/pull/24612#issuecomment-492534634 Can one of the admins verify this patch? This is an

[GitHub] [spark] AmplabJenkins commented on issue #24598: [SPARK-27699][SQL] Partially push down disjunctive predicated in Parquet/ORC

2019-05-15 Thread GitBox
AmplabJenkins commented on issue #24598: [SPARK-27699][SQL] Partially push down disjunctive predicated in Parquet/ORC URL: https://github.com/apache/spark/pull/24598#issuecomment-492701728 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24598: [SPARK-27699][SQL] Partially push down disjunctive predicated in Parquet/ORC

2019-05-15 Thread GitBox
AmplabJenkins commented on issue #24598: [SPARK-27699][SQL] Partially push down disjunctive predicated in Parquet/ORC URL: https://github.com/apache/spark/pull/24598#issuecomment-492701737 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24598: [SPARK-27699][SQL] Partially push down disjunctive predicated in Parquet/ORC

2019-05-15 Thread GitBox
AmplabJenkins removed a comment on issue #24598: [SPARK-27699][SQL] Partially push down disjunctive predicated in Parquet/ORC URL: https://github.com/apache/spark/pull/24598#issuecomment-492701737 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24598: [SPARK-27699][SQL] Partially push down disjunctive predicated in Parquet/ORC

2019-05-15 Thread GitBox
AmplabJenkins removed a comment on issue #24598: [SPARK-27699][SQL] Partially push down disjunctive predicated in Parquet/ORC URL: https://github.com/apache/spark/pull/24598#issuecomment-492701728 Merged build finished. Test PASSed.

[GitHub] [spark] wangyum commented on issue #24523: [SPARK-27631][SQL] Avoid repeating calculate table statistics when AUTO_SIZE_UPDATE_ENABLED is enabled

2019-05-15 Thread GitBox
wangyum commented on issue #24523: [SPARK-27631][SQL] Avoid repeating calculate table statistics when AUTO_SIZE_UPDATE_ENABLED is enabled URL: https://github.com/apache/spark/pull/24523#issuecomment-492722518 retest this please

[GitHub] [spark] skonto commented on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling

2019-05-15 Thread GitBox
skonto commented on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling URL: https://github.com/apache/spark/pull/24613#issuecomment-492733735 @arunmahadevan yes we have thought of this, my colleague @seglo has created a tool

[GitHub] [spark] SparkQA removed a comment on issue #24565: [SPARK-27665][Core] Split fetch shuffle blocks protocol from OpenBlocks

2019-05-15 Thread GitBox
SparkQA removed a comment on issue #24565: [SPARK-27665][Core] Split fetch shuffle blocks protocol from OpenBlocks URL: https://github.com/apache/spark/pull/24565#issuecomment-492681611 **[Test build #105419 has

[GitHub] [spark] skonto edited a comment on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling

2019-05-15 Thread GitBox
skonto edited a comment on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling URL: https://github.com/apache/spark/pull/24613#issuecomment-492733735 @arunmahadevan yes we have thought of this, my colleague @seglo has created

[GitHub] [spark] AmplabJenkins commented on issue #24565: [SPARK-27665][Core] Split fetch shuffle blocks protocol from OpenBlocks

2019-05-15 Thread GitBox
AmplabJenkins commented on issue #24565: [SPARK-27665][Core] Split fetch shuffle blocks protocol from OpenBlocks URL: https://github.com/apache/spark/pull/24565#issuecomment-492734035 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24565: [SPARK-27665][Core] Split fetch shuffle blocks protocol from OpenBlocks

2019-05-15 Thread GitBox
AmplabJenkins commented on issue #24565: [SPARK-27665][Core] Split fetch shuffle blocks protocol from OpenBlocks URL: https://github.com/apache/spark/pull/24565#issuecomment-492734024 Merged build finished. Test PASSed. This

[GitHub] [spark] SparkQA commented on issue #24595: [SPARK-20774][SPARK-27036][SQL] Cancel the running broadcast execution on BroadcastTimeout

2019-05-15 Thread GitBox
SparkQA commented on issue #24595: [SPARK-20774][SPARK-27036][SQL] Cancel the running broadcast execution on BroadcastTimeout URL: https://github.com/apache/spark/pull/24595#issuecomment-492769542 **[Test build #105425 has

[GitHub] [spark] jiangxb1987 commented on a change in pull request #24374: [WIP][SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-05-15 Thread GitBox
jiangxb1987 commented on a change in pull request #24374: [WIP][SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#discussion_r284391661 ## File path: core/src/main/scala/org/apache/spark/SparkContext.scala ##

[GitHub] [spark] SparkQA commented on issue #24615: [SPARK-27488][CORE] Driver interface to support GPU resources

2019-05-15 Thread GitBox
SparkQA commented on issue #24615: [SPARK-27488][CORE] Driver interface to support GPU resources URL: https://github.com/apache/spark/pull/24615#issuecomment-492769513 **[Test build #105424 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24598: [SPARK-27699][SQL] Partially push down disjunctive predicated in Parquet/ORC

2019-05-15 Thread GitBox
AmplabJenkins removed a comment on issue #24598: [SPARK-27699][SQL] Partially push down disjunctive predicated in Parquet/ORC URL: https://github.com/apache/spark/pull/24598#issuecomment-492673857 Build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24598: [SPARK-27699][SQL] Partially push down disjunctive predicated in Parquet/ORC

2019-05-15 Thread GitBox
AmplabJenkins removed a comment on issue #24598: [SPARK-27699][SQL] Partially push down disjunctive predicated in Parquet/ORC URL: https://github.com/apache/spark/pull/24598#issuecomment-492673878 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24598: [SPARK-27699][SQL] Partially push down disjunctive predicated in Parquet/ORC

2019-05-15 Thread GitBox
AmplabJenkins commented on issue #24598: [SPARK-27699][SQL] Partially push down disjunctive predicated in Parquet/ORC URL: https://github.com/apache/spark/pull/24598#issuecomment-492673878 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] srowen commented on issue #24586: [SPARK-27682][CORE][GRAPHX][MLLIB] Replace use of collections and methods that will be removed in Scala 2.13 with work-alikes

2019-05-15 Thread GitBox
srowen commented on issue #24586: [SPARK-27682][CORE][GRAPHX][MLLIB] Replace use of collections and methods that will be removed in Scala 2.13 with work-alikes URL: https://github.com/apache/spark/pull/24586#issuecomment-492678850 BTW I worked around `to[C]` by simply avoiding it. What

[GitHub] [spark] srowen commented on issue #24586: [SPARK-27682][CORE][GRAPHX][MLLIB] Replace use of collections and methods that will be removed in Scala 2.13 with work-alikes

2019-05-15 Thread GitBox
srowen commented on issue #24586: [SPARK-27682][CORE][GRAPHX][MLLIB] Replace use of collections and methods that will be removed in Scala 2.13 with work-alikes URL: https://github.com/apache/spark/pull/24586#issuecomment-492678999 Merged to master

[GitHub] [spark] AmplabJenkins commented on issue #24523: [SPARK-27631][SQL] Avoid repeating calculate table statistics when AUTO_SIZE_UPDATE_ENABLED is enabled

2019-05-15 Thread GitBox
AmplabJenkins commented on issue #24523: [SPARK-27631][SQL] Avoid repeating calculate table statistics when AUTO_SIZE_UPDATE_ENABLED is enabled URL: https://github.com/apache/spark/pull/24523#issuecomment-492692881 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #24523: [SPARK-27631][SQL] Avoid repeating calculate table statistics when AUTO_SIZE_UPDATE_ENABLED is enabled

2019-05-15 Thread GitBox
AmplabJenkins removed a comment on issue #24523: [SPARK-27631][SQL] Avoid repeating calculate table statistics when AUTO_SIZE_UPDATE_ENABLED is enabled URL: https://github.com/apache/spark/pull/24523#issuecomment-492692881 Test PASSed. Refer to this link for build results (access rights

[GitHub] [spark] AmplabJenkins commented on issue #24523: [SPARK-27631][SQL] Avoid repeating calculate table statistics when AUTO_SIZE_UPDATE_ENABLED is enabled

2019-05-15 Thread GitBox
AmplabJenkins commented on issue #24523: [SPARK-27631][SQL] Avoid repeating calculate table statistics when AUTO_SIZE_UPDATE_ENABLED is enabled URL: https://github.com/apache/spark/pull/24523#issuecomment-492692864 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24523: [SPARK-27631][SQL] Avoid repeating calculate table statistics when AUTO_SIZE_UPDATE_ENABLED is enabled

2019-05-15 Thread GitBox
AmplabJenkins removed a comment on issue #24523: [SPARK-27631][SQL] Avoid repeating calculate table statistics when AUTO_SIZE_UPDATE_ENABLED is enabled URL: https://github.com/apache/spark/pull/24523#issuecomment-492692864 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24523: [SPARK-27631][SQL] Avoid repeating calculate table statistics when AUTO_SIZE_UPDATE_ENABLED is enabled

2019-05-15 Thread GitBox
AmplabJenkins removed a comment on issue #24523: [SPARK-27631][SQL] Avoid repeating calculate table statistics when AUTO_SIZE_UPDATE_ENABLED is enabled URL: https://github.com/apache/spark/pull/24523#issuecomment-492720842 Test FAILed. Refer to this link for build results (access rights

[GitHub] [spark] gatorsmile commented on a change in pull request #24595: [SPARK-20774][SPARK-27036][CORE] Cancel the running broadcast execution on BroadcastTimeout

2019-05-15 Thread GitBox
gatorsmile commented on a change in pull request #24595: [SPARK-20774][SPARK-27036][CORE] Cancel the running broadcast execution on BroadcastTimeout URL: https://github.com/apache/spark/pull/24595#discussion_r284356123 ## File path:

[GitHub] [spark] vanzin commented on issue #24582: [SPARK-27678][UI] Allow user impersonation in the UI.

2019-05-15 Thread GitBox
vanzin commented on issue #24582: [SPARK-27678][UI] Allow user impersonation in the UI. URL: https://github.com/apache/spark/pull/24582#issuecomment-492737142 Merging to master. This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins commented on issue #24615: [SPARK-27488] Driver interface to support GPU resources

2019-05-15 Thread GitBox
AmplabJenkins commented on issue #24615: [SPARK-27488] Driver interface to support GPU resources URL: https://github.com/apache/spark/pull/24615#issuecomment-492758768 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #24615: [SPARK-27488] Driver interface to support GPU resources

2019-05-15 Thread GitBox
SparkQA commented on issue #24615: [SPARK-27488] Driver interface to support GPU resources URL: https://github.com/apache/spark/pull/24615#issuecomment-492758739 **[Test build #105423 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105423/testReport)**

[GitHub] [spark] AmplabJenkins commented on issue #24615: [SPARK-27488] Driver interface to support GPU resources

2019-05-15 Thread GitBox
AmplabJenkins commented on issue #24615: [SPARK-27488] Driver interface to support GPU resources URL: https://github.com/apache/spark/pull/24615#issuecomment-492758758 Merged build finished. Test FAILed. This is an automated

[GitHub] [spark] skonto edited a comment on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling

2019-05-15 Thread GitBox
skonto edited a comment on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling URL: https://github.com/apache/spark/pull/24613#issuecomment-492766741 @arunmahadevan regarding the other issue about the failing batch I think

[GitHub] [spark] SparkQA commented on issue #24612: [SPARK-27718][Examples] fixed the error of pagerank

2019-05-15 Thread GitBox
SparkQA commented on issue #24612: [SPARK-27718][Examples] fixed the error of pagerank URL: https://github.com/apache/spark/pull/24612#issuecomment-492680475 **[Test build #4780 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4780/testReport)** for PR

[GitHub] [spark] srowen closed pull request #24586: [SPARK-27682][CORE][GRAPHX][MLLIB] Replace use of collections and methods that will be removed in Scala 2.13 with work-alikes

2019-05-15 Thread GitBox
srowen closed pull request #24586: [SPARK-27682][CORE][GRAPHX][MLLIB] Replace use of collections and methods that will be removed in Scala 2.13 with work-alikes URL: https://github.com/apache/spark/pull/24586 This is an

[GitHub] [spark] SparkQA commented on issue #24612: [SPARK-27718][Examples] fixed the error of pagerank

2019-05-15 Thread GitBox
SparkQA commented on issue #24612: [SPARK-27718][Examples] fixed the error of pagerank URL: https://github.com/apache/spark/pull/24612#issuecomment-492685226 **[Test build #4780 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4780/testReport)** for PR

[GitHub] [spark] wangyum commented on issue #24523: [SPARK-27631][SQL] Avoid repeating calculate table statistics when AUTO_SIZE_UPDATE_ENABLED is enabled

2019-05-15 Thread GitBox
wangyum commented on issue #24523: [SPARK-27631][SQL] Avoid repeating calculate table statistics when AUTO_SIZE_UPDATE_ENABLED is enabled URL: https://github.com/apache/spark/pull/24523#issuecomment-492724555 Sorry @dongjoon-hyun. The issue happens in two cases. I updated it to the pr

[GitHub] [spark] arunmahadevan commented on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling

2019-05-15 Thread GitBox
arunmahadevan commented on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling URL: https://github.com/apache/spark/pull/24613#issuecomment-492732093 The source offsets are available in the `StreamingQueryProgress` in the

[GitHub] [spark] skonto edited a comment on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling

2019-05-15 Thread GitBox
skonto edited a comment on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling URL: https://github.com/apache/spark/pull/24613#issuecomment-492733735 @arunmahadevan yes we have thought of this, my colleague @seglo has created

[GitHub] [spark] seglo commented on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling

2019-05-15 Thread GitBox
seglo commented on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling URL: https://github.com/apache/spark/pull/24613#issuecomment-492739340 > The source offsets are available in the `StreamingQueryProgress` in the listener

[GitHub] [spark] SparkQA commented on issue #24523: [SPARK-27631][SQL] Avoid repeating calculate table statistics

2019-05-15 Thread GitBox
SparkQA commented on issue #24523: [SPARK-27631][SQL] Avoid repeating calculate table statistics URL: https://github.com/apache/spark/pull/24523#issuecomment-492739258 **[Test build #105422 has

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24598: [SPARK-27699][SQL] Partially push down disjunctive predicated in Parquet/ORC

2019-05-15 Thread GitBox
dongjoon-hyun commented on a change in pull request #24598: [SPARK-27699][SQL] Partially push down disjunctive predicated in Parquet/ORC URL: https://github.com/apache/spark/pull/24598#discussion_r284369791 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #24615: [SPARK-27488] Driver interface to support GPU resources

2019-05-15 Thread GitBox
AmplabJenkins commented on issue #24615: [SPARK-27488] Driver interface to support GPU resources URL: https://github.com/apache/spark/pull/24615#issuecomment-492761190 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24615: [SPARK-27488] Driver interface to support GPU resources

2019-05-15 Thread GitBox
AmplabJenkins commented on issue #24615: [SPARK-27488] Driver interface to support GPU resources URL: https://github.com/apache/spark/pull/24615#issuecomment-492761182 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] SparkQA commented on issue #24598: [SPARK-27699][SQL] Partially push down disjunctive predicated in Parquet/ORC

2019-05-15 Thread GitBox
SparkQA commented on issue #24598: [SPARK-27699][SQL] Partially push down disjunctive predicated in Parquet/ORC URL: https://github.com/apache/spark/pull/24598#issuecomment-492673059 **[Test build #105415 has

[GitHub] [spark] vanzin closed pull request #24582: [SPARK-27678][UI] Allow user impersonation in the UI.

2019-05-15 Thread GitBox
vanzin closed pull request #24582: [SPARK-27678][UI] Allow user impersonation in the UI. URL: https://github.com/apache/spark/pull/24582 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins commented on issue #24523: [SPARK-27631][SQL] Avoid repeating calculate table statistics

2019-05-15 Thread GitBox
AmplabJenkins commented on issue #24523: [SPARK-27631][SQL] Avoid repeating calculate table statistics URL: https://github.com/apache/spark/pull/24523#issuecomment-492738435 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24523: [SPARK-27631][SQL] Avoid repeating calculate table statistics

2019-05-15 Thread GitBox
AmplabJenkins commented on issue #24523: [SPARK-27631][SQL] Avoid repeating calculate table statistics URL: https://github.com/apache/spark/pull/24523#issuecomment-492738425 Merged build finished. Test PASSed. This is an

[GitHub] [spark] fhoering edited a comment on issue #22422: [SPARK-25433][PYSPARK] Add support for pex in PySpark

2019-05-15 Thread GitBox
fhoering edited a comment on issue #22422: [SPARK-25433][PYSPARK] Add support for pex in PySpark URL: https://github.com/apache/spark/pull/22422#issuecomment-492755572 @rs-trevort Finally a custom entry point is not necessary anymore. There was a fix in pex to be able to call modules

[GitHub] [spark] AmplabJenkins removed a comment on issue #23267: [SPARK-25401] [SQL] Reorder join predicates to match child outputOrdering

2019-05-15 Thread GitBox
AmplabJenkins removed a comment on issue #23267: [SPARK-25401] [SQL] Reorder join predicates to match child outputOrdering URL: https://github.com/apache/spark/pull/23267#issuecomment-485463442 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #23267: [SPARK-25401] [SQL] Reorder join predicates to match child outputOrdering

2019-05-15 Thread GitBox
AmplabJenkins commented on issue #23267: [SPARK-25401] [SQL] Reorder join predicates to match child outputOrdering URL: https://github.com/apache/spark/pull/23267#issuecomment-492757282 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins removed a comment on issue #24595: [SPARK-20774][SPARK-27036][SQL] Cancel the running broadcast execution on BroadcastTimeout

2019-05-15 Thread GitBox
AmplabJenkins removed a comment on issue #24595: [SPARK-20774][SPARK-27036][SQL] Cancel the running broadcast execution on BroadcastTimeout URL: https://github.com/apache/spark/pull/24595#issuecomment-492768145 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24595: [SPARK-20774][SPARK-27036][SQL] Cancel the running broadcast execution on BroadcastTimeout

2019-05-15 Thread GitBox
AmplabJenkins removed a comment on issue #24595: [SPARK-20774][SPARK-27036][SQL] Cancel the running broadcast execution on BroadcastTimeout URL: https://github.com/apache/spark/pull/24595#issuecomment-492768156 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #24615: [SPARK-27488][CORE] Driver interface to support GPU resources

2019-05-15 Thread GitBox
AmplabJenkins removed a comment on issue #24615: [SPARK-27488][CORE] Driver interface to support GPU resources URL: https://github.com/apache/spark/pull/24615#issuecomment-492768118 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #24615: [SPARK-27488][CORE] Driver interface to support GPU resources

2019-05-15 Thread GitBox
AmplabJenkins removed a comment on issue #24615: [SPARK-27488][CORE] Driver interface to support GPU resources URL: https://github.com/apache/spark/pull/24615#issuecomment-492768125 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24595: [SPARK-20774][SPARK-27036][SQL] Cancel the running broadcast execution on BroadcastTimeout

2019-05-15 Thread GitBox
AmplabJenkins commented on issue #24595: [SPARK-20774][SPARK-27036][SQL] Cancel the running broadcast execution on BroadcastTimeout URL: https://github.com/apache/spark/pull/24595#issuecomment-492768145 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24615: [SPARK-27488][CORE] Driver interface to support GPU resources

2019-05-15 Thread GitBox
AmplabJenkins commented on issue #24615: [SPARK-27488][CORE] Driver interface to support GPU resources URL: https://github.com/apache/spark/pull/24615#issuecomment-492768125 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24615: [SPARK-27488][CORE] Driver interface to support GPU resources

2019-05-15 Thread GitBox
AmplabJenkins commented on issue #24615: [SPARK-27488][CORE] Driver interface to support GPU resources URL: https://github.com/apache/spark/pull/24615#issuecomment-492768118 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #24595: [SPARK-20774][SPARK-27036][SQL] Cancel the running broadcast execution on BroadcastTimeout

2019-05-15 Thread GitBox
AmplabJenkins commented on issue #24595: [SPARK-20774][SPARK-27036][SQL] Cancel the running broadcast execution on BroadcastTimeout URL: https://github.com/apache/spark/pull/24595#issuecomment-492768156 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] srowen commented on issue #17864: [SPARK-20604][ML] Allow imputer to handle numeric types

2019-05-15 Thread GitBox
srowen commented on issue #17864: [SPARK-20604][ML] Allow imputer to handle numeric types URL: https://github.com/apache/spark/pull/17864#issuecomment-492684001 Reviewing this old one .. I'd favor not changing the column type. When outputting the mean, it should round back to integer

[GitHub] [spark] rdblue commented on issue #24469: [SPARK-27576][SQL] table capability to skip the output column resolution

2019-05-15 Thread GitBox
rdblue commented on issue #24469: [SPARK-27576][SQL] table capability to skip the output column resolution URL: https://github.com/apache/spark/pull/24469#issuecomment-492716918 @cloud-fan, I think the cleanest way to fix it is to commit this PR with the new method in `NamedRelation`.

[GitHub] [spark] rdblue commented on issue #24594: [SPARK-27693][SQL] Add default catalog property

2019-05-15 Thread GitBox
rdblue commented on issue #24594: [SPARK-27693][SQL] Add default catalog property URL: https://github.com/apache/spark/pull/24594#issuecomment-492723465 I've rebased and updated this to enable the tests that were ignored in #24570.

[GitHub] [spark] SparkQA commented on issue #24565: [SPARK-27665][Core] Split fetch shuffle blocks protocol from OpenBlocks

2019-05-15 Thread GitBox
SparkQA commented on issue #24565: [SPARK-27665][Core] Split fetch shuffle blocks protocol from OpenBlocks URL: https://github.com/apache/spark/pull/24565#issuecomment-492733362 **[Test build #105419 has

[GitHub] [spark] SparkQA commented on issue #24615: [SPARK-27488] Driver interface to support GPU resources

2019-05-15 Thread GitBox
SparkQA commented on issue #24615: [SPARK-27488] Driver interface to support GPU resources URL: https://github.com/apache/spark/pull/24615#issuecomment-492758230 **[Test build #105423 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105423/testReport)** for

[GitHub] [spark] tgravescs commented on issue #24615: [SPARK-27488] Driver interface to support GPU resources

2019-05-15 Thread GitBox
tgravescs commented on issue #24615: [SPARK-27488] Driver interface to support GPU resources URL: https://github.com/apache/spark/pull/24615#issuecomment-492758411 @mengxr @jiangxb1987 This might overlap a bit with https://github.com/apache/spark/pull/24374/ just let me know which way

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling

2019-05-15 Thread GitBox
dongjoon-hyun commented on a change in pull request #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling URL: https://github.com/apache/spark/pull/24613#discussion_r284386063 ## File path:

[GitHub] [spark] skonto commented on a change in pull request #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling

2019-05-15 Thread GitBox
skonto commented on a change in pull request #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling URL: https://github.com/apache/spark/pull/24613#discussion_r284386550 ## File path:

[GitHub] [spark] skonto edited a comment on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling

2019-05-15 Thread GitBox
skonto edited a comment on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling URL: https://github.com/apache/spark/pull/24613#issuecomment-492766741 @arunmahadevan regarding the other issue about the failing batch I think

[GitHub] [spark] skonto edited a comment on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling

2019-05-15 Thread GitBox
skonto edited a comment on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling URL: https://github.com/apache/spark/pull/24613#issuecomment-492766741 @arunmahadevan regarding the other issue about the failing batch I think

[GitHub] [spark] viirya commented on issue #24614: [SPARK-27712][PySpark][SQL] Returns correct schema even under different column order when creating dataframe

2019-05-15 Thread GitBox
viirya commented on issue #24614: [SPARK-27712][PySpark][SQL] Returns correct schema even under different column order when creating dataframe URL: https://github.com/apache/spark/pull/24614#issuecomment-492672560 This is more interesting, as we allow something like: ```python

[GitHub] [spark] SparkQA removed a comment on issue #24598: [SPARK-27699][SQL] Partially push down disjunctive predicated in Parquet/ORC

2019-05-15 Thread GitBox
SparkQA removed a comment on issue #24598: [SPARK-27699][SQL] Partially push down disjunctive predicated in Parquet/ORC URL: https://github.com/apache/spark/pull/24598#issuecomment-492633073 **[Test build #105417 has

[GitHub] [spark] SparkQA commented on issue #24598: [SPARK-27699][SQL] Partially push down disjunctive predicated in Parquet/ORC

2019-05-15 Thread GitBox
SparkQA commented on issue #24598: [SPARK-27699][SQL] Partially push down disjunctive predicated in Parquet/ORC URL: https://github.com/apache/spark/pull/24598#issuecomment-492701001 **[Test build #105417 has

[GitHub] [spark] skonto edited a comment on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling

2019-05-15 Thread GitBox
skonto edited a comment on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling URL: https://github.com/apache/spark/pull/24613#issuecomment-492733735 @arunmahadevan yes we have thought of this, my colleague @seglo has created

[GitHub] [spark] fhoering commented on issue #22422: [SPARK-25433][PYSPARK] Add support for pex in PySpark

2019-05-15 Thread GitBox
fhoering commented on issue #22422: [SPARK-25433][PYSPARK] Add support for pex in PySpark URL: https://github.com/apache/spark/pull/22422#issuecomment-492755572 @rs-trevort It is documented here with some examples:

[GitHub] [spark] SparkQA removed a comment on issue #24615: [SPARK-27488] Driver interface to support GPU resources

2019-05-15 Thread GitBox
SparkQA removed a comment on issue #24615: [SPARK-27488] Driver interface to support GPU resources URL: https://github.com/apache/spark/pull/24615#issuecomment-492758230 **[Test build #105423 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24615: [SPARK-27488] Driver interface to support GPU resources

2019-05-15 Thread GitBox
AmplabJenkins removed a comment on issue #24615: [SPARK-27488] Driver interface to support GPU resources URL: https://github.com/apache/spark/pull/24615#issuecomment-492758758 Merged build finished. Test FAILed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #24565: [SPARK-27665][Core] Split fetch shuffle blocks protocol from OpenBlocks

2019-05-15 Thread GitBox
AmplabJenkins commented on issue #24565: [SPARK-27665][Core] Split fetch shuffle blocks protocol from OpenBlocks URL: https://github.com/apache/spark/pull/24565#issuecomment-492680039 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #24565: [SPARK-27665][Core] Split fetch shuffle blocks protocol from OpenBlocks

2019-05-15 Thread GitBox
AmplabJenkins commented on issue #24565: [SPARK-27665][Core] Split fetch shuffle blocks protocol from OpenBlocks URL: https://github.com/apache/spark/pull/24565#issuecomment-492680048 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #24612: [SPARK-27718][Examples] fixed the error of pagerank

2019-05-15 Thread GitBox
SparkQA removed a comment on issue #24612: [SPARK-27718][Examples] fixed the error of pagerank URL: https://github.com/apache/spark/pull/24612#issuecomment-492680475 **[Test build #4780 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4780/testReport)**

[GitHub] [spark] rdblue commented on issue #24570: [SPARK-24923][SQL] Implement v2 CreateTableAsSelect

2019-05-15 Thread GitBox
rdblue commented on issue #24570: [SPARK-24923][SQL] Implement v2 CreateTableAsSelect URL: https://github.com/apache/spark/pull/24570#issuecomment-492712804 Thanks for reviewing, @cloud-fan and @mccheah! I'll get the next few PRs posted.

[GitHub] [spark] SparkQA commented on issue #24594: [SPARK-27693][SQL] Add default catalog property

2019-05-15 Thread GitBox
SparkQA commented on issue #24594: [SPARK-27693][SQL] Add default catalog property URL: https://github.com/apache/spark/pull/24594#issuecomment-492726246 **[Test build #105421 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105421/testReport)** for PR

[GitHub] [spark] rs-trevor commented on issue #22422: [SPARK-25433][PYSPARK] Add support for pex in PySpark

2019-05-15 Thread GitBox
rs-trevor commented on issue #22422: [SPARK-25433][PYSPARK] Add support for pex in PySpark URL: https://github.com/apache/spark/pull/22422#issuecomment-492745897 @fhoering Any chance we can document this a bit more here? I think you're saying - Add a __main__.py to the root

[GitHub] [spark] fhoering edited a comment on issue #22422: [SPARK-25433][PYSPARK] Add support for pex in PySpark

2019-05-15 Thread GitBox
fhoering edited a comment on issue #22422: [SPARK-25433][PYSPARK] Add support for pex in PySpark URL: https://github.com/apache/spark/pull/22422#issuecomment-492755572 @rs-trevort Finally a custom entry point is not necessary anymore. It has been fixed in pex to support to call

[GitHub] [spark] fhoering edited a comment on issue #22422: [SPARK-25433][PYSPARK] Add support for pex in PySpark

2019-05-15 Thread GitBox
fhoering edited a comment on issue #22422: [SPARK-25433][PYSPARK] Add support for pex in PySpark URL: https://github.com/apache/spark/pull/22422#issuecomment-492755572 @rs-trevort Finally a custom entry point is not necessary anymore. It has been fixed in pex to support to call

[GitHub] [spark] AmplabJenkins removed a comment on issue #24615: [SPARK-27488] Driver interface to support GPU resources

2019-05-15 Thread GitBox
AmplabJenkins removed a comment on issue #24615: [SPARK-27488] Driver interface to support GPU resources URL: https://github.com/apache/spark/pull/24615#issuecomment-492758768 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] srowen commented on a change in pull request #24609: [SPARK-27715][SQL] SQL query details in UI dose not show in correct format.

2019-05-15 Thread GitBox
srowen commented on a change in pull request #24609: [SPARK-27715][SQL] SQL query details in UI dose not show in correct format. URL: https://github.com/apache/spark/pull/24609#discussion_r284284384 ## File path:

[GitHub] [spark] SparkQA commented on issue #24565: [SPARK-27665][Core] Split fetch shuffle blocks protocol from OpenBlocks

2019-05-15 Thread GitBox
SparkQA commented on issue #24565: [SPARK-27665][Core] Split fetch shuffle blocks protocol from OpenBlocks URL: https://github.com/apache/spark/pull/24565#issuecomment-492681611 **[Test build #105419 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24523: [SPARK-27631][SQL] Avoid repeating calculate table statistics when AUTO_SIZE_UPDATE_ENABLED is enabled

2019-05-15 Thread GitBox
AmplabJenkins removed a comment on issue #24523: [SPARK-27631][SQL] Avoid repeating calculate table statistics when AUTO_SIZE_UPDATE_ENABLED is enabled URL: https://github.com/apache/spark/pull/24523#issuecomment-492720824 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #24523: [SPARK-27631][SQL] Avoid repeating calculate table statistics when AUTO_SIZE_UPDATE_ENABLED is enabled

2019-05-15 Thread GitBox
SparkQA removed a comment on issue #24523: [SPARK-27631][SQL] Avoid repeating calculate table statistics when AUTO_SIZE_UPDATE_ENABLED is enabled URL: https://github.com/apache/spark/pull/24523#issuecomment-492689449 **[Test build #105420 has

[GitHub] [spark] AmplabJenkins commented on issue #24594: [SPARK-27693][SQL] Add default catalog property

2019-05-15 Thread GitBox
AmplabJenkins commented on issue #24594: [SPARK-27693][SQL] Add default catalog property URL: https://github.com/apache/spark/pull/24594#issuecomment-492724839 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] AmplabJenkins commented on issue #24594: [SPARK-27693][SQL] Add default catalog property

2019-05-15 Thread GitBox
AmplabJenkins commented on issue #24594: [SPARK-27693][SQL] Add default catalog property URL: https://github.com/apache/spark/pull/24594#issuecomment-492724850 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24594: [SPARK-27693][SQL] Add default catalog property

2019-05-15 Thread GitBox
AmplabJenkins removed a comment on issue #24594: [SPARK-27693][SQL] Add default catalog property URL: https://github.com/apache/spark/pull/24594#issuecomment-492724850 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24594: [SPARK-27693][SQL] Add default catalog property

2019-05-15 Thread GitBox
AmplabJenkins removed a comment on issue #24594: [SPARK-27693][SQL] Add default catalog property URL: https://github.com/apache/spark/pull/24594#issuecomment-492724839 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] dongjoon-hyun commented on issue #24523: [SPARK-27631][SQL] Avoid repeating calculate table statistics

2019-05-15 Thread GitBox
dongjoon-hyun commented on issue #24523: [SPARK-27631][SQL] Avoid repeating calculate table statistics URL: https://github.com/apache/spark/pull/24523#issuecomment-492736218 Retest this please. This is an automated message

[GitHub] [spark] AmplabJenkins removed a comment on issue #24523: [SPARK-27631][SQL] Avoid repeating calculate table statistics

2019-05-15 Thread GitBox
AmplabJenkins removed a comment on issue #24523: [SPARK-27631][SQL] Avoid repeating calculate table statistics URL: https://github.com/apache/spark/pull/24523#issuecomment-492738435 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24523: [SPARK-27631][SQL] Avoid repeating calculate table statistics

2019-05-15 Thread GitBox
AmplabJenkins removed a comment on issue #24523: [SPARK-27631][SQL] Avoid repeating calculate table statistics URL: https://github.com/apache/spark/pull/24523#issuecomment-492738425 Merged build finished. Test PASSed. This

[GitHub] [spark] fhoering edited a comment on issue #22422: [SPARK-25433][PYSPARK] Add support for pex in PySpark

2019-05-15 Thread GitBox
fhoering edited a comment on issue #22422: [SPARK-25433][PYSPARK] Add support for pex in PySpark URL: https://github.com/apache/spark/pull/22422#issuecomment-492755572 @rs-trevort Finally a custom entry point is not necessary anymore. There was a fix in pex to be able to call modules

[GitHub] [spark] rs-trevor commented on issue #22422: [SPARK-25433][PYSPARK] Add support for pex in PySpark

2019-05-15 Thread GitBox
rs-trevor commented on issue #22422: [SPARK-25433][PYSPARK] Add support for pex in PySpark URL: https://github.com/apache/spark/pull/22422#issuecomment-492756812 This is great. What a guy! Thanks @fhoering This is an

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24490: [SPARK-27300][GRAPH][test-maven] Add Spark Graph modules and dependencies

2019-05-15 Thread GitBox
dongjoon-hyun commented on a change in pull request #24490: [SPARK-27300][GRAPH][test-maven] Add Spark Graph modules and dependencies URL: https://github.com/apache/spark/pull/24490#discussion_r284383005 ## File path: dev/deps/spark-deps-hadoop-2.7 ## @@ -17,13 +18,17 @@

[GitHub] [spark] AmplabJenkins removed a comment on issue #24615: [SPARK-27488] Driver interface to support GPU resources

2019-05-15 Thread GitBox
AmplabJenkins removed a comment on issue #24615: [SPARK-27488] Driver interface to support GPU resources URL: https://github.com/apache/spark/pull/24615#issuecomment-492761182 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #24615: [SPARK-27488] Driver interface to support GPU resources

2019-05-15 Thread GitBox
AmplabJenkins removed a comment on issue #24615: [SPARK-27488] Driver interface to support GPU resources URL: https://github.com/apache/spark/pull/24615#issuecomment-492761190 Test PASSed. Refer to this link for build results (access rights to CI server needed):

  1   2   3   4   5   6   7   8   >