spark git commit: [SPARK-20437][R] R wrappers for rollup and cube

2017-04-25 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master 57e1da394 -> df58a95a3 [SPARK-20437][R] R wrappers for rollup and cube ## What changes were proposed in this pull request? - Add `rollup` and `cube` methods and corresponding generics. - Add short description to the vignette. ## How was

spark git commit: [SPARK-16548][SQL] Inconsistent error handling in JSON parsing SQL functions

2017-04-25 Thread wenchen
Repository: spark Updated Branches: refs/heads/master caf392025 -> 57e1da394 [SPARK-16548][SQL] Inconsistent error handling in JSON parsing SQL functions ## What changes were proposed in this pull request? change to using Jackson's `com.fasterxml.jackson.core.JsonFactory` public

spark git commit: [SPARK-20439][SQL][BACKPORT-2.1] Fix Catalog API listTables and getTable when failed to fetch table metadata

2017-04-25 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.1 8460b0905 -> 6696ad0e8 [SPARK-20439][SQL][BACKPORT-2.1] Fix Catalog API listTables and getTable when failed to fetch table metadata ### What changes were proposed in this pull request? This PR is to backport

spark git commit: [SPARK-18127] Add hooks and extension points to Spark

2017-04-25 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.2 f971ce5dd -> f0de60079 [SPARK-18127] Add hooks and extension points to Spark ## What changes were proposed in this pull request? This patch adds support for customizing the spark session by injecting user-defined custom extensions.

spark git commit: [SPARK-18127] Add hooks and extension points to Spark

2017-04-25 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 0a7f5f279 -> caf392025 [SPARK-18127] Add hooks and extension points to Spark ## What changes were proposed in this pull request? This patch adds support for customizing the spark session by injecting user-defined custom extensions. This

[2/2] spark git commit: Preparing development version 2.1.2-SNAPSHOT

2017-04-25 Thread pwendell
Preparing development version 2.1.2-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/8460b090 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/8460b090 Diff:

[spark] Git Push Summary

2017-04-25 Thread pwendell
Repository: spark Updated Tags: refs/tags/v2.1.1-rc4 [created] 267aca5bd - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[1/2] spark git commit: Preparing Spark release v2.1.1-rc4

2017-04-25 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-2.1 359382c03 -> 8460b0905 Preparing Spark release v2.1.1-rc4 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/267aca5b Tree:

spark git commit: [SPARK-20239][CORE][2.1-BACKPORT] Improve HistoryServer's ACL mechanism

2017-04-25 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-2.1 2d47e1aaf -> 359382c03 [SPARK-20239][CORE][2.1-BACKPORT] Improve HistoryServer's ACL mechanism Current SHS (Spark History Server) has two different ACLs: * ACL of base URL, it is controlled by "spark.acls.enabled" or

spark git commit: [SPARK-20239][CORE][2.1-BACKPORT] Improve HistoryServer's ACL mechanism

2017-04-25 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-2.0 ddf6dd88a -> 068500a4a [SPARK-20239][CORE][2.1-BACKPORT] Improve HistoryServer's ACL mechanism Current SHS (Spark History Server) has two different ACLs: * ACL of base URL, it is controlled by "spark.acls.enabled" or

spark git commit: [SPARK-5484][GRAPHX] Periodically do checkpoint in Pregel

2017-04-25 Thread felixcheung
Repository: spark Updated Branches: refs/heads/branch-2.2 55834a898 -> f971ce5dd [SPARK-5484][GRAPHX] Periodically do checkpoint in Pregel ## What changes were proposed in this pull request? Pregel-based iterative algorithms with more than ~50 iterations begin to slow down and eventually

spark git commit: [SPARK-5484][GRAPHX] Periodically do checkpoint in Pregel

2017-04-25 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master 67eef47ac -> 0a7f5f279 [SPARK-5484][GRAPHX] Periodically do checkpoint in Pregel ## What changes were proposed in this pull request? Pregel-based iterative algorithms with more than ~50 iterations begin to slow down and eventually fail

spark git commit: [SPARK-20449][ML] Upgrade breeze version to 0.13.1

2017-04-25 Thread dbtsai
Repository: spark Updated Branches: refs/heads/branch-2.2 e2591c6d7 -> 55834a898 [SPARK-20449][ML] Upgrade breeze version to 0.13.1 ## What changes were proposed in this pull request? Upgrade breeze version to 0.13.1, which fixed some critical bugs of L-BFGS-B. ## How was this patch tested?

spark git commit: [SPARK-20449][ML] Upgrade breeze version to 0.13.1

2017-04-25 Thread dbtsai
Repository: spark Updated Branches: refs/heads/master 387565cf1 -> 67eef47ac [SPARK-20449][ML] Upgrade breeze version to 0.13.1 ## What changes were proposed in this pull request? Upgrade breeze version to 0.13.1, which fixed some critical bugs of L-BFGS-B. ## How was this patch tested?

spark git commit: [SPARK-18901][FOLLOWUP][ML] Require in LR LogisticAggregator is redundant

2017-04-25 Thread yliang
Repository: spark Updated Branches: refs/heads/branch-2.2 b62ebd91b -> e2591c6d7 [SPARK-18901][FOLLOWUP][ML] Require in LR LogisticAggregator is redundant ## What changes were proposed in this pull request? This is a follow-up PR of #17478. ## How was this patch tested? Existing tests

spark git commit: [SPARK-18901][FOLLOWUP][ML] Require in LR LogisticAggregator is redundant

2017-04-25 Thread yliang
Repository: spark Updated Branches: refs/heads/master 0bc7a9021 -> 387565cf1 [SPARK-18901][FOLLOWUP][ML] Require in LR LogisticAggregator is redundant ## What changes were proposed in this pull request? This is a follow-up PR of #17478. ## How was this patch tested? Existing tests Author:

spark git commit: [SPARK-20404][CORE] Using Option(name) instead of Some(name)

2017-04-25 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.2 c18de9c04 -> b62ebd91b [SPARK-20404][CORE] Using Option(name) instead of Some(name) Using Option(name) instead of Some(name) to prevent runtime failures when using accumulators created like the following ```

spark git commit: [SPARK-20404][CORE] Using Option(name) instead of Some(name)

2017-04-25 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.1 65990fc57 -> 2d47e1aaf [SPARK-20404][CORE] Using Option(name) instead of Some(name) Using Option(name) instead of Some(name) to prevent runtime failures when using accumulators created like the following ```

spark git commit: [SPARK-20404][CORE] Using Option(name) instead of Some(name)

2017-04-25 Thread srowen
Repository: spark Updated Branches: refs/heads/master c8f121951 -> 0bc7a9021 [SPARK-20404][CORE] Using Option(name) instead of Some(name) Using Option(name) instead of Some(name) to prevent runtime failures when using accumulators created like the following ``` sparkContext.accumulator(0,

spark git commit: [SPARK-20455][DOCS] Fix Broken Docker IT Docs

2017-04-25 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.1 427966597 -> 65990fc57 [SPARK-20455][DOCS] Fix Broken Docker IT Docs ## What changes were proposed in this pull request? Just added the Maven `test`goal. ## How was this patch tested? No test needed, just a trivial documentation

spark git commit: [SPARK-20455][DOCS] Fix Broken Docker IT Docs

2017-04-25 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.2 fb59a1954 -> c18de9c04 [SPARK-20455][DOCS] Fix Broken Docker IT Docs ## What changes were proposed in this pull request? Just added the Maven `test`goal. ## How was this patch tested? No test needed, just a trivial documentation

spark git commit: [SPARK-20455][DOCS] Fix Broken Docker IT Docs

2017-04-25 Thread srowen
Repository: spark Updated Branches: refs/heads/master 31345fde8 -> c8f121951 [SPARK-20455][DOCS] Fix Broken Docker IT Docs ## What changes were proposed in this pull request? Just added the Maven `test`goal. ## How was this patch tested? No test needed, just a trivial documentation fix.

[5/5] spark-website git commit: fix conflict

2017-04-25 Thread srowen
fix conflict Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/09046892 Tree: http://git-wip-us.apache.org/repos/asf/spark-website/tree/09046892 Diff:

[3/5] spark-website git commit: simplify maven build

2017-04-25 Thread srowen
simplify maven build Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/9902531e Tree: http://git-wip-us.apache.org/repos/asf/spark-website/tree/9902531e Diff:

[2/5] spark-website git commit: adjust the content structure to make it more reasonable

2017-04-25 Thread srowen
adjust the content structure to make it more reasonable Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/4e458563 Tree: http://git-wip-us.apache.org/repos/asf/spark-website/tree/4e458563 Diff:

[4/5] spark-website git commit: Merge branch 'asf-site' of https://github.com/apache/spark-website into add-sbt-package

2017-04-25 Thread srowen
Merge branch 'asf-site' of https://github.com/apache/spark-website into add-sbt-package Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/3c96a509 Tree:

[1/5] spark-website git commit: fix an error in the descriptions of `Build Targets For Individual Projects`

2017-04-25 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site aa1c66e42 -> 09046892b fix an error in the descriptions of `Build Targets For Individual Projects` Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: