spark git commit: [SPARK-18232][MESOS] Support CNI

2016-11-14 Thread rxin
Repository: spark Updated Branches: refs/heads/master 86430cc4e -> d89bfc923 [SPARK-18232][MESOS] Support CNI ## What changes were proposed in this pull request? Adds support for CNI-isolated containers ## How was this patch tested? I launched SparkPi both with and without

spark-website git commit: Add Big Data Analytics with Spark and Hadoop book.

2016-11-14 Thread rxin
Repository: spark-website Updated Branches: refs/heads/asf-site 8f5026783 -> 4e10a1ac1 Add Big Data Analytics with Spark and Hadoop book. Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/4e10a1ac Tree:

spark-website git commit: Update Maven coordinates.

2016-11-14 Thread rxin
Repository: spark-website Updated Branches: refs/heads/asf-site 8940afe14 -> 8f5026783 Update Maven coordinates. Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/8f502678 Tree:

spark git commit: [SPARK-18430][SQL] Fixed Exception Messages when Hitting an Invocation Exception of Function Lookup

2016-11-14 Thread rxin
Repository: spark Updated Branches: refs/heads/master c31def1dd -> 86430cc4e [SPARK-18430][SQL] Fixed Exception Messages when Hitting an Invocation Exception of Function Lookup ### What changes were proposed in this pull request? When the exception is an invocation exception during function

spark git commit: [SPARK-18430][SQL] Fixed Exception Messages when Hitting an Invocation Exception of Function Lookup

2016-11-14 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 649c15fae -> a0125fd68 [SPARK-18430][SQL] Fixed Exception Messages when Hitting an Invocation Exception of Function Lookup ### What changes were proposed in this pull request? When the exception is an invocation exception during

spark git commit: [SPARK-18428][DOC] Update docs for GraphX

2016-11-14 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 27999b366 -> 649c15fae [SPARK-18428][DOC] Update docs for GraphX ## What changes were proposed in this pull request? 1, Add link of `VertexRDD` and `EdgeRDD` 2, Notify in `Vertex and Edge RDDs` that not all methods are listed 3,

spark git commit: [SPARK-18428][DOC] Update docs for GraphX

2016-11-14 Thread rxin
Repository: spark Updated Branches: refs/heads/master c07187823 -> c31def1dd [SPARK-18428][DOC] Update docs for GraphX ## What changes were proposed in this pull request? 1, Add link of `VertexRDD` and `EdgeRDD` 2, Notify in `Vertex and Edge RDDs` that not all methods are listed 3, `VertexID`

[3/3] spark-website git commit: Add 2.0.2 release.

2016-11-14 Thread rxin
Add 2.0.2 release. Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/39b5c3d6 Tree: http://git-wip-us.apache.org/repos/asf/spark-website/tree/39b5c3d6 Diff:

[1/3] spark-website git commit: Add 2.0.2 release.

2016-11-14 Thread rxin
Repository: spark-website Updated Branches: refs/heads/asf-site 0bd363165 -> 39b5c3d65 http://git-wip-us.apache.org/repos/asf/spark-website/blob/39b5c3d6/site/releases/spark-release-1-1-1.html -- diff --git

[2/3] spark-website git commit: Add 2.0.2 release.

2016-11-14 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/39b5c3d6/site/news/spark-2-0-1-released.html -- diff --git a/site/news/spark-2-0-1-released.html b/site/news/spark-2-0-1-released.html index f772398..09e052d 100644 ---

spark git commit: [SPARK-18124] Observed delay based Event Time Watermarks

2016-11-14 Thread tdas
Repository: spark Updated Branches: refs/heads/branch-2.1 ae66799fe -> 27999b366 [SPARK-18124] Observed delay based Event Time Watermarks This PR adds a new method `withWatermark` to the `Dataset` API, which can be used specify an _event time watermark_. An event time watermark allows the

spark git commit: [SPARK-18124] Observed delay based Event Time Watermarks

2016-11-14 Thread tdas
Repository: spark Updated Branches: refs/heads/master bd85603ba -> c07187823 [SPARK-18124] Observed delay based Event Time Watermarks This PR adds a new method `withWatermark` to the `Dataset` API, which can be used specify an _event time watermark_. An event time watermark allows the

spark git commit: [SPARK-17348][SQL] Incorrect results from subquery transformation

2016-11-14 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/branch-2.0 c40fcbc14 -> 9abff1bcd [SPARK-17348][SQL] Incorrect results from subquery transformation ## What changes were proposed in this pull request? Return an Analysis exception when there is a correlated non-equality predicate in a subquery

spark git commit: [SPARK-17348][SQL] Incorrect results from subquery transformation

2016-11-14 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/branch-2.1 cff7a70b5 -> ae66799fe [SPARK-17348][SQL] Incorrect results from subquery transformation ## What changes were proposed in this pull request? Return an Analysis exception when there is a correlated non-equality predicate in a subquery

spark git commit: [SPARK-17348][SQL] Incorrect results from subquery transformation

2016-11-14 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master 75934457d -> bd85603ba [SPARK-17348][SQL] Incorrect results from subquery transformation ## What changes were proposed in this pull request? Return an Analysis exception when there is a correlated non-equality predicate in a subquery and

spark git commit: [SPARK-11496][GRAPHX][FOLLOWUP] Add param checking for runParallelPersonalizedPageRank

2016-11-14 Thread dbtsai
Repository: spark Updated Branches: refs/heads/branch-2.1 db691f05c -> cff7a70b5 [SPARK-11496][GRAPHX][FOLLOWUP] Add param checking for runParallelPersonalizedPageRank ## What changes were proposed in this pull request? add the param checking to keep in line with other algos ## How was this

spark git commit: [SPARK-11496][GRAPHX][FOLLOWUP] Add param checking for runParallelPersonalizedPageRank

2016-11-14 Thread dbtsai
Repository: spark Updated Branches: refs/heads/master 89d1fa58d -> 75934457d [SPARK-11496][GRAPHX][FOLLOWUP] Add param checking for runParallelPersonalizedPageRank ## What changes were proposed in this pull request? add the param checking to keep in line with other algos ## How was this

spark git commit: [SPARK-17510][STREAMING][KAFKA] config max rate on a per-partition basis

2016-11-14 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master bdfe60ac9 -> 89d1fa58d [SPARK-17510][STREAMING][KAFKA] config max rate on a per-partition basis ## What changes were proposed in this pull request? Allow configuration of max rate on a per-topicpartition basis. ## How was this patch

spark git commit: [SPARK-17510][STREAMING][KAFKA] config max rate on a per-partition basis

2016-11-14 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.1 3c623d226 -> db691f05c [SPARK-17510][STREAMING][KAFKA] config max rate on a per-partition basis ## What changes were proposed in this pull request? Allow configuration of max rate on a per-topicpartition basis. ## How was this patch

spark git commit: [SPARK-18416][STRUCTURED STREAMING] Fixed temp file leak in state store

2016-11-14 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.0 666396510 -> c40fcbc14 [SPARK-18416][STRUCTURED STREAMING] Fixed temp file leak in state store ## What changes were proposed in this pull request? StateStore.get() causes temporary files to be created immediately, even if the store

spark git commit: [SPARK-18416][STRUCTURED STREAMING] Fixed temp file leak in state store

2016-11-14 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.1 c07fe1c59 -> 3c623d226 [SPARK-18416][STRUCTURED STREAMING] Fixed temp file leak in state store ## What changes were proposed in this pull request? StateStore.get() causes temporary files to be created immediately, even if the store

spark git commit: [SPARK-18416][STRUCTURED STREAMING] Fixed temp file leak in state store

2016-11-14 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master 9d07ceee7 -> bdfe60ac9 [SPARK-18416][STRUCTURED STREAMING] Fixed temp file leak in state store ## What changes were proposed in this pull request? StateStore.get() causes temporary files to be created immediately, even if the store is

spark git commit: [SPARK-18432][DOC] Changed HDFS default block size from 64MB to 128MB

2016-11-14 Thread sarutak
Repository: spark Updated Branches: refs/heads/branch-2.0 26ae5cfa7 -> 666396510 [SPARK-18432][DOC] Changed HDFS default block size from 64MB to 128MB Changed HDFS default block size from 64MB to 128MB. https://issues.apache.org/jira/browse/SPARK-18432 Author: Noritaka Sekiyama

spark git commit: [SPARK-18432][DOC] Changed HDFS default block size from 64MB to 128MB

2016-11-14 Thread sarutak
Repository: spark Updated Branches: refs/heads/branch-2.1 518dc1e1e -> c07fe1c59 [SPARK-18432][DOC] Changed HDFS default block size from 64MB to 128MB Changed HDFS default block size from 64MB to 128MB. https://issues.apache.org/jira/browse/SPARK-18432 Author: Noritaka Sekiyama

spark git commit: [SPARK-18432][DOC] Changed HDFS default block size from 64MB to 128MB

2016-11-14 Thread sarutak
Repository: spark Updated Branches: refs/heads/master 637a0bb88 -> 9d07ceee7 [SPARK-18432][DOC] Changed HDFS default block size from 64MB to 128MB Changed HDFS default block size from 64MB to 128MB. https://issues.apache.org/jira/browse/SPARK-18432 Author: Noritaka Sekiyama

spark git commit: [SPARK-18396][HISTORYSERVER] Duration" column makes search result confused, maybe we should make it unsearchable

2016-11-14 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.1 d554c02f4 -> 518dc1e1e [SPARK-18396][HISTORYSERVER] Duration" column makes search result confused, maybe we should make it unsearchable ## What changes were proposed in this pull request? When we search data in History Server, it

spark git commit: [SPARK-18396][HISTORYSERVER] Duration" column makes search result confused, maybe we should make it unsearchable

2016-11-14 Thread srowen
Repository: spark Updated Branches: refs/heads/master ae6cddb78 -> 637a0bb88 [SPARK-18396][HISTORYSERVER] Duration" column makes search result confused, maybe we should make it unsearchable ## What changes were proposed in this pull request? When we search data in History Server, it will

spark git commit: [SPARK-18010][CORE] Reduce work performed for building up the application list for the History Server app list UI page

2016-11-14 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.0 646cc8552 -> 26ae5cfa7 [SPARK-18010][CORE] Reduce work performed for building up the application list for the History Server app list UI page ## What changes were proposed in this pull request? backport of pull request #15556 allow

spark git commit: [SPARK-18166][MLLIB] Fix Poisson GLM bug due to wrong requirement of response values

2016-11-14 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.1 12bde11ca -> d554c02f4 [SPARK-18166][MLLIB] Fix Poisson GLM bug due to wrong requirement of response values ## What changes were proposed in this pull request? The current implementation of Poisson GLM seems to allow only positive

spark git commit: [SPARK-18166][MLLIB] Fix Poisson GLM bug due to wrong requirement of response values

2016-11-14 Thread srowen
Repository: spark Updated Branches: refs/heads/master f95b124c6 -> ae6cddb78 [SPARK-18166][MLLIB] Fix Poisson GLM bug due to wrong requirement of response values ## What changes were proposed in this pull request? The current implementation of Poisson GLM seems to allow only positive