git commit: [SQL] Fixed 2 comment typos in SQLConf

2014-08-28 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 024178c57 -> 68f75dcdf [SQL] Fixed 2 comment typos in SQLConf Author: Cheng Lian Closes #2172 from liancheng/sqlconf-typo and squashes the following commits: 115cc71 [Cheng Lian] Fixed 2 comment typos in SQLConf Project: http://git-wip

git commit: [SQL] Fixed 2 comment typos in SQLConf

2014-08-28 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.1 a118ea5c5 -> c0e3bc17e [SQL] Fixed 2 comment typos in SQLConf Author: Cheng Lian Closes #2172 from liancheng/sqlconf-typo and squashes the following commits: 115cc71 [Cheng Lian] Fixed 2 comment typos in SQLConf (cherry picked from

Git Push Summary

2014-08-28 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.1.0-rc1 [deleted] d6d19b581 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

git commit: [SPARK-3230][SQL] Fix udfs that return structs

2014-08-28 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 68f75dcdf -> 76e3ba426 [SPARK-3230][SQL] Fix udfs that return structs We need to convert the case classes into Rows. Author: Michael Armbrust Closes #2133 from marmbrus/structUdfs and squashes the following commits: 189722f [Michael Arm

git commit: [SPARK-3230][SQL] Fix udfs that return structs

2014-08-28 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.1 c0e3bc17e -> 2e8ad9976 [SPARK-3230][SQL] Fix udfs that return structs We need to convert the case classes into Rows. Author: Michael Armbrust Closes #2133 from marmbrus/structUdfs and squashes the following commits: 189722f [Michael

[3/3] git commit: Additional CHANGES.txt

2014-08-28 Thread pwendell
Additional CHANGES.txt Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/a9df7030 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/a9df7030 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/a9df7030 Branch: refs/he

[1/3] git commit: Revert "[maven-release-plugin] prepare release v1.1.0-rc1"

2014-08-28 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.1 2e8ad9976 -> a9df70308 Revert "[maven-release-plugin] prepare release v1.1.0-rc1" This reverts commit 79e86ef3e1a3ee03a7e3b166a5c7dee11c6d60d7. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apach

[2/3] git commit: Revert "[maven-release-plugin] prepare for next development iteration"

2014-08-28 Thread pwendell
Revert "[maven-release-plugin] prepare for next development iteration" This reverts commit a118ea5c59d653f5a3feda21455ba60bc722b3b1. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/71ec0140 Tree: http://git-wip-us.apache.org/

Git Push Summary

2014-08-28 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.1.0-rc1 [created] a2f8cf984 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

git commit: [maven-release-plugin] prepare for next development iteration

2014-08-28 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.1 da4b94c86 -> 96926c5a4 [maven-release-plugin] prepare for next development iteration Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/96926c5a Tree: http://git-wip-u

git commit: [maven-release-plugin] prepare release v1.1.0-rc1

2014-08-28 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.1 a9df70308 -> da4b94c86 [maven-release-plugin] prepare release v1.1.0-rc1 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/da4b94c8 Tree: http://git-wip-us.apache.org

[1/8] git commit: Revert "[maven-release-plugin] prepare for next development iteration"

2014-08-28 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.1 96926c5a4 -> 1d03330ec Revert "[maven-release-plugin] prepare for next development iteration" This reverts commit 96926c5a42c5970ed74c50db5bd9c68cacf92207. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-

[4/8] git commit: Revert "Revert "[maven-release-plugin] prepare for next development iteration""

2014-08-28 Thread pwendell
Revert "Revert "[maven-release-plugin] prepare for next development iteration"" This reverts commit 71ec0140f7e121bdba3d19e8219e91a5e9d1e320. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/df619440 Tree: http://git-wip-us.ap

[2/8] git commit: Revert "[maven-release-plugin] prepare release v1.1.0-rc1"

2014-08-28 Thread pwendell
Revert "[maven-release-plugin] prepare release v1.1.0-rc1" This reverts commit da4b94c86c9dd0d624b3040aa4b9449be9f60fc3. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/ecdbeeff Tree: http://git-wip-us.apache.org/repos/asf/sp

[8/8] git commit: Revert "[maven-release-plugin] prepare release v1.1.0-rc1"

2014-08-28 Thread pwendell
Revert "[maven-release-plugin] prepare release v1.1.0-rc1" This reverts commit 58b0be6a29eab817d350729710345e9f39e4c506. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/1d03330e Tree: http://git-wip-us.apache.org/repos/asf/sp

[7/8] git commit: Revert "[maven-release-plugin] prepare for next development iteration"

2014-08-28 Thread pwendell
Revert "[maven-release-plugin] prepare for next development iteration" This reverts commit 78e3c036eee7113b2ed144eec5061e070b479e56. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/c0bacc16 Tree: http://git-wip-us.apache.org/

[6/8] git commit: Revert "[maven-release-plugin] prepare release v1.1.0-rc1"

2014-08-28 Thread pwendell
Revert "[maven-release-plugin] prepare release v1.1.0-rc1" This reverts commit 79e86ef3e1a3ee03a7e3b166a5c7dee11c6d60d7. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/c818b2b0 Tree: http://git-wip-us.apache.org/repos/asf/sp

Git Push Summary

2014-08-28 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.1.0-rc1 [deleted] a2f8cf984 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[5/8] git commit: Revert "[maven-release-plugin] prepare for next development iteration"

2014-08-28 Thread pwendell
Revert "[maven-release-plugin] prepare for next development iteration" This reverts commit a118ea5c59d653f5a3feda21455ba60bc722b3b1. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d01b3faf Tree: http://git-wip-us.apache.org/

[3/8] git commit: Revert "Revert "[maven-release-plugin] prepare release v1.1.0-rc1""

2014-08-28 Thread pwendell
Revert "Revert "[maven-release-plugin] prepare release v1.1.0-rc1"" This reverts commit 56070f12f455bae645cba887a74c72b12f1085f8. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/4186c45f Tree: http://git-wip-us.apache.org/rep

Git Push Summary

2014-08-28 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.1.0-rc1 [created] c0cb9d6b5 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

git commit: [maven-release-plugin] prepare for next development iteration

2014-08-28 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.1 f07183249 -> f8f7a0c9d [maven-release-plugin] prepare for next development iteration Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/f8f7a0c9 Tree: http://git-wip-u

git commit: [maven-release-plugin] prepare release v1.1.0-rc1

2014-08-28 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.1 1d03330ec -> f07183249 [maven-release-plugin] prepare release v1.1.0-rc1 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/f0718324 Tree: http://git-wip-us.apache.org

git commit: [SPARK-3150] Fix NullPointerException in in Spark recovery: Add initializing default values in DriverInfo.init()

2014-08-28 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master 76e3ba426 -> 70d814665 [SPARK-3150] Fix NullPointerException in in Spark recovery: Add initializing default values in DriverInfo.init() The issue happens when Spark is run standalone on a cluster. When master and driver fall simultaneously

git commit: [SPARK-3150] Fix NullPointerException in in Spark recovery: Add initializing default values in DriverInfo.init()

2014-08-28 Thread joshrosen
Repository: spark Updated Branches: refs/heads/branch-1.0 edea1efe0 -> 31de05b08 [SPARK-3150] Fix NullPointerException in in Spark recovery: Add initializing default values in DriverInfo.init() The issue happens when Spark is run standalone on a cluster. When master and driver fall simultaneo

git commit: [SPARK-3150] Fix NullPointerException in in Spark recovery: Add initializing default values in DriverInfo.init()

2014-08-28 Thread joshrosen
Repository: spark Updated Branches: refs/heads/branch-1.1 f8f7a0c9d -> fd98020a9 [SPARK-3150] Fix NullPointerException in in Spark recovery: Add initializing default values in DriverInfo.init() The issue happens when Spark is run standalone on a cluster. When master and driver fall simultaneo

git commit: [SPARK-2608][Core] Fixed command line option passing issue over Mesos via SPARK_EXECUTOR_OPTS

2014-08-28 Thread rxin
Repository: spark Updated Branches: refs/heads/master 70d814665 -> 6d392b36e [SPARK-2608][Core] Fixed command line option passing issue over Mesos via SPARK_EXECUTOR_OPTS This is another try after #2145 to fix [SPARK-2608](https://issues.apache.org/jira/browse/SPARK-2608). The basic idea is

git commit: [SPARK-3264] Allow users to set executor Spark home in Mesos

2014-08-28 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 6d392b36e -> 41dc5987d [SPARK-3264] Allow users to set executor Spark home in Mesos The executors and the driver may not share the same Spark home. There is currently one way to set the executor side Spark home in Mesos, through setting `

git commit: [SPARK-3264] Allow users to set executor Spark home in Mesos

2014-08-28 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.1 fd98020a9 -> 069ecfef0 [SPARK-3264] Allow users to set executor Spark home in Mesos The executors and the driver may not share the same Spark home. There is currently one way to set the executor side Spark home in Mesos, through settin

git commit: [SPARK-3285] [examples] Using values.sum is easier to understand than using values.foldLeft(0)(_ + _)

2014-08-28 Thread rxin
Repository: spark Updated Branches: refs/heads/master be53c54b5 -> 39012452d [SPARK-3285] [examples] Using values.sum is easier to understand than using values.foldLeft(0)(_ + _) def sum[B >: A](implicit num: Numeric[B]): B = foldLeft(num.zero)(num.plus) Using values.sum is easier to understa

git commit: [SPARK-3281] Remove Netty specific code in BlockManager / shuffle

2014-08-28 Thread rxin
Repository: spark Updated Branches: refs/heads/master 41dc5987d -> be53c54b5 [SPARK-3281] Remove Netty specific code in BlockManager / shuffle Netty functionality will be added back in subsequent PRs by using the BlockTransferService interface. Author: Reynold Xin Closes #2181 from rxin/SP

git commit: [SPARK-3190] Avoid overflow in VertexRDD.count()

2014-08-28 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master 39012452d -> 96df92906 [SPARK-3190] Avoid overflow in VertexRDD.count() VertexRDDs with more than 4 billion elements are counted incorrectly due to integer overflow when summing partition sizes. This PR fixes the issue by converting parti

git commit: [SPARK-3190] Avoid overflow in VertexRDD.count()

2014-08-28 Thread joshrosen
Repository: spark Updated Branches: refs/heads/branch-1.1 069ecfef0 -> 0b9718add [SPARK-3190] Avoid overflow in VertexRDD.count() VertexRDDs with more than 4 billion elements are counted incorrectly due to integer overflow when summing partition sizes. This PR fixes the issue by converting p

git commit: [SPARK-3190] Avoid overflow in VertexRDD.count()

2014-08-28 Thread joshrosen
Repository: spark Updated Branches: refs/heads/branch-1.0 31de05b08 -> 5481196ab [SPARK-3190] Avoid overflow in VertexRDD.count() VertexRDDs with more than 4 billion elements are counted incorrectly due to integer overflow when summing partition sizes. This PR fixes the issue by converting p

git commit: SPARK-3082. yarn.Client.logClusterResourceDetails throws NPE if requeste...

2014-08-28 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 96df92906 -> 92af2314f SPARK-3082. yarn.Client.logClusterResourceDetails throws NPE if requeste... ...d queue doesn't exist Author: Sandy Ryza Closes #1984 from sryza/sandy-spark-3082 and squashes the following commits: fe08c37 [Sandy R

git commit: SPARK-3082. yarn.Client.logClusterResourceDetails throws NPE if requeste...

2014-08-28 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.1 0b9718add -> f4cbf5e3d SPARK-3082. yarn.Client.logClusterResourceDetails throws NPE if requeste... ...d queue doesn't exist Author: Sandy Ryza Closes #1984 from sryza/sandy-spark-3082 and squashes the following commits: fe08c37 [San

git commit: [SPARK-3277] Fix external spilling with LZ4 assertion error

2014-08-28 Thread pwendell
Repository: spark Updated Branches: refs/heads/master 92af2314f -> a46b8f2d7 [SPARK-3277] Fix external spilling with LZ4 assertion error **Summary of the changes** The bulk of this PR is comprised of tests and documentation; the actual fix is really just adding 1 line of code (see `BlockObje

git commit: [SPARK-3277] Fix external spilling with LZ4 assertion error

2014-08-28 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.1 f4cbf5e3d -> fe4df343d [SPARK-3277] Fix external spilling with LZ4 assertion error **Summary of the changes** The bulk of this PR is comprised of tests and documentation; the actual fix is really just adding 1 line of code (see `Block

[2/3] git commit: Revert "[maven-release-plugin] prepare for next development iteration"

2014-08-28 Thread pwendell
Revert "[maven-release-plugin] prepare for next development iteration" This reverts commit f8f7a0c9dce764ece8acdc41d35bbf448dba7e92. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/587dff21 Tree: http://git-wip-us.apache.org/

[3/3] git commit: Revert "[maven-release-plugin] prepare release v1.1.0-rc1"

2014-08-28 Thread pwendell
Revert "[maven-release-plugin] prepare release v1.1.0-rc1" This reverts commit f07183249b74dd857069028bf7d570b35f265585. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/fb2b40a5 Tree: http://git-wip-us.apache.org/repos/asf/sp

[1/3] git commit: Adding new CHANGES.txt

2014-08-28 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.1 fe4df343d -> fb2b40a52 Adding new CHANGES.txt Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/7db87b3e Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/7db87

git commit: [maven-release-plugin] prepare for next development iteration

2014-08-28 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.1 711aebb32 -> a4a7a2414 [maven-release-plugin] prepare for next development iteration Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/a4a7a241 Tree: http://git-wip-u

Git Push Summary

2014-08-28 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.1.0-rc2 [created] 446173ca1 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

git commit: [maven-release-plugin] prepare release v1.1.0-rc2

2014-08-28 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.1 fb2b40a52 -> 711aebb32 [maven-release-plugin] prepare release v1.1.0-rc2 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/711aebb3 Tree: http://git-wip-us.apache.org

git commit: [Spark QA] Link to console output on test time out

2014-08-28 Thread pwendell
Repository: spark Updated Branches: refs/heads/master a46b8f2d7 -> 3c517a812 [Spark QA] Link to console output on test time out When tests time out we should link to the Jenkins console output for easy review. We already do this for when tests start or complete normally. Here's [a recent ex

git commit: [SPARK-1912] Lazily initialize buffers for local shuffle blocks.

2014-08-28 Thread rxin
Repository: spark Updated Branches: refs/heads/master 3c517a812 -> 665e71d14 [SPARK-1912] Lazily initialize buffers for local shuffle blocks. This is a simplified fix for SPARK-1912. Author: Reynold Xin Closes #2179 from rxin/SPARK-1912 and squashes the following commits: b2f0e9e [Reynold

git commit: [SPARK-3279] Remove useless field variable in ApplicationMaster

2014-08-28 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master 665e71d14 -> 27df6ce6a [SPARK-3279] Remove useless field variable in ApplicationMaster Author: Kousuke Saruta Closes #2177 from sarutak/SPARK-3279 and squashes the following commits: 2955edc [Kousuke Saruta] Removed useless field variabl