git commit: SPARK-1057 (alternative) Remove fastutil

2014-04-11 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.0 dac6240cf -> 4dfcb3860 SPARK-1057 (alternative) Remove fastutil (This is for discussion at this point -- I'm not suggesting this should be committed.) This is what removing fastutil looks like. Much of it is straightforward, like usi

git commit: SPARK-1057 (alternative) Remove fastutil

2014-04-11 Thread pwendell
Repository: spark Updated Branches: refs/heads/master aa8bb117a -> 165e06a74 SPARK-1057 (alternative) Remove fastutil (This is for discussion at this point -- I'm not suggesting this should be committed.) This is what removing fastutil looks like. Much of it is straightforward, like using `

git commit: Update WindowedDStream.scala

2014-04-11 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-0.9 19cf2f73e -> 4a325e17b Update WindowedDStream.scala update the content of Exception when windowDuration is not multiple of parent.slideDuration Author: baishuo(白硕) Closes #390 from baishuo/windowdstream and squashes the followin

git commit: Update WindowedDStream.scala

2014-04-11 Thread pwendell
Repository: spark Updated Branches: refs/heads/master fdfb45e69 -> aa8bb117a Update WindowedDStream.scala update the content of Exception when windowDuration is not multiple of parent.slideDuration Author: baishuo(白硕) Closes #390 from baishuo/windowdstream and squashes the following co

git commit: Update WindowedDStream.scala

2014-04-11 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.0 ce0ce3d9e -> dac6240cf Update WindowedDStream.scala update the content of Exception when windowDuration is not multiple of parent.slideDuration Author: baishuo(白硕) Closes #390 from baishuo/windowdstream and squashes the followin

[1/3] git commit: HOTFIX: Ignore python metastore files in RAT checks.

2014-04-11 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.0 e6128b509 -> ce0ce3d9e HOTFIX: Ignore python metastore files in RAT checks. This was causing some errors with pull request tests. Author: Patrick Wendell Closes #393 from pwendell/hotfix and squashes the following commits: 6201dd3 [

[3/3] git commit: [WIP] [SPARK-1328] Add vector statistics

2014-04-11 Thread pwendell
[WIP] [SPARK-1328] Add vector statistics As with the new vector system in MLlib, we find that it is good to add some new APIs to precess the `RDD[Vector]`. Beside, the former implementation of `computeStat` is not stable which could loss precision, and has the possibility to cause `Nan` in scie

[2/3] git commit: [FIX] make coalesce test deterministic in RDDSuite

2014-04-11 Thread pwendell
[FIX] make coalesce test deterministic in RDDSuite Make coalesce test deterministic by setting pre-defined seeds. (Saw random failures in other PRs.) Author: Xiangrui Meng Closes #387 from mengxr/fix-random and squashes the following commits: 59bc16f [Xiangrui Meng] make coalesce test determi

git commit: [WIP] [SPARK-1328] Add vector statistics

2014-04-11 Thread pwendell
Repository: spark Updated Branches: refs/heads/master 7038b00be -> fdfb45e69 [WIP] [SPARK-1328] Add vector statistics As with the new vector system in MLlib, we find that it is good to add some new APIs to precess the `RDD[Vector]`. Beside, the former implementation of `computeStat` is not s

git commit: [FIX] make coalesce test deterministic in RDDSuite

2014-04-11 Thread pwendell
Repository: spark Updated Branches: refs/heads/master 6a0f8e35c -> 7038b00be [FIX] make coalesce test deterministic in RDDSuite Make coalesce test deterministic by setting pre-defined seeds. (Saw random failures in other PRs.) Author: Xiangrui Meng Closes #387 from mengxr/fix-random and sq

git commit: HOTFIX: Ignore python metastore files in RAT checks.

2014-04-11 Thread pwendell
Repository: spark Updated Branches: refs/heads/master f5ace8da3 -> 6a0f8e35c HOTFIX: Ignore python metastore files in RAT checks. This was causing some errors with pull request tests. Author: Patrick Wendell Closes #393 from pwendell/hotfix and squashes the following commits: 6201dd3 [Patr

svn commit: r1586752 - in /spark: mllib/index.md site/mllib/index.html

2014-04-11 Thread matei
Author: matei Date: Fri Apr 11 19:12:08 2014 New Revision: 1586752 URL: http://svn.apache.org/r1586752 Log: Update MLlib algos Modified: spark/mllib/index.md spark/site/mllib/index.html Modified: spark/mllib/index.md URL: http://svn.apache.org/viewvc/spark/mllib/index.md?rev=1586752&r1=

git commit: [SPARK-1225, 1241] [MLLIB] Add AreaUnderCurve and BinaryClassificationMetrics

2014-04-11 Thread matei
Repository: spark Updated Branches: refs/heads/branch-1.0 170b09d94 -> e6128b509 [SPARK-1225, 1241] [MLLIB] Add AreaUnderCurve and BinaryClassificationMetrics This PR implements a generic version of `AreaUnderCurve` using the `RDD.sliding` implementation from https://github.com/apache/spark/p

git commit: [SPARK-1225, 1241] [MLLIB] Add AreaUnderCurve and BinaryClassificationMetrics

2014-04-11 Thread matei
Repository: spark Updated Branches: refs/heads/master 98225a6ef -> f5ace8da3 [SPARK-1225, 1241] [MLLIB] Add AreaUnderCurve and BinaryClassificationMetrics This PR implements a generic version of `AreaUnderCurve` using the `RDD.sliding` implementation from https://github.com/apache/spark/pull/

git commit: Some clean up in build/docs

2014-04-11 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.0 9e90c464d -> 170b09d94 Some clean up in build/docs (a) Deleted an outdated line from the docs (b) Removed a work around that is no longer necessary given the mesos version bump. Author: Patrick Wendell Closes #382 from pwendell/mave

git commit: Some clean up in build/docs

2014-04-11 Thread pwendell
Repository: spark Updated Branches: refs/heads/master 446bb3417 -> 98225a6ef Some clean up in build/docs (a) Deleted an outdated line from the docs (b) Removed a work around that is no longer necessary given the mesos version bump. Author: Patrick Wendell Closes #382 from pwendell/maven-cl

git commit: SPARK-1417: Spark on Yarn - spark UI link from resourcemanager is broken

2014-04-11 Thread tgraves
Repository: spark Updated Branches: refs/heads/branch-1.0 a1bb4c695 -> 9e90c464d SPARK-1417: Spark on Yarn - spark UI link from resourcemanager is broken Author: Thomas Graves Closes #344 from tgravescs/SPARK-1417 and squashes the following commits: c450b5f [Thomas Graves] fix test e1c1d7e

git commit: SPARK-1417: Spark on Yarn - spark UI link from resourcemanager is broken

2014-04-11 Thread mridulm80
Repository: spark Updated Branches: refs/heads/master 44f654eec -> 446bb3417 SPARK-1417: Spark on Yarn - spark UI link from resourcemanager is broken Author: Thomas Graves Closes #344 from tgravescs/SPARK-1417 and squashes the following commits: c450b5f [Thomas Graves] fix test e1c1d7e [Tho