[GitHub] spark pull request: [SPARK-3936] Add aggregateMessages, which supe...

2014-11-12 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/3100 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-3936] Add aggregateMessages, which supe...

2014-11-12 Thread jegonzal
Github user jegonzal commented on a diff in the pull request: https://github.com/apache/spark/pull/3100#discussion_r20243545 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/TripletFields.java --- @@ -0,0 +1,51 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-3936] Add aggregateMessages, which supe...

2014-11-12 Thread jegonzal
Github user jegonzal commented on a diff in the pull request: https://github.com/apache/spark/pull/3100#discussion_r20257677 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/TripletFields.java --- @@ -0,0 +1,51 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-3936] Add aggregateMessages, which supe...

2014-11-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3100#issuecomment-62673015 [Test build #23248 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/23248/consoleFull) for PR 3100 at commit

[GitHub] spark pull request: [SPARK-3936] Add aggregateMessages, which supe...

2014-11-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3100#issuecomment-62678332 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-3936] Add aggregateMessages, which supe...

2014-11-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3100#issuecomment-62678327 [Test build #23248 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/23248/consoleFull) for PR 3100 at commit

[GitHub] spark pull request: [SPARK-3936] Add aggregateMessages, which supe...

2014-11-11 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/3100#discussion_r20204139 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/EdgeContext.scala --- @@ -0,0 +1,51 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request: [SPARK-3936] Add aggregateMessages, which supe...

2014-11-11 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/3100#discussion_r20204163 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/Graph.scala --- @@ -207,8 +207,39 @@ abstract class Graph[VD: ClassTag, ED: ClassTag] protected ()

[GitHub] spark pull request: [SPARK-3936] Add aggregateMessages, which supe...

2014-11-11 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/3100#discussion_r20204348 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/impl/EdgePartition.scala --- @@ -21,63 +21,93 @@ import scala.reflect.{classTag, ClassTag}

[GitHub] spark pull request: [SPARK-3936] Add aggregateMessages, which supe...

2014-11-11 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/3100#discussion_r20204354 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/impl/EdgePartition.scala --- @@ -21,63 +21,93 @@ import scala.reflect.{classTag, ClassTag}

[GitHub] spark pull request: [SPARK-3936] Add aggregateMessages, which supe...

2014-11-11 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/3100#discussion_r20204491 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/impl/EdgePartition.scala --- @@ -280,55 +344,197 @@ class EdgePartition[ * It is safe to keep

[GitHub] spark pull request: [SPARK-3936] Add aggregateMessages, which supe...

2014-11-11 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/3100#issuecomment-62680888 Ok I'm merging this. I will make a small patch to clean up some stuff. Ankur - can you add the num change for srcMustBeActive, dstMustBeActive, maySatisfyEither, and remove

[GitHub] spark pull request: [SPARK-3936] Add aggregateMessages, which supe...

2014-11-11 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/3100#discussion_r20204979 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/TripletFields.java --- @@ -0,0 +1,51 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request: [SPARK-3936] Add aggregateMessages, which supe...

2014-11-10 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/3100#discussion_r20125517 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/EdgeContext.scala --- @@ -0,0 +1,51 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request: [SPARK-3936] Add aggregateMessages, which supe...

2014-11-10 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/3100#discussion_r20125606 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/Graph.scala --- @@ -207,8 +209,10 @@ abstract class Graph[VD: ClassTag, ED: ClassTag] protected ()

[GitHub] spark pull request: [SPARK-3936] Add aggregateMessages, which supe...

2014-11-10 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/3100#discussion_r20125939 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/EdgeContext.scala --- @@ -0,0 +1,51 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request: [SPARK-3936] Add aggregateMessages, which supe...

2014-11-10 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/3100#discussion_r20126158 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/Graph.scala --- @@ -326,8 +336,54 @@ abstract class Graph[VD: ClassTag, ED: ClassTag] protected ()

[GitHub] spark pull request: [SPARK-3936] Add aggregateMessages, which supe...

2014-11-10 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/3100#discussion_r20126212 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/TripletFields.scala --- @@ -0,0 +1,59 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-3936] Add aggregateMessages, which supe...

2014-11-10 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/3100#discussion_r20126256 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/impl/EdgePartition.scala --- @@ -285,50 +337,126 @@ class EdgePartition[ } /** -

[GitHub] spark pull request: [SPARK-3936] Add aggregateMessages, which supe...

2014-11-10 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/3100#discussion_r20126286 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/impl/EdgePartition.scala --- @@ -285,50 +337,126 @@ class EdgePartition[ } /** -

[GitHub] spark pull request: [SPARK-3936] Add aggregateMessages, which supe...

2014-11-10 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/3100#discussion_r20130288 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/impl/EdgePartition.scala --- @@ -285,50 +337,126 @@ class EdgePartition[ } /**

[GitHub] spark pull request: [SPARK-3936] Add aggregateMessages, which supe...

2014-11-10 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/3100#discussion_r20130355 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/impl/EdgePartition.scala --- @@ -285,50 +337,126 @@ class EdgePartition[ } /** -

[GitHub] spark pull request: [SPARK-3936] Add aggregateMessages, which supe...

2014-11-09 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/3100#discussion_r20062181 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/TripletFields.scala --- @@ -0,0 +1,59 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-3936] Add aggregateMessages, which supe...

2014-11-09 Thread ankurdave
Github user ankurdave commented on a diff in the pull request: https://github.com/apache/spark/pull/3100#discussion_r20062658 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/TripletFields.scala --- @@ -0,0 +1,59 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-3936] Add aggregateMessages, which supe...

2014-11-04 Thread ankurdave
GitHub user ankurdave opened a pull request: https://github.com/apache/spark/pull/3100 [SPARK-3936] Add aggregateMessages, which supersedes mapReduceTriplets aggregateMessages enables neighborhood computation similarly to mapReduceTriplets, but it introduces two API improvements:

[GitHub] spark pull request: [SPARK-3936] Add aggregateMessages, which supe...

2014-11-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3100#issuecomment-61748262 [Test build #22908 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22908/consoleFull) for PR 3100 at commit

[GitHub] spark pull request: [SPARK-3936] Add aggregateMessages, which supe...

2014-11-04 Thread ankurdave
Github user ankurdave commented on the pull request: https://github.com/apache/spark/pull/3100#issuecomment-61748390 This PR is on top of #3054, so view the new changes here: I'm not sure about the name: aggregateNeighbors may be better. @rxin @jegonzal --- If your

[GitHub] spark pull request: [SPARK-3936] Add aggregateMessages, which supe...

2014-11-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3100#issuecomment-61754336 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-3936] Add aggregateMessages, which supe...

2014-11-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3100#issuecomment-61754331 [Test build #22908 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22908/consoleFull) for PR 3100 at commit