GitHub user brennonyork opened a pull request:
https://github.com/apache/spark/pull/5142
[SPARK-4086][GraphX]: Fold-style aggregation for VertexRDD
Adds five new methods into the `VertexRDD` suite to allow for fold-style
calling conventions. Those methods are:
* `leftZipJoinWithFold`
* `leftJoinWithFold`
* `innerZipJoinWithFold`
* `innerJoinWithFold`
* `aggregateUsingIndexWithFold`
Each of above has a set of tests within the `VertexRDDSuite` to ensure
proper functionality.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/brennonyork/spark SPARK-4086
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/5142.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #5142
----
commit c2ef961e1168bb2de57bc4e12d118d9d5883345b
Author: Brennon York <[email protected]>
Date: 2015-03-18T21:32:48Z
added leftJoin*WithFold
commit 639046c6fcc0f9f82f5b1fa6fc4092efa2a6ecff
Author: Brennon York <[email protected]>
Date: 2015-03-19T22:57:51Z
added innerJoin with folds
commit 1229f9fa3ddcadc39a17d1af0146275208f4c34e
Author: Brennon York <[email protected]>
Date: 2015-03-23T18:07:19Z
added aggregateUsingIndexWithFold
commit 98197e743cf71d954fd45a456a88a7ae2ff47888
Author: Brennon York <[email protected]>
Date: 2015-03-23T18:10:46Z
updated test to better demonstrate the aggregate fold-style values
correctly being passed in
commit 6a6136424ab2805148e141471fb2e22d37223d05
Author: Brennon York <[email protected]>
Date: 2015-03-23T18:25:03Z
added proper docstrings
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
