GitHub user aray opened a pull request:
https://github.com/apache/spark/pull/7104
[SPARK-8718] [GRAPHX] Improve EdgePartition2D for non perfect square number
of partitions
See https://github.com/aray/e2d/blob/master/EdgePartition2D.ipynb
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/aray/spark edge-partition-2d-improvement
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/7104.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #7104
----
commit cfa2c5ece11fa379e9c82d4e48d45192387c4859
Author: Andrew Ray <[email protected]>
Date: 2015-05-12T04:11:32Z
Modifications to EdgePartition2D so that it works for non perfect squares.
commit f006364bde37d0b87667227a68ab5e3567276fe6
Author: Andrew Ray <[email protected]>
Date: 2015-05-12T04:29:35Z
remove unneeded comments
commit 3560084686753dac11bb22babb32c8918770fe5a
Author: Andrew Ray <[email protected]>
Date: 2015-06-01T19:07:19Z
Merge branch 'master' into edge-partition-2d-improvement
commit 5d42105891acb37c228d4cc4d42e29021645da63
Author: Andrew Ray <[email protected]>
Date: 2015-06-01T21:16:42Z
% -> /
commit 001bfd09d186bf9647ae49b9cb71a3e21eee1579
Author: Andrew Ray <[email protected]>
Date: 2015-06-02T16:13:38Z
Refactor PartitionStrategy so that we can return a prtition function for a
given number of parts.
To keep compatibility we define default methods that translate between the
two implementation options.
Made EdgePartition2D use old strategy when we have a perfect square and
implement new interface.
commit 925fd2cf0fabbe897f6cda4c9625aa14a6915e4f
Author: Andrew Ray <[email protected]>
Date: 2015-06-02T21:08:50Z
use new interface for partitioning
commit 5141ab450c1eb25553fde06a8afa7a3212737482
Author: Andrew Ray <[email protected]>
Date: 2015-06-27T03:52:58Z
Merge branch 'master' into edge-partition-2d-improvement
commit 97f8464a4055b262a6449bf9932ed7f8f407bd07
Author: Andrew Ray <[email protected]>
Date: 2015-06-27T05:37:14Z
change less
commit 3729f840849d26459edd5bcbb94d865338170142
Author: Andrew Ray <[email protected]>
Date: 2015-06-27T12:51:22Z
correct bounds and remove unneeded comments
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
