GitHub user kdatta opened a pull request:
https://github.com/apache/spark/pull/4205
Spark 3789
First pull request for PyGraphX. The following codes are added:
- Java API for GraphX including JavaVertexRDD, JavaEdgeRDD and JavaGraph
- Python backend including PythonVertexRDD, PythonEdgeRDD and PythonGraph
- graphx package is added to pyspark
- includes vertex.py, edge.py, graph.py and tests.py
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/kdatta/spark SPARK-3789
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/4205.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #4205
----
commit fcbeee2d180130c0b91552edb9af5c8e6c9137d6
Author: Kushal Datta <[email protected]>
Date: 2014-10-06T15:15:40Z
SPARK-3789: initial commit
commit 0eefa444a3beec83e2a79ecf2ca620f9e32685e9
Author: Kushal Datta <[email protected]>
Date: 2014-10-06T18:40:45Z
SPARK-3789: added graph, vertex and edge python files
commit c99f81c16c4ca1f73556d1f506ad59768f7d7c49
Author: Kushal Datta <[email protected]>
Date: 2014-10-07T20:06:54Z
SPARK-3789: Added PythonGraphLoader
commit 207d8ba9d7b39322885a6c9676c17b60cf9a51f6
Author: Kushal Datta <[email protected]>
Date: 2014-10-13T16:29:05Z
SPARK-3789: Removed PythonGraphLoader. Added java_import statement to
java_gateway.py
commit 2c2cef75cfcfe0958eb20e9ebe9a39a9c6e85685
Author: Kushal Datta <[email protected]>
Date: 2014-10-30T20:59:22Z
SPARK-3789: WIP - Added JavaVertexRDD, JavaEdgeRDD and the first few
functions
commit a69a5898b4f6d0c3d21c4e656a59f49c364c2735
Author: Kushal Datta <[email protected]>
Date: 2014-10-30T21:03:04Z
SPARK-3789: Merging master on 10/30/2014
commit cf1df50057a9fdea35cbf34a40945697a77766d5
Author: Kushal Datta <[email protected]>
Date: 2014-10-30T21:11:48Z
SPARK-3789: Removed .pyc files
commit 15805134892a5ea78f4825cb328199b5168e7d7d
Author: Kushal Datta <[email protected]>
Date: 2014-11-04T14:54:39Z
SPARK-3789: WIP - PythonVertexRDD works
commit 08140bf7f190061cafe58a8d973ea280bff6168f
Author: Kushal Datta <[email protected]>
Date: 2014-11-06T15:47:19Z
SPARK-3789: WIP - 11/6/2014
commit 13b96d9829e8e297c1561faf735cd6c6015160c1
Author: Kushal Datta <[email protected]>
Date: 2014-11-06T15:54:53Z
Merge branch 'master' into SPARK-3789
Conflicts:
core/src/main/scala/org/apache/spark/rdd/RDD.scala
commit a2faa642a84aff3175b0919758bbefa0483e0a85
Author: Kushal Datta <[email protected]>
Date: 2014-11-12T19:29:38Z
SPARK-3789: WIP
commit 28be23e39b1d25f7ef331d27ef09c626bd176418
Author: Kushal Datta <[email protected]>
Date: 2014-11-19T01:10:48Z
SPARK-3789: WIP
commit a23d4183bbb65f647d54cbbe533d7d705cc8ae47
Author: Kushal Datta <[email protected]>
Date: 2014-11-19T03:12:48Z
SPARK-3789: WIP
commit 19b280d043982c628ff1ca90f5f38db527ddd4b9
Author: Kushal Datta <[email protected]>
Date: 2014-11-19T08:46:21Z
SPARK-3789: Updated vertex.py, edge.py and graph.py
commit d07ae43bf32c6ffc1ec62f938febd404f41b41b7
Author: Kushal Datta <[email protected]>
Date: 2014-12-10T15:48:15Z
SPARK-3789: JavaEdgeRDDLike compiler errors.
commit e02a8ee087a178530f0cf60f11fcf7a9b1387448
Author: Kushal Datta <[email protected]>
Date: 2014-12-16T19:47:37Z
SPARK-3789: JavaEdgeRDDLike compiler errors.
commit dd9c278e8b003bef95bf0aae40da60319bd4bd99
Author: Kushal Datta <[email protected]>
Date: 2014-12-16T20:03:29Z
SPARK-3789: Merging master on 12/16
Conflicts:
graphx/src/main/scala/org/apache/spark/graphx/VertexRDD.scala
commit 49e3845a344738076acb625303477bf80942ca3d
Author: Kushal Datta <[email protected]>
Date: 2014-12-18T16:48:00Z
SPARK-3789: Updated JavaEdgeRDD class according to EdgeRDD and EdgeRDDImpl
class hierarchy. Fixed compile issues.
commit 44c051fe0576a2a9eb5674e603dac12c7746b170
Author: Kushal Datta <[email protected]>
Date: 2014-12-18T17:13:00Z
SPARK-3789: Mergin master on 12/18
commit db8cff0b5ee00bf2058e0876624ff623e4c2540d
Author: Kushal Datta <[email protected]>
Date: 2014-12-22T14:39:02Z
SPARK-3789: temp commit before merging master on 12/22
commit 46dcd9a6d11ed857e99a80ca41f884aca55f3e90
Author: Kushal Datta <[email protected]>
Date: 2014-12-22T14:41:58Z
SPARK-3789: Merging master on 12/22
commit 375411764e36be082483020662a33aca5c5be861
Author: Kushal Datta <[email protected]>
Date: 2015-01-05T03:54:07Z
SPARK-3789: temp commit before merging master on 1/5
commit a05d458cdb57be8219638c550234dd0cfe7414ea
Author: Kushal Datta <[email protected]>
Date: 2015-01-05T03:55:36Z
SPARK-3789: Merge master on 1/5
commit 5717578d52ad745f52a5f0cd7bec2211bc05c968
Author: Kushal Datta <[email protected]>
Date: 2015-01-07T18:03:37Z
SPARK-3789: temp commit before merging master on 1/7
commit 1bbfffa892c7a1f3859186469602a9a0b90640ca
Author: Kushal Datta <[email protected]>
Date: 2015-01-16T15:33:00Z
SPARK-3789: temp commit before merging master on 1/16
commit 7297f0e55adb53e2bad234ed84cd5bbe436d0e51
Author: Kushal Datta <[email protected]>
Date: 2015-01-16T15:34:52Z
SPARK-3789: Merging master on 1/16
commit 36d15df0c79f8e1431ae971d311461175f47c3a4
Author: Kushal Datta <[email protected]>
Date: 2015-01-16T22:35:51Z
SPARK-3789: collect(), take() fixed
commit 08d420924d3c3a50c89a0cbd1109c16f84f0447e
Author: Kushal Datta <[email protected]>
Date: 2015-01-19T14:46:09Z
SPARK-3789: temp commit before merging master on 1/18
commit 577cb4af8cc82d4ed58a9f6bfffac07a1033cf99
Author: Kushal Datta <[email protected]>
Date: 2015-01-19T14:47:40Z
SPARK-3789: Merge master on 1/18
commit 6a6b7ec1822599d5d0cb4d618c8057e798f0436f
Author: Kushal Datta <[email protected]>
Date: 2015-01-21T19:46:30Z
SPARK-3789: filter in VertexRDD fixed
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
