Re: Implementing TinkerPop on top of GraphX

code updated. sorry, wrong branch uploaded before. On Fri, Jan 16, 2015 at 2:13 PM, Kushal Datta wrote: > The source code is under a new module named 'graphx'. let me double check. > > On Fri, Jan 16, 2015 at 2:11 PM, Kyle Ellrott > wrote: > >> Looking at https://github.com/kdatta/tinkerpop3/co

Re: Implementing TinkerPop on top of GraphX

The source code is under a new module named 'graphx'. let me double check. On Fri, Jan 16, 2015 at 2:11 PM, Kyle Ellrott wrote: > Looking at https://github.com/kdatta/tinkerpop3/compare/graphx-gremlin I > only see a maven build file. Do you have some source code some place else? > > I've worked

Re: Implementing TinkerPop on top of GraphX

Looking at https://github.com/kdatta/tinkerpop3/compare/graphx-gremlin I only see a maven build file. Do you have some source code some place else? I've worked on a spark based implementation ( https://github.com/kellrott/spark-gremlin ), but its not done and I've been tied up on other projects. I

Re: Implementing TinkerPop on top of GraphX

Hi David, Yes, we are still headed in that direction. Please take a look at the repo I sent earlier. I think that's a good starting point. Thanks, -Kushal. On Thu, Jan 15, 2015 at 8:31 AM, David Robinson wrote: > I am new to Spark and GraphX, however, I use Tinkerpop backed graphs and > think

Re: Implementing TinkerPop on top of GraphX

I am new to Spark and GraphX, however, I use Tinkerpop backed graphs and think the idea of using Tinkerpop as the API for GraphX is a great idea and hope you are still headed in that direction. I noticed that Tinkerpop 3 is moving into the Apache family: http://wiki.apache.org/incubator/TinkerPopP

Re: Implementing TinkerPop on top of GraphX

into the Spark >>>>>> ecosystem. >>>>>> * TinkerPop can continue to maintain and own a solid / feature-rich >>>>>> graph API that has already been accepted by a wide audience, relieving >>>>>> the >>>>>> pre

Re: Implementing TinkerPop on top of GraphX

;>> * GraphX can demonstrate its ability to be a key player in the GraphDB >>>>> space sitting inline with other major distributions (Neo4j, Titan, etc.). >>>>> * Allows for the abstract graph traversal logic (query API) to be >>>>> owned and maintained

Re: Implementing TinkerPop on top of GraphX

t;>>> * GraphX doesn’t own the API for its graph query capability. This could >>>> be seen as good or bad, but it might make GraphX-specific implementation >>>> additions more tricky (possibly). Also, GraphX will need to maintain the >>>> features described w

Re: Implementing TinkerPop on top of GraphX

om>>, "dev@spark.apache.org<mailto:dev@spark.apache.org>" mailto:dev@spark.apache.org>>, Matthias Broecheler mailto:matth...@thinkaurelius.com>> Subject: Re: Implementing TinkerPop on top of GraphX Who here would be interested in helping to work on an implementat

Re: Implementing TinkerPop on top of GraphX

re tricky (possibly). Also, GraphX will need to maintain the >>> features described within the TinkerPop API as that might change in the >>> future. >>> >>> From: Kushal Datta >>> Date: Thursday, November 6, 2014 at 4:00 PM >>> To: "York, Brenn

Re: Implementing TinkerPop on top of GraphX

ge in the >> future. >> >> From: Kushal Datta >> Date: Thursday, November 6, 2014 at 4:00 PM >> To: "York, Brennon" >> Cc: Kyle Ellrott , Reynold Xin < >> r...@databricks.com>, "dev@spark.apache.org" , >> Matthias Broecheler >&

Re: Implementing TinkerPop on top of GraphX

tain the > features described within the TinkerPop API as that might change in the > future. > > From: Kushal Datta > Date: Thursday, November 6, 2014 at 4:00 PM > To: "York, Brennon" > Cc: Kyle Ellrott , Reynold Xin , > "dev@spark.apache.org" , Matth

Re: Implementing TinkerPop on top of GraphX

.apache.org<mailto:dev@spark.apache.org>" mailto:dev@spark.apache.org>>, Matthias Broecheler mailto:matth...@thinkaurelius.com>> Subject: Re: Implementing TinkerPop on top of GraphX Before we dive into the implementation details, what are the high level thoughts on Gremlin/Grap

Re: Implementing TinkerPop on top of GraphX

Ellrott > Date: Thursday, November 6, 2014 at 12:10 PM > To: Kushal Datta > Cc: Reynold Xin , "York, Brennon" < > brennon.y...@capitalone.com>, "dev@spark.apache.org" , > Matthias Broecheler > Subject: Re: Implementing TinkerPop on top of GraphX > &g

Re: Implementing TinkerPop on top of GraphX

; > brennon.y...@capitalone.com>, "dev@spark.apache.org" , > Matthias Broecheler > Subject: Re: Implementing TinkerPop on top of GraphX > > I still have to dig into the Tinkerpop3 internals (I started my work long > before it had been released), but I can say that to get the Ti

Re: Implementing TinkerPop on top of GraphX

ennon.y...@capitalone.com>>, "dev@spark.apache.org<mailto:dev@spark.apache.org>" mailto:dev@spark.apache.org>>, Matthias Broecheler mailto:matth...@thinkaurelius.com>> Subject: Re: Implementing TinkerPop on top of GraphX I still have to dig into the Tinkerpop3 internals (I st

Re: Implementing TinkerPop on top of GraphX

I still have to dig into the Tinkerpop3 internals (I started my work long before it had been released), but I can say that to get the Tinerpop2 Gremlin pipeline to work in the GraphX was a bit of a hack. The whole Tinkerpop2 Gremlin design was based around streaming pipes of data, rather then large

Re: Implementing TinkerPop on top of GraphX

Great stuffs! I've got some thoughts about that, and I was wondering if it would be first interesting to have something like for spark-core (let's say): 0/ Core API offering basic (or advanced → HeLP) primitives 1/ catalyst optimizer for a text base system (SPARQL, Cypher, custom SQL3, whatnot) 2/

Re: Implementing TinkerPop on top of GraphX

What do you guys think about the Tinkerpop3 Gremlin interface? It has MapReduce to run Gremlin operators in a distributed manner and Giraph to execute vertex programs. The Tinkpop3 is better suited for GraphX. On Thu, Nov 6, 2014 at 11:48 AM, Kyle Ellrott wrote: > I've taken a crack at implemen

Re: Implementing TinkerPop on top of GraphX

I've taken a crack at implementing the TinkerPop Blueprints API in GraphX ( https://github.com/kellrott/sparkgraph ). I've also implemented portions of the Gremlin Search Language and a Parquet based graph store. I've been working out finalize some code details and putting together better code exam

Re: Implementing TinkerPop on top of GraphX

cc Matthias In the past we talked with Matthias and there were some discussions about this. On Thu, Nov 6, 2014 at 11:34 AM, York, Brennon wrote: > All, was wondering if there had been any discussion around this topic yet? > TinkerPop is a great abstraction for gr