Re: Nifi to Titan... How?

2016-05-20 Thread Pat Trainor
Matt, Great response, and thanks for writing. I would imagine querying would be left to Java, Gephi, etc., and a Cassandra query (QueryCassandra) would seem to do well, or even the REST API in Titan 1.0.0? But then again, I see where Titan queries would be valuable, with Traversals not being the l

Re: Nifi to Titan... How?

2016-05-20 Thread Matt Burgess
Pat, No worries, this discussion is relevant to the devs group :) I appreciate and share your interest in getting connected data into graph databases in order to get more insight out of the data. It may be possible to put the data directly into the backing store (Cassandra, e.g.) via NiFi, but in

Re: Nifi to Titan... How?

2016-05-20 Thread Pat Trainor
Joe Witt & Andre, You guys are very nice, but I thought this was the only mailing list for Nifi... I now realize that there is a user's list, where this kind of question would be more appropriate. Thanks for not tazing me... :) As for the great replies: Joe, I want the output to be used in Tit

Re: Nifi to Titan... How?

2016-05-20 Thread Andre
Pat, There's a few ways of skinning this cat but the common approach is to make use of Tinkerpop's Gremlin using Groovy. I would then suggest tying the Groovy code with NiFi's ExecuteScript processor. This would ensure your code is reasonably re-usable across different Graph DBs (as long they imp

Re: Nifi to Titan... How?

2016-05-19 Thread Joe Witt
Pat It looks like Titan can be backed by Apache Cassandra or Apache HBase. NiFi can deliver to both of those. Would that take care of what you're looking to do? Thanks Joe On Thu, May 19, 2016 at 11:16 PM, Pat Trainor wrote: > Thanks to everyone making this now open sourced tool awesome. > > I

Nifi to Titan... How?

2016-05-19 Thread Pat Trainor
Thanks to everyone making this now open sourced tool awesome. ​I can't find anything that directly links the 2. I want to use ​Nifi to coordinate page scraping, parsing, and finally throw Titan data for graphs. ​Do I have to use Kafka or Spark for this? I'm looking at the output mechanisms (Pro