I have a use case where I am receiving data that has  many levels of
hierarchial relationship (e.g. parent child)  coming in real time and I
want to group those messages to populate  one common id (called familyid)
on each message in that group .Since the ordering of hierarchial data is
not guaranteed(i.e child can come before parent), I have to hold the data
in cache till I get all the records of that family Once I receive all the
records of a family I could put all of them to a nosql db after enriching
them.
I am trying to see if I could use storm and neo4j to write and query the
data in real time from the bolts.
 Is it ok to write to neo4j from bolts on arrival of a message in storm
bolts assuming the incoming message rate the message rate will be 50 to
100k per second.?
is it ok to cache the data in bolts while waiting for other messages of a
given family ?

Thanks
himansu


-- 
Thanks & Regards
Himansu

Reply via email to