Not sure I agree about Trident batches / second, though to be fair I haven't used it myself. That said, you can either batch yourself in storm (thus reduced the number of DB transactions / s), or use something like HBase or Redis / MongoDB / Couchbase depending on your needs.
On Thu, Jan 8, 2015 at 2:12 PM, Raphael Hsieh <[email protected]> wrote: > Doing a persistentAggregate to an external datastore seems like a pretty > standard use case. However Storm/Trident processes so many batches every > second, there are not many databases that can keep up with that large > amount of read/write throughput. > > How have people been deciding to store their storm aggregations in a way > that external services might be able to access this data ? > > -- > Raphael Hsieh > > > >
