Re: Join stream with historical data

2016-09-14 Thread Ambud Sharma
Yes you can build something for data enrichment as long as your use some
sort of LRU cache on the bolt that is fairly sizable and your event volume
is reasonable to make sure there won't be a bottleneck in the topology.

On Sep 13, 2016 10:43 AM, "Daniela S"  wrote:

> Dear all,
>
> is it possible to add some kind of "historical data" to a data stream in
> Storm? I would like to lookup an entry in a database for every tuple when
> it arrives in Storm and to join the values of this entry with the tuple to
> proceed with processing.
>
> Thank you in advance.
>
> Best regards,
> Daniela
>


Join stream with historical data

2016-09-13 Thread Daniela S

Dear all,

 

is it possible to add some kind of "historical data" to a data stream in Storm? I would like to lookup an entry in a database for every tuple when it arrives in Storm and to join the values of this entry with the tuple to proceed with processing.

 

Thank you in advance.

 

Best regards,

Daniela