I believe that batch matchs your usecase, but if you really want to use real time here, you could have a deamon that fetchs this informations from db and push them to a queue and have the spout read from this queue. If there is nothing to send, just sleep the spout until information is available.
On Mon, Jul 14, 2014 at 8:06 AM, yuanjun Li <[email protected]> wrote: > Maybe batch execution? > > > 2014-07-14 18:39 GMT+08:00 amjad khan <[email protected]>: > > I made a storm topoogy where spout was fetching data from mysql using >> select query. The select query was fired after every 30 msec but because >> the size of the table is more than 20 GB the select query takes more than >> 10 sec to execute therefore this is not working. I need to know what are >> the possible alternatives for this situation. Kindly reply as soon as >> possible. >> >> Thanks, >> > > -- ------------------------------------------ Telles Mota Vidal Nobrega M.sc. Candidate at UFCG B.sc. in Computer Science at UFCG Software Engineer at OpenStack Project - HP/LSD-UFCG
