I suggest to keep spout as light as possible just to accept request trigger and fetch data from bolt. On 14 Jul 2014 16:48, "Telles Nobrega" <[email protected]> wrote:
> I believe that batch matchs your usecase, but if you really want to use > real time here, you could have a deamon that fetchs this informations from > db and push them to a queue and have the spout read from this queue. If > there is nothing to send, just sleep the spout until information is > available. > > > On Mon, Jul 14, 2014 at 8:06 AM, yuanjun Li <[email protected]> wrote: > >> Maybe batch execution? >> >> >> 2014-07-14 18:39 GMT+08:00 amjad khan <[email protected]>: >> >> I made a storm topoogy where spout was fetching data from mysql using >>> select query. The select query was fired after every 30 msec but because >>> the size of the table is more than 20 GB the select query takes more than >>> 10 sec to execute therefore this is not working. I need to know what are >>> the possible alternatives for this situation. Kindly reply as soon as >>> possible. >>> >>> Thanks, >>> >> >> > > > -- > ------------------------------------------ > Telles Mota Vidal Nobrega > M.sc. Candidate at UFCG > B.sc. in Computer Science at UFCG > Software Engineer at OpenStack Project - HP/LSD-UFCG >
