Hi Padma It is hard to guess what problem you are facing. I can share a problem that we faced earlier on that was slowing the processing. You might have a similar issue. Our bolts were throwing exceptions which was causing restart of our workers. This slowed down the processing. After we fixed all our bolts the topology is working at great speed bounded only by external resources. Hope that helps. Regards Naresh
> On Mar 26, 2014, at 5:58 AM, padma priya chitturi <[email protected]> > wrote: > > Hi, > > When using storm to process 1GB data file (has approx 200 million tuples), > the execution proceeded at first while at a later point, processing has been > stuck and the workers have restarted processing the file from the beginning. > Does the issue lie with IO ? As storm can process million of tuples per > second, 200 million tuples wouldn't be an issue. Can someone suggest me on > this... > > > Thanks, > Padma Ch > > >> On Wed, Mar 26, 2014 at 4:13 PM, Swara Desai <[email protected]> wrote: >> Hi, >> I am evaluating storm for some processing that might take upto one hour. >> This implies that the bolt would be processing one tuple for an hour. >> Can storm handle cases which have long processing time? Other than >> configuring things like timeout, have any of you noticed any issues with >> heavy processing? >> >> Thanks in advance >
