Hi, When using storm to process 1GB data file (has approx 200 million tuples), the execution proceeded at first while at a later point, processing has been stuck and the workers have restarted processing the file from the beginning. Does the issue lie with IO ? As storm can process million of tuples per second, 200 million tuples wouldn't be an issue. Can someone suggest me on this...
Thanks, Padma Ch On Wed, Mar 26, 2014 at 4:13 PM, Swara Desai <[email protected]> wrote: > Hi, > I am evaluating storm for some processing that might take upto one hour. > This implies that the bolt would be processing one tuple for an hour. > Can storm handle cases which have long processing time? Other than > configuring things like timeout, have any of you noticed any issues with > heavy processing? > > Thanks in advance >
