Hello, Just to close this thread out and to update:
The issue was with the ZK cluster. There was connectivity issue among the ZK nodes and this was the cause for the redeliveries and failure to ack. Once the connectivity issue was resolved, the messages were processed without any redeliveries. Thanks Vinay On Fri, Jul 11, 2014 at 8:28 AM, Vinay Pothnis <[email protected]> wrote: > Hello, > > I have a storm cluster with 5 nodes and spouts reading from RabbitMQ > source. I am seeing a strange behaviour where some of the tuples are > failing and getting redelivered from RabbitMQ. > > The logs on the individual storm nodes do not have any exceptions and no > obvious indicators. I believe I am "acking" from all the bolts that are > part of the topology. > > I increased the timeout from the default 30s to 5 minutes. Still, some > messages are failing and getting redelivered. Any pointers as to how to > debug this and figure out the root cause of this? > > If I see the admin console for a particular queue on RabbitMQ, I see the > bursts of delivery, acknowledgement and redeliveries. For example, if my > message timeout is 30s, i see bursts at the interval of 1 minute. If my > message timeout is 1 minute, i see bursts at the interval of 2 minutes. Any > pointers/suggestions regarding this issue? > > Thanks > Vinay >
