Hi All,
after increment of parallelism in bolts also spout is failing ? how can I know how much time my bolts are taking to complete the tuple processing.I'm using kafka spout with 10 partitions so I kept my topology.max.spout.pending as 10 .do I need to increase the value more than that?if yes to extent i can increase the number ? as a stupid play i kept the value 100 to 1 partition kafka it give me metrics error. *Best regards,* *K.Sai Dilip Reddy.* On Thu, May 5, 2016 at 12:23 PM, Sai Dilip Reddy Kiralam < [email protected]> wrote: > > > > *Best regards,* > > *K.Sai Dilip Reddy.* > > ---------- Forwarded message ---------- > From: Spico Florin <[email protected]> > Date: Tue, May 3, 2016 at 1:02 PM > Subject: Re: Why tuples fail in spout > To: [email protected] > > > Hi! > It could be that your process time for that tuples is greater than > topology.message.timeout.secs > 30 seconds. In these case have a look at your bolts processing time or how > fast you generate your data from spout that could not cope with your bolts. > You can: > 1. Increase your level your parallelism for your bolts. > 2. Throttling the messages from the spouts by setting out > topology.max.spout.pending > Please have a look at these questions: > > http://stackoverflow.com/questions/32322682/apache-storm-what-happens-to-a-tuple-when-no-bolts-are-available-to-consume-it > > > http://stackoverflow.com/questions/26536525/what-is-the-point-of-timing-out-tuples > > I hope that these help. > Regards, > Florin > > On Tue, May 3, 2016 at 9:42 AM, Sai Dilip Reddy Kiralam < > [email protected]> wrote: > >> but no failed count is shown for bolts >> >> >> >> *Best regards,* >> >> *K.Sai Dilip Reddy.* >> >> On Tue, May 3, 2016 at 11:19 AM, John Fang <[email protected]> >> wrote: >> >>> Some tuples failed in the bolts. You can review the bolts' code. Maybe >>> your bolts' code trigger the fail() due to some reasons, Or the operation >>> of bolts need more time. >>> >>> ------------------------------------------------------------------ >>> 发件人：Sai Dilip Reddy Kiralam <[email protected]> >>> 发送时间：2016年5月3日(星期二) 12:06 >>> 收件人：user <[email protected]> >>> 主 题：Why tuples fail in spout >>> >>> Hi all, >>> >>> >>> I'm running storm topology in the local machine & storm UI shows some >>> tuples are failed in the spout.as per my knowledge spout tuples are >>> transferred to a bolts with out any failure.Can any of you help me out in >>> finding the reason of tuples failures in the spout. >>> >>> >>> >>> >>> >>> >>> *Best regards,* >>> >>> *K.Sai Dilip Reddy.* >>> >>> >>> >> > >
