[ 
https://issues.apache.org/jira/browse/STORM-1869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15306115#comment-15306115
 ] 

Stephen Powis commented on STORM-1869:
--------------------------------------

Here's a rough prototype for this idea against 0.10.x branch - 
https://github.com/Crim/storm/pull/1

Thoughts?

> Add ability for Kafka Spout to do limited retries on failed tuples, and 
> redirect down a "failed" stream
> -------------------------------------------------------------------------------------------------------
>
>                 Key: STORM-1869
>                 URL: https://issues.apache.org/jira/browse/STORM-1869
>             Project: Apache Storm
>          Issue Type: Improvement
>          Components: storm-kafka
>            Reporter: Stephen Powis
>
> h4. Summary
> KafkaSpout provides no way to limit the number of times a tuple can fail 
> within your topology.  I think it'd be great to allow configuring a hard 
> limit to the number of times a tuple can be failed before it is no longer 
> retried.
> Additionally, it'd be fantastic if the spout could do a one-time emit of this 
> tuple down a "failed" stream.  This stream would allow you to handle these 
> failed tuples in some way -- persist the failed tuple to some other storage 
> system to be replayed later?  logged?  ignored? tons of things you could 
> possibly want to do with these.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to