Stephen Powis created STORM-1869:
------------------------------------

             Summary: Add ability for Kafka Spout to do limited retries on 
failed tuples, and redirect down a "failed" stream
                 Key: STORM-1869
                 URL: https://issues.apache.org/jira/browse/STORM-1869
             Project: Apache Storm
          Issue Type: Improvement
          Components: storm-kafka
            Reporter: Stephen Powis


h4. Summary

KafkaSpout provides no way to limit the number of times a tuple can fail within 
your topology.  I think it'd be great to allow configuring a hard limit to the 
number of times a tuple can be failed before it is no longer retried.

Additionally, it'd be fantastic if the spout could do a one-time emit of this 
tuple down a "failed" stream.  This stream would allow you to handle these 
failed tuples in some way -- persist the failed tuple to some other storage 
system to be replayed later?  logged?  ignored? tons of things you could 
possibly want to do with these.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to