Jeff Fenchel created STORM-2106:

             Summary: Storm Kafka Client is paused while failed tuples are 
                 Key: STORM-2106
             Project: Apache Storm
          Issue Type: Bug
            Reporter: Jeff Fenchel

With the changes in STORM-2087, the kafka 10 spout will limited to emitting 
tuples that are within the poll() size for kafka. This means that if the first 
tuple in a batch from kafka is failed, the spout will not emit more than the 
size of the batch from kafka until the tuple is either processed successfully 
or given up on. This behavior is exacerbated by the exponential backoff retry 

There probably needs to be bookkeeping for the next emittable offset.

This message was sent by Atlassian JIRA

Reply via email to