Jeff Fenchel created STORM-2106: ----------------------------------- Summary: Storm Kafka Client is paused while failed tuples are replayed Key: STORM-2106 URL: https://issues.apache.org/jira/browse/STORM-2106 Project: Apache Storm Issue Type: Bug Reporter: Jeff Fenchel
With the changes in STORM-2087, the kafka 10 spout will limited to emitting tuples that are within the poll() size for kafka. This means that if the first tuple in a batch from kafka is failed, the spout will not emit more than the size of the batch from kafka until the tuple is either processed successfully or given up on. This behavior is exacerbated by the exponential backoff retry policy. There probably needs to be bookkeeping for the next emittable offset. -- This message was sent by Atlassian JIRA (v6.3.4#6332)