Jeff Fenchel created STORM-2106:
-----------------------------------
Summary: Storm Kafka Client is paused while failed tuples are
replayed
Key: STORM-2106
URL: https://issues.apache.org/jira/browse/STORM-2106
Project: Apache Storm
Issue Type: Bug
Reporter: Jeff Fenchel
With the changes in STORM-2087, the kafka 10 spout will limited to emitting
tuples that are within the poll() size for kafka. This means that if the first
tuple in a batch from kafka is failed, the spout will not emit more than the
size of the batch from kafka until the tuple is either processed successfully
or given up on. This behavior is exacerbated by the exponential backoff retry
policy.
There probably needs to be bookkeeping for the next emittable offset.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
