[
https://issues.apache.org/jira/browse/STORM-2106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15507712#comment-15507712
]
Jeff Fenchel commented on STORM-2106:
-------------------------------------
[~Srdo] Thank you so much for the explanation here! You are 100% correct. As it
turns out, I did this to myself in hacking around some exceptions caused by
rebalance. I'll close the ticket. Thanks again for your time here!
> Storm Kafka Client is paused while failed tuples are replayed
> -------------------------------------------------------------
>
> Key: STORM-2106
> URL: https://issues.apache.org/jira/browse/STORM-2106
> Project: Apache Storm
> Issue Type: Bug
> Reporter: Jeff Fenchel
>
> With the changes in STORM-2087, the kafka 10 spout will limited to emitting
> tuples that are within the poll() size for kafka. This means that if the
> first tuple in a batch from kafka is failed, the spout will not emit more
> than the size of the batch from kafka until the tuple is either processed
> successfully or given up on. This behavior is exacerbated by the exponential
> backoff retry policy.
> There probably needs to be bookkeeping for the next emittable offset.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
