Jeff Fenchel created STORM-2087:
-----------------------------------

             Summary: Storm-kafka-client: Failed tuples are not always replayed 
                 Key: STORM-2087
                 URL: https://issues.apache.org/jira/browse/STORM-2087
             Project: Apache Storm
          Issue Type: Bug
            Reporter: Jeff Fenchel


I am working with kafka 10 and the storm-kafka-client from master. It appears 
that tuples are not always being replayed when they are failed.

With a topology that randomly fails tuples a small percentage of the time I 
found that the committed kafka offset would get stuck and eventually processing 
would stop even though the committed offset was no where near the end of the 
topic. 

I have also replicated the issue in unit tests with this PR: 
https://github.com/apache/storm/pull/1679

It seems that increasing the number of times I call nextTuple for the in order 
case will make it work, but it doesn't seem to help the case where tuples are 
failed out of order from which they were emitted. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to