Stig Rohde Døssing created STORM-2869:
-----------------------------------------

             Summary: KafkaSpout discards all pending records when adjusting 
the consumer position after a commit
                 Key: STORM-2869
                 URL: https://issues.apache.org/jira/browse/STORM-2869
             Project: Apache Storm
          Issue Type: Bug
          Components: storm-kafka-client
    Affects Versions: 2.0.0, 1.2.0
            Reporter: Stig Rohde Døssing
            Assignee: Stig Rohde Døssing


As part of the STORM-2666 fix the spout clears out waitingToEmit when the 
consumer position falls behind the committed offset during a commit. We only 
need to do it for the affected partition, and then only for the records that 
are behind the committed offset.

Also the validation check in emitOrRetryTuple is slightly too permissive, it 
should check whether the current record is behind the committed offset, not 
whether the consumer position is behind the committed offset.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to