[
https://issues.apache.org/jira/browse/STORM-2869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim resolved STORM-2869.
---------------------------------
Resolution: Fixed
Fix Version/s: 1.2.0
2.0.0
Thanks [~Srdo], I merged into master and 1.x-branch.
> KafkaSpout discards all pending records when adjusting the consumer position
> after a commit
> -------------------------------------------------------------------------------------------
>
> Key: STORM-2869
> URL: https://issues.apache.org/jira/browse/STORM-2869
> Project: Apache Storm
> Issue Type: Bug
> Components: storm-kafka-client
> Affects Versions: 2.0.0, 1.2.0
> Reporter: Stig Rohde Døssing
> Assignee: Stig Rohde Døssing
> Labels: pull-request-available
> Fix For: 2.0.0, 1.2.0
>
> Time Spent: 1h 20m
> Remaining Estimate: 0h
>
> As part of the STORM-2666 fix the spout clears out waitingToEmit when the
> consumer position falls behind the committed offset during a commit. We only
> need to do it for the affected partition, and then only for the records that
> are behind the committed offset.
> Also the validation check in emitOrRetryTuple is slightly too permissive, it
> should check whether the current record is behind the committed offset, not
> whether the consumer position is behind the committed offset.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)