[
https://issues.apache.org/jira/browse/STORM-810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xiajun updated STORM-810:
-------------------------
Description: When KafkaSpout refresh with kafka partitions, it will remove
patitions that no longer served by this spout and close the connection. But
before close the connection, PartitionManager don't commit the latest offset.
As a result some other spout that serve the removed partition will replay some
tuple that between last commit and close.
> PartitionManager in storm-kafka should commit latest offset before close
> -------------------------------------------------------------------------
>
> Key: STORM-810
> URL: https://issues.apache.org/jira/browse/STORM-810
> Project: Apache Storm
> Issue Type: Improvement
> Components: storm-kafka
> Affects Versions: 0.10.0, 0.11.0
> Reporter: xiajun
> Assignee: xiajun
>
> When KafkaSpout refresh with kafka partitions, it will remove patitions that
> no longer served by this spout and close the connection. But before close the
> connection, PartitionManager don't commit the latest offset. As a result some
> other spout that serve the removed partition will replay some tuple that
> between last commit and close.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
