[
https://issues.apache.org/jira/browse/FLUME-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14162385#comment-14162385
]
Hari Shreedharan commented on FLUME-2495:
-----------------------------------------
commitOffsets could throw an exception, correct? This fix would cause a lot of
duplicates if commitOffsets throws an exception even if the transaction was
successfully committed. Maybe the list should be cleared before the attempt to
commit?
> Kafka Source may miss events when channel is not available
> ----------------------------------------------------------
>
> Key: FLUME-2495
> URL: https://issues.apache.org/jira/browse/FLUME-2495
> Project: Flume
> Issue Type: Bug
> Components: Sinks+Sources
> Reporter: Gwen Shapira
> Assignee: Gwen Shapira
> Attachments: FLUME-2495.0.patch, FLUME-2495.1.patch
>
>
> Because the Kafka consumer itself tracks offsets, and we don't restart the
> consumer when we get channel errors, the consumer will skip messages that we
> couldn't write to channel, even though we did not advance offset in Zookeeper.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
