[
https://issues.apache.org/jira/browse/KAFKA-5075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15969699#comment-15969699
]
Jiangjie Qin commented on KAFKA-5075:
-------------------------------------
[~gwenshap] I was actually about to reply on the 0.10.2.1-RC1 mail thread :)
This is an issue since 0.10.1. So it is not something new. The reason I set it
to 0.10.2.1 is that it may cause data loss. That said I am also fine to leave
the fix to 0.11.0 given the issue has been there for a while.
> The position in the consumers may be advanced incorrectly when some exception
> is thrown from consumer.poll()
> ------------------------------------------------------------------------------------------------------------
>
> Key: KAFKA-5075
> URL: https://issues.apache.org/jira/browse/KAFKA-5075
> Project: Kafka
> Issue Type: Bug
> Components: clients, consumer
> Affects Versions: 0.10.2.0
> Reporter: Jiangjie Qin
> Assignee: Dong Lin
> Fix For: 0.11.0.0
>
>
> In Fetcher.fetchRecords() we iterate over the partition data to collect the
> ConsumerRecords, after we collect some consumer records from a partition, we
> advance the position of that partition then move on to the next partition. If
> the next partition throws exceptions (e.g. OffsetOutOfRangeException), the
> messages that have already been read out of the buffer will not be delivered
> to the users. Since the positions of the previous partitions have been be
> updated, those messages will not be consumed again either.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
