[
https://issues.apache.org/jira/browse/KAFKA-987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13721221#comment-13721221
]
Swapnil Ghike commented on KAFKA-987:
-------------------------------------
I discussed this yesterday with Jun. If there is no offset already present in
zookeeper, we set the offset value to -1 in the offset cache in
addPartitionInfo(). Later, even if no message is consumed, the real offset will
be checkpointed. Jun said that he was ok with this patch.
> Avoid checkpointing offsets in Kafka consumer that have not changed since the
> last commit
> -----------------------------------------------------------------------------------------
>
> Key: KAFKA-987
> URL: https://issues.apache.org/jira/browse/KAFKA-987
> Project: Kafka
> Issue Type: Bug
> Affects Versions: 0.8
> Reporter: Swapnil Ghike
> Assignee: Swapnil Ghike
> Labels: improvement
> Fix For: 0.8
>
> Attachments: kafka-987.patch, kafka-987-v2.patch
>
>
> We need to fix the Kafka zookeeper consumer to avoid checkpointing offsets
> that have not changed since the last offset commit. This will help reduce the
> write load on zookeeper.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
