[
https://issues.apache.org/jira/browse/FLINK-2974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14996797#comment-14996797
]
ASF GitHub Bot commented on FLINK-2974:
---------------------------------------
GitHub user rmetzger opened a pull request:
https://github.com/apache/flink/pull/1341
[FLINK-2974] Add periodic offset committer for Kafka
The offset committer is only enabled when Flink's checkpointing is disabled.
When checkpointing is enabled, we commit to ZK upon checkpoint completion.
I removed `docs/apis/kafka.md` because its not liked from anywhere and
contained duplicate infos.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/rmetzger/flink flink2974
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/1341.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1341
----
commit ea0715c6c9bbfeedaec7faeb47cb0d636c5e01e1
Author: Robert Metzger <[email protected]>
Date: 2015-11-06T16:06:02Z
[FLINK-2974] Add periodic offset committer for Kafka when checkpointing is
disabled
----
> Add periodic offset commit to Kafka Consumer if checkpointing is disabled
> -------------------------------------------------------------------------
>
> Key: FLINK-2974
> URL: https://issues.apache.org/jira/browse/FLINK-2974
> Project: Flink
> Issue Type: Improvement
> Components: Kafka Connector
> Reporter: Robert Metzger
>
> Flink only writes the offsets from the consumer into ZK if checkpointing is
> enabled.
> We should have a similar feature to Kafka's autocommit in our consumer.
> Issue reported by user:
> http://stackoverflow.com/questions/33501574/flink-kafka-why-am-i-losing-messages
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
