[
https://issues.apache.org/jira/browse/FLINK-4727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15544834#comment-15544834
]
ASF GitHub Bot commented on FLINK-4727:
---------------------------------------
GitHub user tzulitai opened a pull request:
https://github.com/apache/flink/pull/2585
[FLINK-4727] [kafka-connector] Set missing initial offset states with
starting KafkaConsumer position
This was fixed for the 0.8 consumer before. This PR adds the behaviour to
the 0.9 consumer.
In #2580, there's a new IT test that assures this behaviour for 0.8 and
0.9, but is commented out for 0.9 in #2580 because that test won't pass until
the changes in this PR is also included.
I want to keep the review / discussion of the two issues apart, hence
separate PRs. I suggest to merge #2580 first, and then rebase this afterwards
to include the test.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/tzulitai/flink FLINK-4727
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/2585.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2585
----
commit d030c3e4230d821d53ddf3377e0910404284300e
Author: Tzu-Li (Gordon) Tai <tzuli...@apache.org>
Date: 2016-10-04T08:53:38Z
[FLINK-4727] [kafka-connector] Set missing initial offset states with
starting KafkaConsumer position
With this change, on a clean startup of FlinkKafkaConsumer09, the auto
retrieved offsets (either earliest, latest, or an actual
committed offset) from Kafka will also be checkpointed and committed, even
if no records are read after the startup.
----
> Kafka 0.9 Consumer should also checkpoint auto retrieved offsets even when no
> data is read
> ------------------------------------------------------------------------------------------
>
> Key: FLINK-4727
> URL: https://issues.apache.org/jira/browse/FLINK-4727
> Project: Flink
> Issue Type: Bug
> Components: Kafka Connector
> Reporter: Tzu-Li (Gordon) Tai
> Assignee: Tzu-Li (Gordon) Tai
> Priority: Blocker
> Fix For: 1.2.0, 1.1.3
>
>
> This is basically the 0.9 version counterpart for FLINK-3440.
> When the 0.9 consumer fetches initial offsets from Kafka on startup, but does
> not have any data to read, it should also checkpoint & commit these initial
> offsets.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
