GitHub user rmetzger opened a pull request:
https://github.com/apache/flink/pull/2108
[FLINK-4027] Flush FlinkKafkaProducer on checkpoints
A user on the mailing list raised the point that our Kafka producer can be
made at-least-once quite easily.
The current producer code doesn't have any guarantees
We are using the producer's callbacks to account for unacknowledged
records. When a checkpoint barrier reaches the sink, it will confirm the
checkpoint once all pending records have been acked.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/rmetzger/flink flink4027
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/2108.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2108
----
commit d657ca8be1420a3e73c48bbbf65788fbd0b75c2c
Author: Robert Metzger <[email protected]>
Date: 2016-06-15T15:50:38Z
[FLINK-4027] Flush FlinkKafkaProducer on checkpoints
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
