[
https://issues.apache.org/jira/browse/FLINK-6996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16061091#comment-16061091
]
Tzu-Li (Gordon) Tai edited comment on FLINK-6996 at 6/23/17 3:12 PM:
---------------------------------------------------------------------
I think its the other way around.
In approach (b), i.e.
{{FlinkKafkaProducer010.writeToKafkaWithTimestamps(inStream, schema, config)}},
flushing works.
It's in approach (a) where its used as a regular sink UDF {{stream.addSink(new
FlinkKafkaProducer010(...))}}, since it doesn't implement the
{{CheckpointedFunction}} interface, there's no flushing happening.
was (Author: tzulitai):
I think its the other way around.
In approach (b), i.e.
{{FlinkKafkaProducer010.writeToKafkaWithTimestamps(inStream, schema, config)}},
flushing works.
It's in approach (a) where its used as a regular sink function
{{stream.addSink(new FlinkKafkaProducer010(...))}}, since it doesn't implement
the {{CheckpointedFunction}} interface, there's no flushing happening.
> FlinkKafkaProducer010 doesn't guarantee at-least-once semantic
> --------------------------------------------------------------
>
> Key: FLINK-6996
> URL: https://issues.apache.org/jira/browse/FLINK-6996
> Project: Flink
> Issue Type: Bug
> Components: Kafka Connector
> Affects Versions: 1.2.0, 1.3.0, 1.2.1, 1.3.1
> Reporter: Piotr Nowojski
> Assignee: Piotr Nowojski
>
> FlinkKafkaProducer010 doesn't implement CheckpointedFunction interface. This
> means, when it's used like a "custom operator" (option b from [the java
> doc|https://ci.apache.org/projects/flink/flink-docs-master/api/java/org/apache/flink/streaming/connectors/kafka/FlinkKafkaProducer010.html])
> it will not flush the data on "snapshotState" as it is supposed to.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
