[ https://issues.apache.org/jira/browse/FLINK-3752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15344370#comment-15344370 ]
ASF GitHub Bot commented on FLINK-3752: --------------------------------------- Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2142#discussion_r68060615 --- Diff: docs/apis/streaming/connectors/kafka.md --- @@ -198,6 +198,63 @@ Flink on YARN supports automatic restart of lost YARN containers. If checkpointing is not enabled, the Kafka consumer will periodically commit the offsets to Zookeeper. +#### Kafka Consumers and Timestamp Extraction/Watermark Emission + +In many scenarios, the timestamp of a record is embedded (explicitly or implicitly) in the record itself. +In addition, the user may want to emit watermarks either periodically, or in an irregular fashion, e.g. based on +special records in the Kafka stream that contain the current event-time watermark. For these cases, the Flink Kafka +Consumer allows the specification of an `AssignerWithPeriodicWatermarks` or an `AssignerWithPunctuatedWatermarks`. + +You can specify your custom timestamp extractor/ watermark emitter as described --- End diff -- space after / > Add Per-Kafka-Partition Watermark Generation to the docs > -------------------------------------------------------- > > Key: FLINK-3752 > URL: https://issues.apache.org/jira/browse/FLINK-3752 > Project: Flink > Issue Type: Improvement > Components: Documentation > Affects Versions: 1.1.0 > Reporter: Stephan Ewen > Assignee: Kostas Kloudas > Fix For: 1.1.0 > > > The new methods that create watermarks per Kafka topic-partition, rather than > per Flink DataStream partition, should be documented under > https://ci.apache.org/projects/flink/flink-docs-master/apis/streaming/event_timestamps_watermarks.html -- This message was sent by Atlassian JIRA (v6.3.4#6332)