[
https://issues.apache.org/jira/browse/FLINK-3429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15184734#comment-15184734
]
Maximilian Michels commented on FLINK-3429:
-------------------------------------------
+1 very much needed.
> Add histogram-based timestamp/watermark extractor
> -------------------------------------------------
>
> Key: FLINK-3429
> URL: https://issues.apache.org/jira/browse/FLINK-3429
> Project: Flink
> Issue Type: Improvement
> Components: Streaming
> Reporter: Robert Metzger
> Assignee: Kostas Kloudas
>
> While FLINK-3428 provides a static low watermark generator, we should also
> provide a watermark extractor which periodically takes samples of the
> event-time distribution in a data stream into a histogram.
> From that histogram, users can specify that watermarks should cover a certain
> percentile of the data.
> For example a user might want watermarks to rise when 90% of the events have
> been seen. With the periodic update of the histogram, the extractor can react
> to network latencies and other issues causing late, out-of-order arrivals.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
