[ 
https://issues.apache.org/jira/browse/FLINK-3429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Flink Jira Bot updated FLINK-3429:
----------------------------------
    Labels: stale-major  (was: )

> Add histogram-based timestamp/watermark extractor
> -------------------------------------------------
>
>                 Key: FLINK-3429
>                 URL: https://issues.apache.org/jira/browse/FLINK-3429
>             Project: Flink
>          Issue Type: Improvement
>          Components: API / DataStream
>            Reporter: Robert Metzger
>            Priority: Major
>              Labels: stale-major
>
> While FLINK-3428 provides a static low watermark generator, we should also 
> provide a watermark extractor which periodically takes samples of the 
> event-time distribution in a data stream into a histogram.
> From that histogram, users can specify that watermarks should cover a certain 
> percentile of the data.
> For example a user might want watermarks to rise when 90% of the events have 
> been seen. With the periodic update of the histogram, the extractor can react 
> to network latencies and other issues causing late, out-of-order arrivals.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to