Stephan Ewen commented on FLINK-3370:

Think of a "pane" as the unit of slide, sou add each element into a pane, and 
then compute the window as the union of multiple panes.
It only makes sense for aligned windows (time, no custom non-time triggers).

It is a bit tricky to implement in RocksDB, which is the main workhorse for 
large state right now. So we are delaying this until we have solved that 

> Add an aligned version of the window operator
> ---------------------------------------------
>                 Key: FLINK-3370
>                 URL: https://issues.apache.org/jira/browse/FLINK-3370
>             Project: Flink
>          Issue Type: Improvement
>          Components: Windowing Operators
>    Affects Versions: 1.0.0
>            Reporter: Stephan Ewen
>            Assignee: Stephan Ewen
> The windowing operators currently follow a generic implementation for support 
> of unaligned windows.
> We can gain efficiency by creating a variant that is optimized for aligned 
> windows:
>   - Aligned windows can use aligned triggers, which keep no per-key state
>   - Less trigger state means less checkpointing data
>   - Based on the aligned windows, we can create sliding event time windows 
> that do not replicate data into the different overlapping windows

This message was sent by Atlassian JIRA

Reply via email to