[ 
https://issues.apache.org/jira/browse/FLINK-12855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17143744#comment-17143744
 ] 

Jark Wu commented on FLINK-12855:
---------------------------------

I don't have a strong opinion on this. I just watched a presentation of Amazon 
Kinesis SQL weeks ago, which introduced the Stagger Window, and thought it 
might be related to this issue :)

 !screenshot-2.png! 

> Stagger TumblingProcessingTimeWindow processing to distribute workload
> ----------------------------------------------------------------------
>
>                 Key: FLINK-12855
>                 URL: https://issues.apache.org/jira/browse/FLINK-12855
>             Project: Flink
>          Issue Type: New Feature
>          Components: API / DataStream
>            Reporter: Teng Hu
>            Assignee: Teng Hu
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 1.12.0
>
>         Attachments: screenshot-1.png, screenshot-2.png, stagger_window.png, 
> stagger_window_delay.png, stagger_window_throughput.png
>
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> Flink natively triggers all panes belonging to same window at the same time. 
> In other words, all panes are aligned and their triggers all fire 
> simultaneously, causing the thundering herd effect.
> This new feature provides the option that panes could be staggered across 
> partitioned streams, so that their workloads are distributed.
> Attachment: proof of concept working



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to