[ https://issues.apache.org/jira/browse/FLINK-12855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17143330#comment-17143330 ]
Teng Hu commented on FLINK-12855: --------------------------------- The idea came from our own practice of [scaling up the application|https://youtu.be/9U8ksIqrgLM], also inspired by this [blogpost|https://klaviyo.tech/flinkperf-c7bd28acc67]. Yes, I agree naming could be confusing since there seems to be no standard way of defining those windowing functions in the industry. I actually like the idea of creating a new window type, but I want to hear more from rest of the community what do you guys think. The event time window change is [out|https://github.com/apache/flink/pull/12640] and more to come. Thanks, Niel > Stagger TumblingProcessingTimeWindow processing to distribute workload > ---------------------------------------------------------------------- > > Key: FLINK-12855 > URL: https://issues.apache.org/jira/browse/FLINK-12855 > Project: Flink > Issue Type: New Feature > Components: API / DataStream > Reporter: Teng Hu > Assignee: Teng Hu > Priority: Major > Labels: pull-request-available > Fix For: 1.12.0 > > Attachments: stagger_window.png, stagger_window_delay.png, > stagger_window_throughput.png > > Time Spent: 10m > Remaining Estimate: 0h > > Flink natively triggers all panes belonging to same window at the same time. > In other words, all panes are aligned and their triggers all fire > simultaneously, causing the thundering herd effect. > This new feature provides the option that panes could be staggered across > partitioned streams, so that their workloads are distributed. > Attachment: proof of concept working -- This message was sent by Atlassian Jira (v8.3.4#803005)