[
https://issues.apache.org/jira/browse/FLINK-12855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17143330#comment-17143330
]
Teng Hu edited comment on FLINK-12855 at 6/24/20, 2:28 AM:
-----------------------------------------------------------
The idea came from our own practice in scaling up the
[application|https://youtu.be/9U8ksIqrgLM], also inspired by this
[blogpost|https://klaviyo.tech/flinkperf-c7bd28acc67].
Yes, I agree naming could be confusing since there seems to be no standard way
of defining those windowing functions in the industry. I actually like the idea
of creating a new window type, but I want to hear more from rest of the
community what do you guys think.
The event time window change is
[out|https://github.com/apache/flink/pull/12640] and more to come.
Thanks,
Niel
was (Author: tenghu):
The idea came from our own practice of [scaling up the
application|https://youtu.be/9U8ksIqrgLM], also inspired by this
[blogpost|https://klaviyo.tech/flinkperf-c7bd28acc67].
Yes, I agree naming could be confusing since there seems to be no standard way
of defining those windowing functions in the industry. I actually like the idea
of creating a new window type, but I want to hear more from rest of the
community what do you guys think.
The event time window change is
[out|https://github.com/apache/flink/pull/12640] and more to come.
Thanks,
Niel
> Stagger TumblingProcessingTimeWindow processing to distribute workload
> ----------------------------------------------------------------------
>
> Key: FLINK-12855
> URL: https://issues.apache.org/jira/browse/FLINK-12855
> Project: Flink
> Issue Type: New Feature
> Components: API / DataStream
> Reporter: Teng Hu
> Assignee: Teng Hu
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.12.0
>
> Attachments: stagger_window.png, stagger_window_delay.png,
> stagger_window_throughput.png
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Flink natively triggers all panes belonging to same window at the same time.
> In other words, all panes are aligned and their triggers all fire
> simultaneously, causing the thundering herd effect.
> This new feature provides the option that panes could be staggered across
> partitioned streams, so that their workloads are distributed.
> Attachment: proof of concept working
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
