Re: Apache Flink: aligning watermark among parallel tasks

2016-03-29 Thread Maximilian Michels
Hi Ozan, You probably want to look at a custom Trigger implementation. Please see the different triggers in org/apache/flink/streaming/api/windowing/triggers/. You can write your own event-based trigger. Best thing would be to extend the EventTimeTrigger with your logic. Then you can use windowed

Apache Flink: aligning watermark among parallel tasks

2016-03-25 Thread Ozan DENİZ
We are using periodic event time window with watermark. We have currently 4 parallel tasks in our Flink App. During the streaming process, all the 4 tasks' watermark values must be close to trigger window event. For example; Task 1 watermark value = 8 Task 2 watermark value =

Apache Flink: aligning watermark among parallel tasks

2016-03-24 Thread Ozan DENİZ
We are using periodic event time window with watermark. We have currently 4 parallel tasks in our Flink App. During the streaming process, all the 4 tasks' watermark values must be close to trigger window event. For example; Task 1 watermark value = 8 Task 2 watermark value =