Re: Watermark on keyed stream

2018-10-10 Thread Elias Levy
You are correct that watermarks are not tracked per key. You are dealing with events with a high degree of delay variability. That is usually not a good match for event time processing as implemented in Flink. You could use event time processing and configure a very large window allowed

Watermark on keyed stream

2018-10-10 Thread Nick Triller
Hi everyone, it seems Flink only supports global watermarks currently which is a problem for my use case. Many sensors send data which might be buffered for days in upstream systems before arriving at the Flink job. The job keys the stream by sensor. If other sensors send values in the