Re: ProcessFunction's Event Timer not firing

2018-11-10 Thread Fritz Budiyanto
Thanks Hequn for the pointer. From what I read, I may also need to emit the timestamp regularly for all idle partitions to ensure watermark progression. — Fritz > On Nov 8, 2018, at 6:02 PM, Hequn Cheng wrote: > > Hi Fritz, > > Watermarks are merged on stream shuffles. If one of the input's

Re: ProcessFunction's Event Timer not firing

2018-11-08 Thread Hequn Cheng
Hi Fritz, Watermarks are merged on stream shuffles. If one of the input's watermark not progressing, they will not advance the event time at the operators. I think you should decrease the parallelism of source and make sure there are data in each of your source partition. Note that the Kafka sourc