Thanks Hequn for the pointer.
From what I read, I may also need to emit the timestamp regularly for all idle
partitions to ensure watermark progression.
—
Fritz
> On Nov 8, 2018, at 6:02 PM, Hequn Cheng wrote:
>
> Hi Fritz,
>
> Watermarks are merged on stream shuffles. If one of the input's
Hi Fritz,
Watermarks are merged on stream shuffles. If one of the input's watermark
not progressing, they will not advance the event time at the operators. I
think you should decrease the parallelism of source and make sure there are
data in each of your source partition.
Note that the Kafka sourc