Maximilian Michels created BEAM-9733:
----------------------------------------
Summary: ImpulseSourceFunction does not emit a final watermark
Key: BEAM-9733
URL: https://issues.apache.org/jira/browse/BEAM-9733
Project: Beam
Issue Type: Bug
Components: runner-flink
Reporter: Maximilian Michels
Assignee: Maximilian Michels
The Flink Runner's {{ImpulseSourceFunction}} does not emit a final watermark,
unless {{--shutdownSourcesOnFinalWatermark}} flag has been specified (the flag
is used in tests to shutdown the pipeline after reading all data). Most
pipelines will be long-running and thus do not specify the flag.
Not sending out the final watermark causes GroupByKey to hold back the data of
event time windows until the pipeline is shut down (the final watermark is
always emitted on pipeline shutdown which is why using the above flag works).
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
