Jan Lukavský created BEAM-7785:
----------------------------------
Summary: DirectRunner: watermarks are updated asynchronously from
bundle processing
Key: BEAM-7785
URL: https://issues.apache.org/jira/browse/BEAM-7785
Project: Beam
Issue Type: Bug
Components: runner-direct
Affects Versions: 2.13.0
Reporter: Jan Lukavský
Assignee: Jan Lukavský
Fix For: 2.15.0
Watermarks are updated in QuiescenceDriver (by calling fireTimers, which calls
forceRefresh()) on WatermarkManager. This results in creating timer bundles,
that are then processed asynchronously as DirectTransformExecutor. Because of
that, watermarks (input watermarks mostly) might be updated while bundle is
being processed. That violates assumption, that bundle processing should be
atomical (with identical external conditions during processing of whole bundle).
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)