Jan Doms created BEAM-6333:
------------------------------
Summary: allow disabling/configuring automatic watermark
generation for idle kafka partitions
Key: BEAM-6333
URL: https://issues.apache.org/jira/browse/BEAM-6333
Project: Beam
Issue Type: Improvement
Components: io-java-kafka
Affects Versions: 2.9.0
Reporter: Jan Doms
Assignee: Raghu Angadi
Fix For: 2.9.1
For pipelines that require the emitted watermarks to be absolutely correct the
current behavior using 2 seconds timeout could lead to problems.
Therefor it should be possible to disable this behavior. While changing the
code the hardcoded 2 seconds can also be made configurable. (There's already a
TODO about that in the code.)
A (preliminary) PR making this change is available:
https://github.com/apache/beam/pull/7382.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
