Thomas Weise created BEAM-10760:
-----------------------------------
Summary: Cleanup timers lead to unbounded state accumulation in
global window
Key: BEAM-10760
URL: https://issues.apache.org/jira/browse/BEAM-10760
Project: Beam
Issue Type: Bug
Components: runner-core, runner-flink
Affects Versions: 2.21.0
Reporter: Thomas Weise
Assignee: Thomas Weise
For each key, the runner sets a cleanup timer that is designed to garbage
collect state at the end of a window. For a global window, these timers will
stay around until the pipeline terminates. Depending on the key cardinality,
this can lead to unbounded state growth, which in the case of the Flink runner
is observable in the growth of checkpoint size.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
