Arvid Heise created FLINK-21452:
-----------------------------------
Summary: FLIP-27 sources cannot reliably downscale
Key: FLINK-21452
URL: https://issues.apache.org/jira/browse/FLINK-21452
Project: Flink
Issue Type: Improvement
Components: Connectors / Common
Affects Versions: 1.12.1, 1.13.0
Reporter: Arvid Heise
Assignee: Arvid Heise
Sources currently store their registered readers into the snapshot. However,
when downscaling, we have unmatched readers that we violate a couple of
invariants.
The solution is to not store registered readers - they are re-registered
anyways on restart.
To keep it backward compatible, the best option is to always store an empty set
of readers while writing the snapshot and discard any recovered readers from
the snapshot.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
