Github user gyfora commented on the issue:
https://github.com/apache/flink/pull/3801
Hi
Thanks for the nice effort!
I only skimmed through the changes to get the main idea (I will do a more
thorough review in the next days) but I have some initial questions :)
1. You mentioned and it looks like that incremental snapshots cannot be
rescaled as it checkpoints the files directly for multiple keygroups together.
How is this constraint enforced? Will the job fail if we try to rescale it?
2. When you restore from a full snapshot will the next incremental snapshot
contain all the files or just the diffs?
3. How do you plan for users to trigger the incremental snapshot operation?
I guess the question goes both for checkpoints and savepoints. For example
every n-th checkpoint is a full snapshot. And users could use flag maybe to
indicate whether the savepoint should be incremental?
Cheers,
Gyula
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
