Re: Using retained checkpoints as savepoints

2020-02-18 Thread Stephan Ewen
Maybe one small addition: - for the heap state backend, there is no difference at all between the format and behavior of retained checkpoints (after the job is canceled) and savepoints. Same format and features. - For RocksDB incremental checkpoints, we do in fact support re-scaling, and I thin

Re: Using retained checkpoints as savepoints

2020-02-18 Thread Aljoscha Krettek
Hi, the reason why we are quite conservative when it comes to stating properties of checkpoints is that we don't want to prevent ourselves from implementing possibly optimized checkpoint formats that would not support these features. You're right that currently checkpoints support most of th