Hi, After going through the following article regarding rocksdb incremental checkpoint (https://flink.apache.org/features/2018/01/30/incremental-checkpointing.html), my understanding was that at each checkpoint, flink only checkpoints newly created SSTables whereas other it can reference from earlier checkpoints (depending upon num of retained checkpoints).
So can we assume from this that if numRetainedCheckpoints = 1 (default), behaviour is similar as checkpointing comeplete data as it is (same as non incremental checkpointing). Also performed a load test by running exactly same flink job on 2 different clusters. Only difference between all these clusters were numOfRetained checkpoints. Incremental Checkpoint Load Test Cluster 1 num Retained Checkpoints = 3 Cluster 2 num Retained Checkpoints = 1 As we can see, checkpoint data size for cluster with num of retained checkpoints = 1 is less than one with greater number of retained checkpoints.
