Hi peeps,
I am externalizing checkpoints in S3 for my flink job and I retain them on
cancellation. However when I look into my S3 bucket where the checkpoints
are stored there is only 1 checkpoint at any point in time . Is this the
default behavior of flink where older checkpoints are deleted when the
current checkpoint completes ? Here are a few screenshots. What are your
thoughts on restoring an older state which is not the previous state ?

List contents of bucket at time 0

Object Name: 
checkpoints/fb9fea316bf2d530a6fc54ea107d66d4/chk-6/6af4f345-49e0-4ae1-baae-1f7c4d71ebf4Last
modified time : Wed Aug 21 22:17:23 GMT 2019
Object Name: checkpoints/fb9fea316bf2d530a6fc54ea107d66d4/chk-6/_metadataLast
modified time : Wed Aug 21 22:17:24 GMT 2019

List contents of bucket at time 1

Printing last modified times
Object Name: 
checkpoints/fb9fea316bf2d530a6fc54ea107d66d4/chk-12/7cf17042-7790-4909-9252-73511d93f518Last
modified time : Wed Aug 21 22:23:24 GMT 2019
Object Name: checkpoints/fb9fea316bf2d530a6fc54ea107d66d4/chk-12/_metadataLast
modified time : Wed Aug 21 22:23:24 GMT 2019

Thanks,

Vishwas

Reply via email to