Re: Safe way to clear old checkpoint data

2022-11-27 Thread Hangxiang Yu
. 16:15:45 > *Кому:* Evgeniy Lyutikov > *Копия:* user > *Тема:* Re: Safe way to clear old checkpoint data > > Hi, > > I would recommend upgrading to Flink 1.15, given the changes that were > made in 1.15 make ownership more understandable. See > https:/

Re: Safe way to clear old checkpoint data

2022-11-25 Thread Evgeniy Lyutikov
_metadata? От: Martijn Visser Отправлено: 25 ноября 2022 г. 16:15:45 Кому: Evgeniy Lyutikov Копия: user Тема: Re: Safe way to clear old checkpoint data Hi, I would recommend upgrading to Flink 1.15, given the changes that were made in 1.15 make ownership more understandable.

Re: Safe way to clear old checkpoint data

2022-11-25 Thread Martijn Visser
Hi, I would recommend upgrading to Flink 1.15, given the changes that were made in 1.15 make ownership more understandable. See https://flink.apache.org/2022/05/06/restore-modes.html Best regards, Martijn On Fri, Nov 25, 2022 at 9:33 AM Evgeniy Lyutikov wrote: > Hello > We use Flink 1.14.4 i

Safe way to clear old checkpoint data

2022-11-25 Thread Evgeniy Lyutikov
Hello We use Flink 1.14.4 in kubernetes operator (version 1.2.0), all chepoint data store in s3 bucket. If parse _metadata file of checkpoint it contains links to objects in the shared directory and their number is much less than the total number of objects in the directory. For example, the n