Re: high-availability.storageDir clean up?

Hi Elias, Flink will remove these files if the job reached a globally terminal state (FINISHED, FAILED, CANCELLED). The files should only remain if the cluster crashed. This should give you the opportunity to restart the cluster which can then recover the jobs which have not yet reached a

Re: high-availability.storageDir clean up?

Hi Elias, Till (in CC) is familiar with Flink's HA implementation. He might be able to answer your question. Thanks, Fabian 2018-06-25 23:24 GMT+02:00 Elias Levy : > I noticed in one of our cluster that they are relatively old > submittedJobGraph* and completedCheckpoint* files. I was

high-availability.storageDir clean up?

I noticed in one of our cluster that they are relatively old submittedJobGraph* and completedCheckpoint* files. I was wondering at what point it is save to clean some of these up.