Hi All, Thanks for the responses, the finished source explains my issue then. I can work around the problem by letting my sources negotiate a "final" checkpoint via zookeeper.
@Paul, I think your answer was meant for the earlier question asked by Joshua? Cheers, Niels On Wed, Oct 17, 2018 at 11:15 AM Joshua Fan <joshuafat...@gmail.com> wrote: > Hi Niels, > > Probably not, an operator begins to do checkpoint until it gets all the > barriers from all the upstream sources, if one source can not send a > barrier, the downstream operator can not do checkpoint, FYI. > > Yours sincerely > Joshua > > On Wed, Oct 17, 2018 at 4:58 PM Niels van Kaam <ni...@vankaam.net> wrote: > >> Hi All, >> >> I am debugging an issue where the periodic checkpointing has halted. I >> noticed that one of the sources of my job has completed (finished). The >> other sources and operators would however still be able to produce output. >> >> Does anyone know if Flink's periodic checkpoints are supposed to continue >> when one or more sources of a job are in the "FINISHED" state? >> >> Cheers, >> Niels >> >>
