Re: Duplicated data when using Externalized Checkpoints in a Flink Highly Available cluster

2017-06-08 Thread Nico Kruber
Hi Amara, please refer to [1] for some details about our checkpointing mechanism, in short, for your situation: * checkpoints are made at certain checkpoint barriers, * in between those barriers, processing continues and so do outputs * in case of a failure the state at the latest checkpoint is r

Re: Duplicated data when using Externalized Checkpoints in a Flink Highly Available cluster

2017-06-05 Thread F.Amara
-Checkpoints-in-a-Flink-Highly-Available-cluster-tp13301p13483.html Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

Re: Duplicated data when using Externalized Checkpoints in a Flink Highly Available cluster

2017-06-04 Thread F.Amara
Kafka) | | | | | |--| |---| || Thanks, Amara -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Duplicated-data-when-using-Externalized-Checkpoints-in-a-Flink-Highly-Available-cluster-tp13301p13481.html Sen

Re: Duplicated data when using Externalized Checkpoints in a Flink Highly Available cluster

2017-06-01 Thread Robert Metzger
processing for my application? Could you > please guide me on what I might have missed? > > Thanks, > Amara > > > > > -- > View this message in context: http://apache-flink-user- > mailing-list-archive.2336050.n4.nabble.com/Duplicated-data- > when-using-Externalized

Re: Duplicated data when using Externalized Checkpoints in a Flink Highly Available cluster

2017-05-30 Thread F.Amara
? Could you please guide me on what I might have missed? Thanks, Amara -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Duplicated-data-when-using-Externalized-Checkpoints-in-a-Flink-Highly-Available-cluster-tp13301p13379.html Sent from the Apache

Re: Duplicated data when using Externalized Checkpoints in a Flink Highly Available cluster

2017-05-26 Thread Tzu-Li (Gordon) Tai
flink-user-mailing-list-archive.2336050.n4.nabble.com/Duplicated-data-when-using-Externalized-Checkpoints-in-a-Flink-Highly-Available-cluster-tp13301.html Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

Duplicated data when using Externalized Checkpoints in a Flink Highly Available cluster

2017-05-24 Thread F.Amara
hanks, Amara -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Duplicated-data-when-using-Externalized-Checkpoints-in-a-Flink-Highly-Available-cluster-tp13301.html Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.