Re: Flink KafkaProducer flushing on savepoints

2021-03-05 Thread Piotr Nowojski
pache.org > *Subject:* Re: Flink KafkaProducer flushing on savepoints > > Hi, > > What Flink version and which FlinkKafkaProducer version are you using? > `FlinkKafkaProducerBase` is no longer used in the latest version. I would > guess some older versions, and FlinkKafkaProducer010

Re: Flink KafkaProducer flushing on savepoints

2021-03-05 Thread Witzany, Tomas
Sent: 03 March 2021 21:10 To: Witzany, Tomas Cc: user@flink.apache.org Subject: Re: Flink KafkaProducer flushing on savepoints Hi, What Flink version and which FlinkKafkaProducer version are you using? `FlinkKafkaProducerBase` is no longer used in the latest version. I would guess some older

Re: Flink KafkaProducer flushing on savepoints

2021-03-03 Thread Piotr Nowojski
Hi, What Flink version and which FlinkKafkaProducer version are you using? `FlinkKafkaProducerBase` is no longer used in the latest version. I would guess some older versions, and FlinkKafkaProducer010 or later (no longer supported). I would suggest either to use the universal FlinkKafkaProducer

Flink KafkaProducer flushing on savepoints

2021-03-02 Thread Witzany, Tomas
Hi, I have a question about the at-least-once guarantees for Kafka producers when checkpointing is disabled. In our data pipeline we have a Flink job on an unlimited stream that originally, we had checkpoints turned on. Further this job is cancelled with a savepoint once a day to do some data