Hi, I am having some difficulties trying to get exactly-once semantic while ensuring data order from NiFi to Kafka. I have read Kafka documentation and it should be quite straight forward using idempotent producer from NiFi and having a Kafka topic with a single partition, but I am still getting some duplicated messages in Kafka.
NiFi version: 1.12.1 Kafka version: 2.7.0 NiFi flow: (Both shown queues with FIFO prioritizer) PublishKafka_2_6 configuration: As I said, target Kafka topic has just one partition to ensure data order. Incoming flowfiles are small 60 bytes messages. I have been a while working with it so any suggestion is really welcome. Thanks in advance, Aian
