Re: Reprocessing messsages in kafka streams vs Transformer init

2022-10-07 Thread John Roesler
Hello Tomasz, Thanks for the question! Streams should always call init() before passing any records to transform(...). When we talk about "reprocessing", we just mean that some record was processed, but then there was a failure before its offset was committed, and therefore we have to process

Reprocessing messsages in kafka streams vs Transformer init

2022-10-07 Thread xardaso
Hi Everyone, I have a question related to messages auto reprocessing in kafka streams and Transformer/Processor init()/close() methods. Is possible that in some scenarios (failures, rebalance etc.) a message is processed twice by Transformer.transform() without calling Transformer.init()

Re: SSL configuration in Apache Kafka

2022-10-07 Thread sunil chaudhari
You can try two things. Instead of localhost, can you publish the kafka service on Hostname? Since ur client.auth is none, can you try removing keystore from the producer? Regards, Sunil. On Fri, 7 Oct 2022 at 2:56 PM, Namita Jaokar wrote: > Hi All, > > I am trying to enable SSL in my kafka

Re: consumer loses offset

2022-10-07 Thread Luke Chen
Hi Lorenzo, Sounds like it is caused by this bug: https://issues.apache.org/jira/browse/KAFKA-13636 If you're not in the versions of fixed version list or newer, please try to upgrade it. Thanks. Luke On Fri, Oct 7, 2022 at 5:36 PM Lorenzo Rovere wrote: > Hi everyone, I have a simple question

consumer loses offset

2022-10-07 Thread Lorenzo Rovere
Hi everyone, I have a simple question about Kafka offsets. We have 1 producer and 1 consumer. Imagine the consumer reading till offset 5 (for example) and then suddenly stops for some hours. In the meantime the producer keeps writing messages and the offset of the last message is 10 (always for

SSL configuration in Apache Kafka

2022-10-07 Thread Namita Jaokar
Hi All, I am trying to enable SSL in my kafka broker and have generated required certificates following the steps provided in the official documentation. I have also made changes in Kafka's server.properties to enable SSL. On starting zookeeper followed by kafka server startup, There are no