Re: Reprocessing messsages in kafka streams vs Transformer init

2022-10-08 Thread xardaso
Hi John, Thank you for your quick and thorough reply, it's really helpful for me! Regards, Tomasz Zorawik --- Original Message --- sobota, 8 października 2022 1:28 AM, John Roesler napisał(a): > Hello Tomasz, > > Thanks for the question! > > Streams should always call init()

Re: Reprocessing messsages in kafka streams vs Transformer init

2022-10-07 Thread John Roesler
Hello Tomasz, Thanks for the question! Streams should always call init() before passing any records to transform(...). When we talk about "reprocessing", we just mean that some record was processed, but then there was a failure before its offset was committed, and therefore we have to process

Reprocessing messsages in kafka streams vs Transformer init

2022-10-07 Thread xardaso
Hi Everyone, I have a question related to messages auto reprocessing in kafka streams and Transformer/Processor init()/close() methods. Is possible that in some scenarios (failures, rebalance etc.) a message is processed twice by Transformer.transform() without calling Transformer.init()