Hello Generally with Kafka a client older than the broker is fine and a broker older than the client is not. There have been gotchas with this but generally true.
Thanks On Fri, Dec 17, 2021 at 9:39 AM Midhun Mohan <midhun.mo...@esginc.us> wrote: > Thanks Mark for getting back with a detailed explanation, I just had one > more question, do you think there will be issue with using different > version of Kafka broker & consumekafka processor > > On Fri, Dec 17, 2021 at 8:45 PM Mark Payne <marka...@hotmail.com> wrote: > > > Midhun, > > > > There are several ConsumeKafka processors. They come in two flavors: > > > > ConsumeKafka_<client version> > > ConsumeKafkaRecord_<client version> > > > > Typically, the ConsumeKafkaRecord processors are preferable, as they > allow > > writing out multiple messages into the same FlowFile, which is FAR more > > efficient in terms of both processing performance (throughput) and memory > > utilization. > > > > But ideally you want to use the version that matches your Kafka brokers. > > So if you’re using Kafka 2.6 you should use ConsumeKafka_2_6. If you are > > using Kafka 2.0 - 2.5 you should use ConsumeKafka_2_5 and so on. > > > > Thanks > > -Mark > > > > > > > On Dec 17, 2021, at 7:55 AM, Midhun Mohan <midhun.mo...@esginc.us> > > wrote: > > > > > > Hi Team, > > > > > > I remember seeing a Kafka consumer named ConsumeKafka in version lower > > than > > > 1.15 , do we have replacement for that processor in 1.15 > > > > > > -- > > > > > > > > > Regards, > > > Midhun Mohan > > > > > > -- > > > Regards, > Midhun Mohan >
