Re: Kafka compatibility with ZK

Great, thanks for the update Manoj and and Andrey! I recommend the simple upgrade from 2.5.0 to 2.5.1 to get the fix for https://issues.apache.org/jira/browse/KAFKA-9835. Ismael On Thu, Sep 3, 2020 at 9:01 PM wrote: > We also upgraded kafka 2.2.1 to kafka 2.5.0 and kept same zookeeper . no > is

Re: Kafka compatibility with ZK

We also upgraded kafka 2.2.1 to kafka 2.5.0 and kept same zookeeper . no issued reported . Later we also upgraded zookeeper to 3.5.8 . all good . On 9/3/20, 8:42 PM, "Andrey Klochkov" wrote: [External] Hello all, FWIW we upgraded to Kafka 2.4.1 and kept ZK at 3.4.6, no issues not

Re: Kafka compatibility with ZK

Hello all, FWIW we upgraded to Kafka 2.4.1 and kept ZK at 3.4.6, no issues noticed. On Sun, Aug 2, 2020 at 10:04 AM Marina Popova wrote: > > Actually, I'm very interested in your experience as well I'm about to > start the same (similar) upgrade - from Kafka 0.11/ZK3.4.13 to Kafka 2.4/ZK > 3

Re: Kafka compatibility with ZK

Answers inline. On Fri, Aug 14, 2020 at 6:46 AM Marina Popova wrote: > thank you, Ismael! > a follow up question (or two :) ): > -- our clients (consumers and producers) are all upgraded to Kafka 2.4.0 / > ZK 3.5.6 version at this time, and since it is a very involved process to > upgrade them,

Re: Kafka compatibility with ZK

thank you, Ismael! a follow up question (or two :) ): -- our clients (consumers and producers) are all upgraded to Kafka 2.4.0 / ZK 3.5.6 version at this time, and since it is a very involved process to upgrade them, I'd want to leave them at that for now. Any issues you can think of running cli

Re: Kafka compatibility with ZK

Note that 2.5.1 has now been released. Ismael On Sun, Aug 2, 2020 at 11:13 AM Ismael Juma wrote: > Hi Marina, > > If you upgrade to ZK 3.5.x, I highly recommend going with 3.5.8. It has a > few critical fixes when compared to 3.5.6. Also, Kafka 2.5.1 should be out > in a few days and I'd recomm

Re: Kafka compatibility with ZK

Hi Andrey, ZK 3.4.6 probably works, but we haven't tested with that version for a while. Generally, we recommend upgrading to the latest bug fix release of ZooKeeper (3.4.13, 3.5.8) as they tend to include important fixes. However, you can do that in your own time, independently of the Kafka upgra

Re: Kafka compatibility with ZK

Hi Marina, If you upgrade to ZK 3.5.x, I highly recommend going with 3.5.8. It has a few critical fixes when compared to 3.5.6. Also, Kafka 2.5.1 should be out in a few days and I'd recommend that over 2.4.1. Ismael On Sun, Aug 2, 2020 at 10:04 AM Marina Popova wrote: > > Actually, I'm very in

Re: Kafka compatibility with ZK

That procedure looks safe and sane to me, Marina. > On Aug 2, 2020, at 10:04 AM, Marina Popova > wrote: > >  > Actually, I'm very interested in your experience as well I'm about to > start the same (similar) upgrade - from Kafka 0.11/ZK3.4.13 to Kafka 2.4/ZK > 3.5.6 > > I have Kafka and

Re: Kafka compatibility with ZK

Actually, I'm very interested in your experience as well I'm about to start the same (similar) upgrade - from Kafka 0.11/ZK3.4.13 to Kafka 2.4/ZK 3.5.6 I have Kafka and ZK as separate clusters. My plan is : 1. rolling upgrade the Kafka cluster to 2.4 - using the inter.broker.protocol.vers

Re: Kafka compatibility with ZK

Hi Peter, Thanks, that's very helpful! We'll go on with upgrading to 2.4.1 and not touching our ZK 3.4.6 for now. I can report back if that actually causes issues just in case anybody is interested. On Thu, Jul 23, 2020 at 2:00 PM Peter Bukowinski wrote: > Agreed. We use a cloudera distribution

Re: Kafka compatibility with ZK

Agreed. We use a cloudera distribution of zookeeper, that is versioned at 3.4.5 (plus a bunch of backported patches) with kafka 2.4 and haven’t had any issues. > On Jul 23, 2020, at 1:19 PM, Andrey Klochkov wrote: > > We are running a separate ZK cluster and its version is not really tied to >

Re: Kafka compatibility with ZK

We are running a separate ZK cluster and its version is not really tied to the version of Kafka we're using. I have seen the Confluent compatibility matrix and based on that our *current* version of Kafka is not compatible with our version of ZK, and we haven't seen any problems with that. My susp

Re: Kafka compatibility with ZK

Zookeeper is not part of the kafka project and must be installed separately. Confluent maintain a version compatibility table you can use as a reference: https://docs.confluent.io/current/installation/versions-interoperability.html#zk

Re: Kafka compatibility with ZK

Hi, AFAIK, ZK is packed with Kafka. So if you upgrade to 2.4.1 you’ll get what is in 2.4.1. It’s a little different however, if you’re hosting ZK in a different host running independently of Kafka. What’s your situation ? On Thu, 23 Jul 2020 at 21:02, Andrey Klochkov wrote: > Hello, > We're

Kafka compatibility with ZK

Hello, We're upgrading our Kafka from 1.1.0 to 2.4.1 and I'm wondering if ZK needs to be upgraded too (we're currently on 3.4.6). The upgrade guide says that "kafka has switched to the XXX version of ZK" but never says if switching to a newer ZK is mandatory or not. What are the guidelines on keepi