Re: Help needed to migrate from one infra to another without downtime

2021-10-20 Thread Ran Lupovich
One thing that comes to my mind after reading your explanation, zk quorum should be odd number, you stated you have six zookeepers... I would suggest checking this matter, 3 , 5 , 7 etc... בתאריך יום ד׳, 20 באוק׳ 2021, 22:00, מאת Rijo Roy ‏: > Hi, > > Hope you are safe and well! > > Let me give

Help needed to migrate from one infra to another without downtime

2021-10-20 Thread Rijo Roy
Hi,  Hope you are safe and well! Let me give a brief about my environment: OS: Ubuntu 18.04 Kafka Version: Confluent Kafka v5.5.1 ZooKeeper Version : 3.5.8 No.of Kafka Brokers: 3 No. of Zookeeper nodes: 3 I am working on a project where we are aiming to move out from our existing

Re: Neverending KafkaStreams rebalance

2021-10-20 Thread Guozhang Wang
Hello Murilo, I think what you've discovered is a processing spike: i.e. each poll call itself returning up to 1000 records, and then processing them may take longer (if, say, they hit the p99 percentile latency due to the processing logic etc). After your config change, it is less sensitive to