Re: How Kafka Manages Network Partition

2019-09-23 Thread Isuru Boyagane
Ok. If min.insync.replicas is 1 and the acknowledgment method is acks=1, - Zookeeper thinks that broker_1 and broker_2 are dead and elect broker_0 as the new leader. - But, broker_2 can still send fetch requests to broker_1 and original ISR (broker_1, broker_2) will remain the same.

Re: How Kafka Manages Network Partition

2019-09-23 Thread Karolis Pocius
AFAIK there won't be two leaders. Once brokers lose connection with ZooKeeper, a new leader will be elected (whichever can still access ZooKeeper) and the remaining brokers will fall behind in replication. Now depending on your config, there might be several other issues: not enough replicas to sa

How Kafka Manages Network Partition

2019-09-23 Thread Isuru Boyagane
Can anyone clarify how Kafka manages below network partition? Say we have this configuration before the network partition, - Kafka cluster has three brokers (say broker_0, broker_1, broker2). - broker_1 is the leader. - ISR has been reduced to broker_1 and broker_2. - There is a Zooke