Re: What happens to Kafka when ZK lost its quorum?
Hi Weide/Connie, I have added this entry in the FAQ, please let me know if anything on the wiki is not clear to you. https://cwiki.apache.org/confluence/display/KAFKA/FAQ#FAQ-HowareKafkabrokersdependonZookeeper ? Guozhang On Wed, May 14, 2014 at 8:15 AM, Neha Narkhede neha.narkh...@gmail.comwrote: Kafka requires a functional and healthy zookeeper setup. It is recommended that you closely monitor your zookeeper cluster and provision it so that it is performant. Thanks, Neha On Tue, May 13, 2014 at 6:52 AM, Connie Yang cybercon...@gmail.com wrote: Hi all, Can Kafka producers, brokers and consumers still be processing messages and functioning in their normal states if Zookeeper lost its quorum? Thanks, Connie -- -- Guozhang
Re: What happens to Kafka when ZK lost its quorum?
Kafka requires a functional and healthy zookeeper setup. It is recommended that you closely monitor your zookeeper cluster and provision it so that it is performant. Thanks, Neha On Tue, May 13, 2014 at 6:52 AM, Connie Yang cybercon...@gmail.com wrote: Hi all, Can Kafka producers, brokers and consumers still be processing messages and functioning in their normal states if Zookeeper lost its quorum? Thanks, Connie
Re: What happens to Kafka when ZK lost its quorum?
Hi Guozhang, In worst case zookeeper dies for say 1 hour and come back up, will things still be recovered automatically after 1 hour ? Weide On Wed, May 14, 2014 at 8:28 AM, Guozhang Wang wangg...@gmail.com wrote: In 0.8, the servers and consumers are heavily dependent on ZK to function. With ZK down, the servers cannot manage replicas and consumers cannot assign partitions within the group. In 0.9 we are going to remove the ZK dependency from consumer clients, but Kafka servers would still be dependent on ZK. Guozhang On Tue, May 13, 2014 at 6:52 AM, Connie Yang cybercon...@gmail.com wrote: Hi all, Can Kafka producers, brokers and consumers still be processing messages and functioning in their normal states if Zookeeper lost its quorum? Thanks, Connie -- -- Guozhang
Re: What happens to Kafka when ZK lost its quorum?
In 0.8, the servers and consumers are heavily dependent on ZK to function. With ZK down, the servers cannot manage replicas and consumers cannot assign partitions within the group. In 0.9 we are going to remove the ZK dependency from consumer clients, but Kafka servers would still be dependent on ZK. Guozhang On Tue, May 13, 2014 at 6:52 AM, Connie Yang cybercon...@gmail.com wrote: Hi all, Can Kafka producers, brokers and consumers still be processing messages and functioning in their normal states if Zookeeper lost its quorum? Thanks, Connie -- -- Guozhang
What happens to Kafka when ZK lost its quorum?
Hi all, Can Kafka producers, brokers and consumers still be processing messages and functioning in their normal states if Zookeeper lost its quorum? Thanks, Connie
Re: What happens to Kafka when ZK lost its quorum or becomes unstable?
The brokers are designed with the expectation that ZK service is always available. If ZK is not available, the clients may not be able to send/fetch data properly. Thanks, Jun On Tue, May 13, 2014 at 6:48 AM, Connie Yang cybercon...@gmail.com wrote: Hi, Can the producers, brokers and consumers still be processing messages when their ZK cluster lost its quorum or becomes unstable? I know this is rather general question as it may depends on what configuration these use. So, please enumerate all of those combinations. Thanks, Connie
What happens to Kafka when ZK lost its quorum or becomes unstable?
Hi, Can the producers, brokers and consumers still be processing messages when their ZK cluster lost its quorum or becomes unstable? I know this is rather general question as it may depends on what configuration these use. So, please enumerate all of those combinations. Thanks, Connie
