Re: Partial broker shutdown causing producers to stall even with replicas

2015-11-19 Thread Mahdi Ben Hamida
I've logged this as https://issues.apache.org/jira/browse/KAFKA-2864 -- Mahdi. On 11/16/15 12:59 PM, Rajiv Kurian wrote: Yes I think so. We specifically upgraded the Kafka broker with a patch to avoid the ZK client NPEs. Guess not all of them are fixed. The Kafka broker becoming a zombie even

Re: Partial broker shutdown causing producers to stall even with replicas

2015-11-16 Thread Mahdi Ben Hamida
Hello, See below for my original email. I was wondering if anybody has feedback on the 4 questions I've asked. Should I go ahead and file this as a bug ? Thanks. -- Mahdi. On 11/12/15 2:37 PM, Mahdi Ben Hamida wrote: Hi Everyone, We are using kafka 0.8.2.1 and we noticed that

Re: Partial broker shutdown causing producers to stall even with replicas

2015-11-16 Thread Rajiv Kurian
Yes I think so. We specifically upgraded the Kafka broker with a patch to avoid the ZK client NPEs. Guess not all of them are fixed. The Kafka broker becoming a zombie even if one ZK node is bad is especially terrible. On Tuesday, November 17, 2015, Mahdi Ben Hamida wrote: >

Partial broker shutdown causing producers to stall even with replicas

2015-11-12 Thread Mahdi Ben Hamida
Hi Everyone, We are using kafka 0.8.2.1 and we noticed that kafka/zookeeper-client were not able to gracefully handle a non existing zookeeper instance. This caused one of our brokers to get stuck during a shutdown and that seemed to impact the partitions for which the broker was a leader