Re: How to recover from ConsumerRebalanceFailedException ?

Bhavesh, In 0.9 consumer would not talk to ZK and will be single threaded, which will be easier to provide monitoring mechanisms. Guozhang On Thu, Nov 20, 2014 at 8:15 PM, Jun Rao wrote: > Can you just monitor the consumer byte/message/fetch rate? > > Thanks, > > Jun > > On Thu, Nov 20, 2014 a

Re: How to recover from ConsumerRebalanceFailedException ?

Can you just monitor the consumer byte/message/fetch rate? Thanks, Jun On Thu, Nov 20, 2014 at 5:31 PM, Bhavesh Mistry wrote: > HI Jun, > > Do you want me to request Jira ticket for feature a notification for new > consumer API and old consumer feature that consumer stream is dying. So > appl

Re: How to recover from ConsumerRebalanceFailedException ?

HI Jun, Do you want me to request Jira ticket for feature a notification for new consumer API and old consumer feature that consumer stream is dying. So application can try to restart it programmatically. I understand this is due to network or zk cluster instability. Let me know if you have alt

Re: How to recover from ConsumerRebalanceFailedException ?

Hi Jun, ZK cluster are up and running. What is best way to programmatically recover and I would try to exponential recovery process which I am willing to implement.So do you think monitoring "ZkClient-EventThread *" thread

Re: How to recover from ConsumerRebalanceFailedException ?

Is your ZK service alive at that point? If not, you just need to monitor the ZK server properly. Thanks, Jun On Mon, Nov 17, 2014 at 2:30 PM, Bhavesh Mistry wrote: > Hi Kafka Team, > > > I get following exception due to ZK/Network issues intermittently. How do > I recover from consumer thread

Re: How to recover from ConsumerRebalanceFailedException ?

Hi Kakfa team, So just monitor "ZkClient-EventThread *" threads via ThreadInfo[] threads = ManagementFactory.getThreadMXBean().; and if this ZkClient-EventThread

How to recover from ConsumerRebalanceFailedException ?

Hi Kafka Team, I get following exception due to ZK/Network issues intermittently. How do I recover from consumer thread dying *programmatically* and restart source because we have alerts that due to this error we have partition OWNERSHIP is *none* ? Please let me know how to restart source and