Hi Jun, yes, we tried that. we also added mbean over jmx to monitor. The thread is healthy. Moreover, if it's something wrong with application, it should recover after restarting. However, after restarting application, it received few messages and immediately died. We have to restart kafka and zookeeper to make it back to normal. I haven't identified whether those few messages received after restarting are new messages from topic or always few repeated messages.
do you know what "Owner = null" means and why it happens? If the consumer works properly, owner always equals something like: Owner = xxxservice_ip-10-60-41-167-1345969396925-4966bd1a-0 If there is no consumer on a group, ConsumerOffsetChecker won't return anything. We always get Owner = null when consumer stops working. Any ideas? Thanks, Ke On Sun, Aug 26, 2012 at 6:10 PM, Jun Rao <jun...@gmail.com> wrote: > Ke, > > Have your tried suggestions in item #3 in > http://incubator.apache.org/kafka/faq.html ? If you put your consumer > thread in a java threadpool, exceptions may be eaten. > > Thanks, > > Jun > > On Sat, Aug 25, 2012 at 1:29 PM, Ke Ren <k...@spaceapegames.com> wrote: > > > Hi guys, > > > > I am running a kafka instance and a zookeeper instance on the same ec2 > > instance. I have 2 consumer groups on the same topic. They work fine for > > few days but one of the consumers keeps stopping after few days. I can't > > see any exception in my application logs or kafka log. The thread of the > > stopping consumer is still running but consumer can't receive any > message. > > Even I restart my application and it's still the same. I have to restart > > zookeeper and kafka to make it back to normal. > > > > I used the following tool suggested by kafka docs and found owner is null > > after consumer stops working. also its consumer offset won't change any > > more. > > > > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --group mygroup > > --zkconnect 127.0.0.1:2181 --topic mytopic > > > > It's very similar with > > > > > http://mail-archives.apache.org/mod_mbox/incubator-kafka-users/201207.mbox/%3c4ff59b1a.3080...@conduit.com%3E > > > > Any ideas about it? > > > > Thanks > > > > Ke > > >
