NullPointerException in calls of ZkClient

2016-02-03 Thread Hema Bhatia
I am repeatedly seeing NPEs for calls made to ZkClient. I am using zkClient-0.5 + zookeeper 3.4.5 + kafka 0.8.2.0 There is a related jira for similar NPE issue, and looks like zkClient-0.5 must have solved the issue. https://issues.apache.org/jira/browse/KAFKA-2169

kafka error

2015-09-29 Thread Hema Bhatia
I keep seeing this error while creating topic : Error is: replication factor: 3 larger than available brokers: 2 I have 4 kafka nodes, and replication factor of 3. 2 nodes on datacenter 1, 2 on datacenter 2 running kafka 0.8.2.0.

RE: log clean up

2015-09-25 Thread Hema Bhatia
=[%d] %p %m (%c)%n log4j.appender.stateChangeAppender.MaxFileSize=100KB log4j.appender.stateChangeAppender.MaxBackupIndex=5 Adding the last two lines will make sure you have 5 state change log files each 100KB. Gwen On Fri, Sep 25, 2015 at 11:04 AM, Hema Bhatia <hema.bha...@apollo.edu>

log clean up

2015-09-25 Thread Hema Bhatia
Is there a way to delete kafka server, controller and state-change logs. They just keep growing over time and not purged. -Hema

RE: ZkClient throwing NPEs

2015-09-24 Thread Hema Bhatia
issue on the slim chance I'm not wrong: https://github.com/sgroschupf/zkclient/issues/25. -Jason On Thu, Sep 24, 2015 at 10:09 AM, Hema Bhatia <hema.bha...@apollo.edu> wrote: > Can anyone help with the below issue... > Thanks. > > -Original Message- > From: Hema Bh

RE: ZkClient throwing NPEs

2015-09-24 Thread Hema Bhatia
2015 at 12:39 PM, Hema Bhatia <hema.bha...@apollo.edu> wrote: > Thanks Jason. > > So what is the temporary workaround for this until its fixed? For now, > we just restart the app server having this issue, but we keep seeing > this issue time and again. > > > -O

RE: ZkClient throwing NPEs

2015-09-24 Thread Hema Bhatia
Can anyone help with the below issue... Thanks. -Original Message- From: Hema Bhatia [mailto:hema.bha...@apollo.edu] Sent: Tuesday, September 22, 2015 12:57 PM To: users@kafka.apache.org Subject: ZkClient throwing NPEs Hi, I keep getting the below exception when Kafka tries to connect

ZkClient throwing NPEs

2015-09-22 Thread Hema Bhatia
Hi, I keep getting the below exception when Kafka tries to connect to zookeeper and zookeeper is momentarily not able to connect. After that, connection does not restore unless we restart the servers. This may be connected to this issue : https://issues.apache.org/jira/browse/KAFKA-824 But I

High level consumer offset check in Java

2015-08-31 Thread Hema Bhatia
Hi all, I want to check consumer offset within Java application. Is there an API (or some way) to do that for high level consumer? I see OffsetFetchResponse class which has APIs which I can use for simple consumer, but found nothing yet for high-level consumer. I am using kafka 0.8.2.0, and

RE: Consumer in Java client

2015-03-31 Thread Hema Bhatia
2 more questions to add to it: - Any estimation for when new consumer client will be ready for high level consumer? - Also, will it come with offset management functionality for high level consumer too? -Original Message- From: Jiangjie Qin [mailto:j...@linkedin.com.INVALID] Sent:

RE: Delete Topic in 0.8.2

2015-03-01 Thread Hema Bhatia
, Can you attach controller.log and state-change.log. Image is not showing up at least for me. Can you also give us details on how big the cluster is and topic's partitions and replication-factor and any steps on reproducing this. Thanks, Harsha On Sun, Mar 1, 2015, at 12:40 PM, Hema Bhatia wrote

Delete Topic in 0.8.2

2015-03-01 Thread Hema Bhatia
I upgraded my kafka server to 0.8.2 and client to use 0.8.2 as well.. I am trying to test delete topic feature and I see that delete topic do not work consistently. I saw it working fine a first few times but after a while I saw that deleting topics add them to delete_topic node in admin folder