Closing socket for 1.2.4.5 because of error (kafka.network.Processor)

2015-12-21 Thread Arathi Maddula
Hi, I found this error in my kafka.out. How can I find what is causing this error? Kafka jar : kafka_2.10-0.8.2.2.3.2.0-2950.jar Closing socket for /1.2.3.4 because of error (kafka.network.Processor) java.lang.NullPointerException at kafka.network.Processor.run(SocketServer.scala:404)

Change kafka broker ids dynamically

2015-11-06 Thread Arathi Maddula
Hi, Is it possible to change the broker.ids property for a node belonging to a Kafka cluster? For example, currently if I have brokers with ids 1,2,3. If I want to stop broker 1, can I change broker.id to 0 (with current id = 1) in server.properties and meta.properties files and then restart

Regarding question Kafka metrics. Issue with unclean leader election rate

2014-01-23 Thread Arathi Maddula
This is wrt question Kafka metrics. Issue with unclean leader election rate (http://www.marshut.com/inkitk/kafka-metrics-issue-with-unclean-leader-election-rate.html) We use Kafka 0.8.0

Kafka metrics. Issue with unclean leader election rate

2014-01-23 Thread Arathi Maddula
Yes we use 0.8.0 release

Default compression code in Kafka topics

2013-11-08 Thread arathi maddula
Hi, We have a cluster of Kafka servers. We want data of all topics on these servers to be compressed, Is there some configuration to achieve this? I was able to compress code by using compression.codec property in ProducerConfig in Kafka Producer. But I wanted to know if there is a way of

Messages TTL setting

2013-07-22 Thread arathi maddula
Hi, We have a 3 node Kafka cluster. We want to increase the maximum amount of time for which messages are saved in Kafka data logs. Can we change the configuration on one node, stop it and start it and then change the configuration of the next node? Or should we stop all 3 nodes at a time, make

Kafka compression issues

2013-07-09 Thread arathi maddula
Hi, I use kafka 0.8. When I run the kafka console producer using ./kafka-console-producer.sh --topic test.compress.e --compress true --broker-list 127.0.0.1:9092 Iam able to see compressed messages in the log. But when I run a Java producer class using the following properties, no

High level zookeeper consumer life

2013-05-31 Thread arathi maddula
Hi, I use a high level consumer inside a servlet which reads from Kafka stream. Every time I send an HTTP request, I use a different group ID. This results in lots of consumers on zookeeper node( ls /consumers on zookeeper client shows list of all consumers). Please help me clarify these: 1)Is

Issue during commitOffsets using SimpleConsumer

2013-05-30 Thread arathi maddula
Hi, I get the following error on running SimpleConsumer.commitOffsets(). Could you tell me what is the issue? *java.io.EOFException*: Received -1 when reading from channel, socket has likely been closed. at kafka.utils.Utils$.read(Utils.scala:375) at

SimpleConsumer and message offsets

2013-05-29 Thread arathi maddula
Hi, Iam using a program which reads data from a stream using SimpleConsumer. Is there a way for SimpleConsumer to remember the last offset read? I want the program to continue from the last offset read when it is restarted. Thanks in advance. -Arathi

Re: Offset in high level consumer

2013-05-23 Thread arathi maddula
...@gmail.comwrote: You can run the ConsumerOffsetChecker tool that ships with Kafka. Thanks, Neha On Wed, May 22, 2013 at 2:02 PM, arathi maddula arathimadd...@gmail.com wrote: Hi, Could you tell me how to find the offset in a high level Java consumer ? Thanks Arathi