Re: Kafka High Level Consumer Connector shuts down after 10 seconds

Session termination can happen either when client or zookeeper process pauses (due to GC) or when the client process terminates. A sustainable solution is to tune GC settings. For now, you can try increasing the zookeeper.session.timeout.ms. On Sun, Mar 9, 2014 at 3:44 PM, Ameya Bhagat

How kafka assign partition to stream

In my environment, I have 2 brokers and only 1 topic, each brokers has 10 partitions, so there are 20 partitions in total. I have 4 consumers in one consumer group, each consumer use createMessageStreams to create 10 streams, 40 streams in total. Since partition can not be split, so there are

kafka-websocket on github

I put this up over the weekend, thought it might be useful to folks: https://github.com/b/kafka-websocket

Re: Anouncing Kafka Offset Monitor 0.1

Interesting. We were able to get this from JMX for Kafka 0.7.2 - here's a snapshot for one of our Kafka clusters: https://apps.sematext.com/spm-reports/s/93EtvhnOz0 Is getting this from ZK instead of JMX better? Otis -- Performance Monitoring * Log Analytics * Search Analytics Solr

Re: Starting from beginning of topic using Java API (kafka 0.7)

Other than constantly using a new group id (and making a mess of zookeeper) or deleting the info for the group from zookeeper, is there any way to start from the beginning of the queue? It looks like this can be done from the underlying scala code, but I can't find anything in the Java API. -

Re: Starting from beginning of topic using Java API (kafka 0.7)

Currently, the only way to restart from the beginning of the queue is by deleting the previous checkpoint for the group. The reason is that in real production deployments, a consumer application can go through process restarts or other interruptions but the expectation is that it can start reading

Question on stability of new shiny KafkaProducer

Hello I am having producer throughput issue, so I am seriously considering to use new shiny KafkaProducer. Before proceeding, I want to confirm that it's fully stable for production from Kafka developers. Thank you Best, Jae

Re: Question on stability of new shiny KafkaProducer

The new producer is running on our mirror makers serving production load. It is relatively stable but there are a few corner case bugs that need to be fixed. Also, we haven't run performance tests yet to come up with throughput/latency numbers. I think you can reasonably use it in beta, but I

Re: Question on stability of new shiny KafkaProducer

I would second that. If you are a little bit risk tolerant, though, we would certainly appreciate the additional usage and since we are actively doing QA on it would want to fix any issues you might find. -Jay On Mon, Mar 10, 2014 at 3:23 PM, Neha Narkhede neha.narkh...@gmail.comwrote: The

Remote Zookeeper

Hi Pretty new to Kafka. Have been successful in installing Kafka 0.8.0. I am just wondering how should I make my kafka cluster (2 brokers) connect to a single remote zookeper server? I am using $KAFKA/kafka-server-start.sh $KAFKA_CONFIG/server.properties on both the brokers to start them up

Re: Remote Zookeeper

zookeeper.connect https://kafka.apache.org/08/configuration.html On Mon, Mar 10, 2014 at 7:17 PM, A A andthereitg...@hotmail.com wrote: Hi Pretty new to Kafka. Have been successful in installing Kafka 0.8.0. I am just wondering how should I make my kafka cluster (2 brokers) connect to a