Re: kafka metrics emitting to graphite

I plan on trying this out https://github.com/airbnb/kafka-statsd-metrics2 but yea, JMXTrans is a good option for getting mbean values into graphite as well. On 10/11/15, 8:18 PM, "sunil kalva" wrote: >tx ben, >i though we have native support for graphite in kafka, i

Kafka Async producer throwing Exception before configured timeout.

Hi , We are getting below exception frequently even, we have configured timeout as 1ms. Does anyone also has faced this issue. org.apache.kafka.common.errors.TimeoutException: Failed to update metadata > after 28 ms We are using Kafka-0.8.2.1 and producer configurations are: >

New Consumer - discover consumer groups

Hi, Assuming i am using the latest kafka (trunk), exclusively with the new consumer, and i want to monitor consumer lag across all groups - how would i go about discovering the consumer groups? Is there an API call for this? Thanks, Damian

Getting started with Kafka using Java client

Hi All, Can someone please point me to a well documented github code example for using Kafka 's java client. So far I haven't been able to find much related to using Java client. Most of the examples are using command prompt for producing and consuming messages. It's a bit frustrating that though

Re: Getting started with Kafka using Java client

Hi Tarun There is an examples section in the kafka project here which shows the Consumer, SingleConsumer and Producer. These are just clients so you’ll need ZK and a Kafka server running to get them going. You probably don’t need to worry

Does Kafka recover all data if node is reimaged

I was wondering if a kafka broker node get reimaged and all data is wiped off, Will kafka recover all data on node from replication? -- Thanks, Raja.

Re: New Consumer - discover consumer groups

I double checked with Jun but there is currently no direct API for consumer group discovery. I expect you already know this but you can get a consumer’s offset in the new API. You could also derive the info you need from the offsets topic. B > On 12 Oct 2015, at 17:09, Damian Guy

Partitions - Brokers - Servers

I think I understand the concept of partitioning a topic and it's benefits. But I can't find any clear explanation of relationship between partitions, brokers and physical servers. Is there any document or article that discusses the number of partitions for each broker and brokers for each

Kafka 0.9.0 release branch

Hi, Everyone, As we are getting closer to the 0.9.0 release, we plan to cut an 0.9.0 release branch in about two weeks from now. In the meantime, we will try to resolve most if not all 0.9.0 blockers listed below.

Consume messages from offset A to B with the kafka shell scripts, etc.? And get total messages given starting and ending offset?

Hi, Similar to consuming max messages N (or count of messages N in kafkacat), is there any way/option to consume starting from offset A up to ending offset B (we know only offsets but not the total # of messages between those offsets) It looks like that's not available natively? And I guess one

Re: Does Kafka recover all data if node is reimaged

Yes. As long as you have not reassigned the partitions to other brokers, the wiped broker will rebuild from replication. Keep in mind, however, that if you are using the retention by time configuration, you will have 2x retention on that broker for the length of retention. This means that if your