Re: custom message handlers?

yes, i meant MirrorMaker. sorry for not being clear. d On 9/28/15 11:37 AM, James Cheng wrote: On Sep 28, 2015, at 12:47 PM, Doug Tomm wrote: hello, i've noticed the addition of the custom message handler feature in the latest code; a very useful feature. in what

Re: kafka 0.8.2.2 release

It's been discussed here recently http://mail-archives.apache.org/mod_mbox/kafka-dev/201509.mbox/%3CCAFc58G_dn_mMGaJoyiw81-RdAFJ2NAgxQFLtc%3D9pU5PwPW_Kvg%40mail.gmail.com%3E -Jaikiran On Monday 28 September 2015 11:08 PM, Richard Lee wrote: It appears from maven central and git that there was a

custom message handlers?

hello, i've noticed the addition of the custom message handler feature in the latest code; a very useful feature. in what release will it be available, and when might that be? at present i am building kafka from source to get this feature. many thanks, doug

kafka 0.8.2.2 release

It appears from maven central and git that there was a 0.8.2.2 release on Sept 2nd. However, the Kafka downloads page (https://kafka.apache.org/downloads.html) does not appear to have been updated. Also, why aren't the kafka shell scripts made available as a .tgz file in maven central like

Re: custom message handlers?

> On Sep 28, 2015, at 12:47 PM, Doug Tomm wrote: > > hello, > > i've noticed the addition of the custom message handler feature in the latest > code; a very useful feature. in what release will it be available, and when > might that be? at present i am building kafka from

Re: Log Cleaner Thread Stops

This is correct, compression isn't used for the offsets at all. If, for some reason, you do have either a compressed or a corrupt message somewhere in the topic, the method I mentioned previously will flush it out. We haven't seen that as a recurring problem, so fixing it once is sufficient.

Re: which producer should be used

Sorry, you're correct. Looks like a silly mistake on my side. I'll check my imports -- Sharninder On Mon, Sep 28, 2015 at 6:24 PM, Gwen Shapira wrote: > KafkaProducer takes ProducerRecord as an argument to send(). > > See the code: > >

Pushing from Pig to Kafka

Hi all! I accidently posted this on the dev mailing list yesterday, when it's much better off here. Can anybody help me? When I run a pig script I get: java.lang.InstantiationError: org.apache.avro.io.BinaryEncoder at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)

Re: Pushing from Pig to Kafka

Hey Stefan, I don't think it is much a matter for which list a lot of folks read both (depending on from where/whom you are expecting answer some). It has been ~ 2 years since folks have been operationalizing that part of the code (for a lot of reasons mostly map/reduce kind of having other

Failing to write to Kafka (partitions "don't have a leader")

We're running into this issue in a clustered environment where we're trying to send messages to Kafka and are getting the below error. Can someone explain what might be causing it and what the error message means (Failed to send data since partitions [,8] don't have a leader) ?

Re: which producer should be used

KafkaProducer takes ProducerRecord as an argument to send(). See the code: https://github.com/apache/kafka/blob/trunk/clients/src/main/java/org/apache/kafka/clients/producer/KafkaProducer.java#L298 and a usage example here: