ProducerData jar file

Hi Experts, kafka.javaapi.producer.ProducerData class is available in 0.8.1 ? I am unable to use it, I copied all the jars in /build/dependant-libs-2.10.1 and libs folders, any help ? -- Thanks, Kishore.

Re: ProducerData jar file

do i need to download this separately ? my requirement is ingest the data in my csv files into kafka, please help me how to do it with java code. On Thu, Dec 11, 2014 at 1:30 PM, kishore kumar akishore...@gmail.com wrote: Hi Experts, kafka.javaapi.producer.ProducerData class is available in

Re: ProducerData jar file

Hi, You just need to include the libraries available in kafka/libs folder. Pl follow below example https://cwiki.apache.org/confluence/display/KAFKA/0.8.0+Producer+Example On Thu, Dec 11, 2014 at 4:43 PM, kishore kumar akishore...@gmail.com wrote: do i need to download this separately ? my

Re: How to Setup MirrorMaker in Generalized way

Hi Neha, Thanks for your reply. Now using MM tool to replicate data between Kafka clusters, But I am facing one problem, Messages gets duplicated if MM killed forcefully[ *kill -9* ]. Is there any solution to avoid this duplicated entry in target cluster? I am using Kafka *8.1.1.* On Mon,

Very slow producer

Hi, I’m writing my own producer to read from text files, and send line by line to Kafka cluster. I notice that the producer is extremely slow. It's currently sending at ~57KB/node/s. This is like 50-100 times slower than using bin/kafka-console-producer.sh Here’s my producer: final File dir

Re: ProducerData jar file

hi Manikumar, As I mentioned in previous mail, I added the jars available in libs folder, but this class is not available in that jars, I am using cloudera's CLABS-KAFKA. On Thu, Dec 11, 2014 at 4:55 PM, Manikumar Reddy ku...@nmsworks.co.in wrote: Hi, You just need to include the libraries

Re: ProducerData jar file

Hi, kafka.javaapi.producer.ProducerData class belongs to kafka 0.7/0.6. This class is removed from 0.8 on-wards. Pl try with 0.8.x API. Regards, Manikumar On Thu, Dec 11, 2014 at 8:10 PM, kishore kumar akishore...@gmail.com wrote: hi Manikumar, As I mentioned in previous mail, I added

there is no option --delete--version kafka_2.9.2-0.8.1.1

There is no option --delete--version kafka_2.9.2-0.8.1.1： 张宗军 乐居控股有限公司 运维技术部 地址：北京市东城区广渠家园5号楼首东国际大厦11层，100022 电话：15110221260 / 010-58951710 电邮：zongj...@leju.com 网址：www.leju.com 本邮件可能包含机密或专属资料和信息，供目标收件人用于特殊目的。严格禁止其他人改动、 使用、分发或披露。如果您不是目标收件人（或经过授权的收件人），请回复该邮件与发件人

Re: OutOfMemoryException when starting replacement node.

Agree that the docs can be better. Perhaps you want to open a JIRA (at issues.apache.org) with this suggestion? On Wed, Dec 10, 2014 at 4:03 PM, Solon Gordon so...@knewton.com wrote: I see, thank you for the explanation. You might consider being more explicit about this in your documentation.

Re: Is Kafka documentation regarding null key misleading?

Guozhang, can you point me to the code that implements periodic/sticky random partitioner? I actually like to try it out in our env, even though I assume it is NOT ported to 0.8.2 java producer. Thanks, Steven On Mon, Dec 8, 2014 at 1:43 PM, Guozhang Wang wangg...@gmail.com wrote: Hi Yury,

Re: Very slow producer

Did you set producer.type to async when creating your producer? The console producer uses async by default, but the default producer config is sync. -Ewen On Thu, Dec 11, 2014 at 6:08 AM, Huy Le Van huy.le...@insight-centre.org wrote: Hi, I’m writing my own producer to read from text files,

How do I create a consumer group

We're using 0.82 beta and a homegrown c++ async library based on boost asio that has support for the offset api. (apikeys OffsetCommitRequest = 8, OffsetFetchRequest = 9, ConsumerMetadataRequest = 10) If we use a java client and commit an offset then the consumer group shows up in the response

Given brokers, is it able to know all the zookeepers that brokers connect to

Hi Guys, If I know the brokers. Is there a way to know the zookeeper host from broker list? Thanks! Siyuan

Re: [DISCUSSION] adding the serializer api back to the new java producer

Thanks Jun. I think we all understand the motivation of adding serialization API back, but are just proposing different ways of doing such. I personally prefer to not bind the producer instance with a fixed serialization, but that said I am fine with the current proposal too as this can still be

Re: Very slow producer

Hi Ewen, Thank you for your response. It’s much faster after changing to async. Cheers,Huy, Le Van On Thursday, Dec 11, 2014 at 7:08 p.m., Ewen Cheslack-Postava e...@confluent.io, wrote: Did you set producer.type to async when creating your producer? The console producer uses async

Re: Is Kafka documentation regarding null key misleading?

Steven, You can take a look at kafka.producer.async.DefaultEventHandler, in getPartition function. Guozhang On Thu, Dec 11, 2014 at 9:58 AM, Steven Wu stevenz...@gmail.com wrote: Guozhang, can you point me to the code that implements periodic/sticky random partitioner? I actually like to