Re: OutOfMemoryError in mirror maker

2015-06-28 Thread tao xiao
That is so cool. Thank you On Sun, 28 Jun 2015 at 04:29 Guozhang Wang wangg...@gmail.com wrote: Tao, I have added you to the contributor list of Kafka so you can assign tickets to yourself now. I will review the patch soon. Guozhang On Thu, Jun 25, 2015 at 2:54 AM, tao xiao

Re: Batch producer latencies and flush()

2015-06-28 Thread Ewen Cheslack-Postava
The logic you're requesting is basically what the new producer implements. The first condition is the batch size limit and the second is linger.ms. The actual logic is a bit more complicated and has some caveats dealing with, for example, backing off after failures, but you can see in this code

Re: Batch producer latencies and flush()

2015-06-28 Thread Achanta Vamsi Subhash
*bump* On Tue, Jun 23, 2015 at 1:03 PM, Achanta Vamsi Subhash achanta.va...@flipkart.com wrote: Hi, We are using the batch producer of 0.8.2.1 and we are getting very bad latencies for the topics. We have ~40K partitions now in a 20-node cluster. - We have many topics and each with

RE: Help Us Nominate Apache Kafka for a 2015 Bossie (Best of OSS) Award - Due June 30th

2015-06-28 Thread Aditya Auradkar
Sent :) From: Gwen Shapira [gshap...@cloudera.com] Sent: Friday, June 26, 2015 11:53 AM To: users@kafka.apache.org Cc: d...@kafka.apache.org Subject: Re: Help Us Nominate Apache Kafka for a 2015 Bossie (Best of OSS) Award - Due June 30th Sent! Thanks for