Re: Batching with new Producer API

2015-02-26 Thread Akshat Aranya
Oh, that makes a lot more sense! I assumed that the batch size was in terms of number of messages, not the number of bytes because it was so small. What would be a reasonable value to use? Will 1-2 MB be too large and bursty? On Thu, Feb 26, 2015 at 10:07 AM, Harsha wrote: > Akshat, >P

Re: Batching with new Producer API

2015-02-26 Thread Harsha
Akshat, Produce.batch_size is in bytes and if your messages avg size is 310 bytes and your current number of messages per batch is 46 you are getting close to the max batch size 16384. Did you try increasing the producer batch_size bytes? -Harsha On Thu, Feb 26, 2015, a