Hi, I am using the new Producer API in Kafka 0.8.2. I am writing messages to Kafka that are ~310 bytes long with the same partition key to one single . I'm mostly using the default Producer config, which sets the max batch size to 16,384. However, looking at the JMX stats on the broker side, I see that I'm only getting an average batch size of 46. I also tried increasing the linger.ms value to 100ms (default is 0), but that didn't help either. Is there something else that I can tune that will improve write batching?
Thanks, Akshat