Re: Http Kafka producer

Hi Marc, That describes the behavior of the kafka producer library that batches writes to kafka. This post on confluent.io explains it pretty well: http://kafka.apache.org/082/javadoc/index.html?org/apache/kafka/clients/pro ducer/KafkaProducer.html But the general idea is that the producer will

Re: Http Kafka producer

Marc, As Erik said, the behavior I was referring to is for the standard Kafka producer, which the REST proxy uses for sending data to Kafka. Batches are not of a predetermined fixed size or anything like that. Internally, the producer maintains a queue of messages, keeping track of both

Re: Reg Leader re-election when leader crashes

Hello Amar, Few questions. 1. What is the version of Kafka you are using? 2. What is the replication factor of your topic? 3. What is your min.insync.replicas set to? 4. Are you using new producer? Are you producing in sync or async mode? On Wed, Aug 26, 2015 at 1:36 PM, Amar

Re: Mirror a partition of a topic

Binh, You can refer to this https://cwiki.apache.org/confluence/display/KAFKA/KIP-3+-+Mirror+Maker+Enhancement#KIP-3-MirrorMakerEnhancement-Messagehandlerinconsumerthread and KAFKA-1997 https://issues.apache.org/jira/browse/KAFKA-1997 for details on getting this done using MirrorMaker’s message