Currently, I have one producer publishing messages on one topic (say t1). I have configured number of partitions on broker as 3 for topic t1 in broker config. At Consumer side, i have one consumer group with 3 consumers. I have mapped these 3 consumers to 3 partitions (one to one mapping), each consumer creates one map task and i store consumer's offsets in hdfs.
But in future, if suppose producer starts producing messages at higher speed, I would like to increase number of partitions for this topic (t1) and number of consumers also for that consumer group. I want to avoid broker restart. I was wondering if there is any way to do that. Broker restart can be problematic in case i have multiple brokers. On Tue, May 15, 2012 at 9:35 PM, Jun Rao <jun...@gmail.com> wrote: > No, this is a config change on the broker and requires a broker restart. > > Jun > > On Tue, May 15, 2012 at 8:27 AM, Tarun Kumar <agrawal.taru...@gmail.com > >wrote: > > > Is there any way to change the number of partitions topic wise on the fly > > without restarting kafka server? > > >
