If we have six brokers, and a topic has three partitions on broker 1, 2, 3. Now if I add another three partitions. Will they be evenly distributed to 1,2,3 or 4,5,6?
One more question. If I use reassignment tool in 0.81 with 0.8 broker, will that work and get around the bugs? Regards, Libo -----Original Message----- From: Neha Narkhede [mailto:[email protected]] Sent: Monday, December 16, 2013 10:26 AM To: [email protected] Subject: RE: cluster expansion They will be evenly distributed across the nodes in the cluster. Thanks, Neha On Dec 16, 2013 6:42 AM, "Yu, Libo" <[email protected]> wrote: > Assume we have three brokers and a topic already has three partitions. > Now if I add another three partitions to this topic. Where will the > three partitions be located after running the script? > > Regards, > > Libo > > > -----Original Message----- > From: Jun Rao [mailto:[email protected]] > Sent: Sunday, December 15, 2013 11:43 PM > To: [email protected] > Subject: Re: cluster expansion > > Yes, kafka-add-partitons.sh should be stable in 0.8.0. > > Thanks, > > Jun > > > On Sat, Dec 14, 2013 at 1:22 AM, Robert Turner <[email protected]> wrote: > > > Is the kafka-add-partitons.sh tool stable in 0.8.0? > > > > > > On 13 December 2013 19:21, Neha Narkhede <[email protected]> > wrote: > > > > > Partition movement is not an automatic operation in Kafka yet. You > > > need > > to > > > use the partition reassignment tool - > > > > > > > > https://cwiki.apache.org/confluence/display/KAFKA/Replication+tools# > > Re plicationtools-6.ReassignPartitionsTool > > > . > > > > > > > > > Also, that feature is stable in 0.8.1. > > > > > > Thanks, > > > Neha > > > > > > > > > On Fri, Dec 13, 2013 at 6:48 AM, Robert Turner > > > <[email protected]> > > wrote: > > > > > > > No the 6 partitions for each topic will remain on the original > brokers. > > > You > > > > could either reassign some partitions from all topics to the new > > brokers > > > or > > > > you could add partitions to the new brokers for each topic. In > > > > 0.8.0 > > > there > > > > is now an add-partitions tool. > > > > > > > > Cheers > > > > Rob Turner. > > > > > > > > > > > > On 13 December 2013 14:42, Yu, Libo <[email protected]> wrote: > > > > > > > > > Hi folks, > > > > > > > > > > There are three brokers running 0.8-beta1 in our cluster currently. > > > > Assume > > > > > all the topics have six partitions. > > > > > I am going to add another three brokers to the cluster and > > > > > upgrade > > all > > > of > > > > > them to 0.8. My question is after the cluster is up, will the > > > > > partition be evenly distributed to all brokers? Thanks. > > > > > > > > > > Regards, > > > > > > > > > > Libo > > > > > > > > > > > > > > > > > > > > > > -- > > > > Cheers > > > > Rob. > > > > > > > > > > > > > > > -- > > Cheers > > Rob. > > >
