Re: How to Change number of partitions without Rolling restart?

2020-06-21 Thread sunil chaudhari
Thanks all for this. Las question around this. If I write scripts for topics, I am afraid it will change partitions for some default/internal system created topics which I don't want, In that Case, I guess, I have to filter topic list first and then provide it to the script... is that correct?

Re: How to Change number of partitions without Rolling restart?

2020-06-21 Thread Manoj.Agrawal2
Or if you don’t want to automate then , use the excel sheet and generate below command for all topic . Put all 350 statement in script and run it . On 6/21/20, 9:28 PM, "Peter Bukowinski" wrote: [External] You can’t use a wildcard and must address each topic individually. You can

Re: How to Change number of partitions without Rolling restart?

2020-06-21 Thread Liam Clarke-Hutchinson
Hi Sunil, You'd want to do a bit of shell scripting for this. for topic in $(./kafka-topics.sh --bootstrap-server your-kafka-here:9092 --list); do ./kafka-topics.sh --bootstrap-server your-kafka-here:9092 --topic $topic --partitions X --alter done Etc. etc. And yep, to make sure further auto

RE: How to Change number of partitions without Rolling restart?

2020-06-21 Thread JOHN, BIBIN
: sunil chaudhari Sent: Sunday, June 21, 2020 11:16 PM To: users@kafka.apache.org Subject: Re: How to Change number of partitions without Rolling restart? Manoj, You mean I have execute this command manually for all 350 Topics which I already have? Is there any possibility I can use any wild

Re: How to Change number of partitions without Rolling restart?

2020-06-21 Thread Peter Bukowinski
You can’t use a wildcard and must address each topic individually. You can automate it with a for loop that takes an array/list of topics as the item to iterate over. -- Peter Bukowinski > On Jun 21, 2020, at 9:16 PM, sunil chaudhari > wrote: > > Manoj, > You mean I have execute this

Re: How to Change number of partitions without Rolling restart?

2020-06-21 Thread sunil chaudhari
Manoj, You mean I have execute this command manually for all 350 Topics which I already have? Is there any possibility I can use any wild cards? On Mon, 22 Jun 2020 at 9:28 AM, wrote: > You can use below command to alter to partition > > ./bin/kafka-topics.sh --alter --zookeeper localhost:2181

Re: How to Change number of partitions without Rolling restart?

2020-06-21 Thread Manoj.Agrawal2
You can use below command to alter to partition ./bin/kafka-topics.sh --alter --zookeeper localhost:2181 --topic my-topic --partitions 6 Thanks Manoj On 6/21/20, 7:38 PM, "sunil chaudhari" wrote: [External] Hi, I already have 350 topics created. Please guide me how can I do

Re: How to Change number of partitions without Rolling restart?

2020-06-21 Thread sunil chaudhari
Hi, I already have 350 topics created. Please guide me how can I do that for these many topics? Also I want each new topic to be created with more number partitions automatically than previous number 3, which I had set in properties. Regards, Sunil. On Mon, 22 Jun 2020 at 6:31 AM, Liam

Re: How to Change number of partitions without Rolling restart?

2020-06-21 Thread Liam Clarke-Hutchinson
Hi Sunil, The broker setting num.partitions only applies to automatically created topics (if that is enabled) at the time of creation. To change partitions for a topic you need to use kafka-topics.sh to do so for each topic. Kind regards, Liam Clarke-Hutchinson On Mon, Jun 22, 2020 at 3:16 AM

How to Change number of partitions without Rolling restart?

2020-06-21 Thread sunil chaudhari
Hi, I want to change number of partitions for all topics. How can I change that? Is it server.properties which I need to change? Then, in that case I have to restart broker right? I checked from confluent control center, there is no option to change partitions. Please advise. Regards, Sunil