Re: Kakfa Topic gets auto-created post deletion

2024-03-13 Thread Abhishek Singla
Issue is now resolved by upgrading zookeeper version from 3.4.14 to 3.8.0 On Sun, Feb 18, 2024 at 6:15 PM sunil chaudhari wrote: > Hi Abhishek, > as I told you before, topic is getting created only because of consumer > polling. > The only way is to stop consumer, remove topic name from the

Re: Kakfa Topic gets auto-created post deletion

2024-02-18 Thread sunil chaudhari
Hi Abhishek, as I told you before, topic is getting created only because of consumer polling. The only way is to stop consumer, remove topic name from the consumer, delete topic. Here I assume your consumer knows which topic to read from( by static topic name) If not, I dont know how your

Re: Kakfa Topic gets auto-created post deletion

2024-02-18 Thread Abhishek Singla
Hi Megh, Thanks for the detailed explanation. I tested it out and below are the observations. When the delete topic command is issued, the topic is marked for deletion and it is deleted within the next 1 minute. In this 1 minute interval, the consumer offsets are there in __consumer_offsets

Re: Kakfa Topic gets auto-created post deletion

2024-02-18 Thread megh vidani
Hi Abhishek, The consumer offsets get stored in the __consumer_offsets topic by the kafka brokers and don't get automatically deleted when you delete a topic. If you have auto.create.topics.enable set to true in your broker configs, th consumer automatically creates the topic again. You will

Re: Kakfa Topic gets auto-created post deletion

2024-02-18 Thread Abhishek Singla
We only delete topics which does not have any active producers. Nowhere in our consumer config we explicitly specify topic name, these are subscribed based on pattern. How do I remove topic from consumer config? On Sun, 18 Feb 2024 at 2:51 PM, sunil chaudhari wrote: > correcte missig thing. >

Re: Kakfa Topic gets auto-created post deletion

2024-02-18 Thread sunil chaudhari
correcte missig thing. You have to remove that topic from producer as well as consumer config both. On Sun, 18 Feb 2024 at 2:49 PM, sunil chaudhari wrote: > You have to remove that topic from consumer config. > restart consumer. > the wait for some time. > Then delete topic. > this time it wont

Re: Kakfa Topic gets auto-created post deletion

2024-02-18 Thread sunil chaudhari
You have to remove that topic from consumer config. restart consumer. the wait for some time. Then delete topic. this time it wont create again. On Sun, 18 Feb 2024 at 1:07 PM, Abhishek Singla wrote: > Hi Team, > > Kafka version: 2_2.12-2.6.0 > Zookeeper version: 3.4.14 > Java version:

Kakfa Topic gets auto-created post deletion

2024-02-17 Thread Abhishek Singla
Hi Team, Kafka version: 2_2.12-2.6.0 Zookeeper version: 3.4.14 Java version: 1.8.0_301 Kafka Subscribe Pattern API is used to Subscribe to all topics matching specified pattern to get dynamically assigned partitions. New topics of specified pattern get created with time. > KafkaConsumer