Failed attempt to delete topic

2015-12-03 Thread Rakesh Vidyadharan
Hello, We are on an older kafka (0.8.1) version. While a number of consumers were running, we attempted to delete a few topics using the kafka-topics.sh file (basically want to remove all messages in that topic and restart, since our entities went through some incompatible changes). We

Re: Failed attempt to delete topic

2015-12-03 Thread Stevo Slavić
Delete was actually considered to be working since Kafka 0.8.2 (although there are still not easily reproducible edge cases when it doesn't work well even in in 0.8.2 or newer). In 0.8.1 one could request topic to be deleted (request gets stored as entry in ZooKeeper), because of presence of the

Re: Failed attempt to delete topic

2015-12-03 Thread Rakesh Vidyadharan
Hi Mayuresh These are some of the relevant logs that I could find [2015-12-03 16:04:23,594] INFO Loading log 'merckx.raw.event.type-0' (kafka.log.LogManager) [2015-12-03 16:04:23,595] INFO Completed load of log merckx.raw.event.type-0 with log end offset 2 (kafka.log.Log) [2015-12-03

Re: Failed attempt to delete topic

2015-12-03 Thread Mayuresh Gharat
you can use the zookeeper shell inside the bin directory for that. Thanks, Mayuresh On Thu, Dec 3, 2015 at 4:04 PM, Rakesh Vidyadharan < rvidyadha...@gracenote.com> wrote: > Thanks Stevo. I did see some messages related to /admin/delete_topics. > Will do some research on how I can clean up

Re: Failed attempt to delete topic

2015-12-03 Thread Rakesh Vidyadharan
Thanks Mayuresh. I was able to use the shell to delete the entries and things are working fine now. On 03/12/2015 18:22, "Mayuresh Gharat" wrote: >you can use the zookeeper shell inside the bin directory for that. > >Thanks, > >Mayuresh > >On Thu, Dec 3, 2015 at

Re: Failed attempt to delete topic

2015-12-03 Thread Mayuresh Gharat
Can you paste some logs from the controller, when you deleted the topic? Thanks, Mayuresh On Thu, Dec 3, 2015 at 2:30 PM, Rakesh Vidyadharan < rvidyadha...@gracenote.com> wrote: > Hello, > > We are on an older kafka (0.8.1) version. While a number of consumers > were running, we attempted to

Re: Failed attempt to delete topic

2015-12-03 Thread Steve Robenalt
Hi Rakesh, Topic deletion didn't really work properly until 0.8.2. Here's a stackoverflow link that summarizes how to work around this limitation: http://stackoverflow.com/questions/24287900/delete-topic-in-kafka-0-8-1-1 HTH, Steve On Thu, Dec 3, 2015 at 3:33 PM, Mayuresh Gharat

Re: Failed attempt to delete topic

2015-12-03 Thread Rakesh Vidyadharan
Thanks Stevo. I did see some messages related to /admin/delete_topics. Will do some research on how I can clean up zookeeper. Thanks Rakesh On 03/12/2015 17:55, "Stevo Slavić" wrote: >Delete was actually considered to be working since Kafka 0.8.2 (although >there are