Are you running something else besides the consumers that would maintain a memory of the topics and potentially recreate them by issuing a metadata request? For example, Burrow (the consumer monitoring app I wrote) does this because it maintains a list of all topics in memory, and will end up recreating a topic that has been deleted as it issues a metadata request to try and find out what happened after an offset request for the topic fails.
-Todd On Fri, Dec 9, 2016 at 8:37 AM, Tim Visher <tim.vis...@gmail.com> wrote: > On Fri, Dec 9, 2016 at 11:34 AM, Todd Palino <tpal...@gmail.com> wrote: > > > Given that you said you removed the log directories, and provided that > when > > you did the rmr on Zookeeper it was to the “/brokers/topics/(topic name)” > > path, you did the right things for a manual deletion. It sounds like you > > may have a consumer (or other client) that is recreating the topic. Do > you > > have auto topic creation enabled? > > > > That was the last epiphany we had. We had shut down the producer but not > all the consumers and we do allow auto-topic creation. > > That said, we then proceeded to shut all of them down (the consumers) and > the topic came back. I'm glad that we were doing the right steps though. > > > > > -Todd > > > > > > On Fri, Dec 9, 2016 at 8:25 AM, Tim Visher <tim.vis...@gmail.com> wrote: > > > > > I did all of that because setting delete.topic.enable=true wasn't > > > effective. We set that across every broker, restarted them, and then > > > deleted the topic, and it was still stuck in existence. > > > > > > On Fri, Dec 9, 2016 at 11:11 AM, Ali Akhtar <ali.rac...@gmail.com> > > wrote: > > > > > > > You need to also delete / restart zookeeper, its probably storing the > > > > topics there. (Or yeah, just enable it and then delete the topic) > > > > > > > > On Fri, Dec 9, 2016 at 9:09 PM, Rodrigo Sandoval < > > > > rodrigo.madfe...@gmail.com > > > > > wrote: > > > > > > > > > Why did you do all those things instead of just setting > > > > > delete.topic.enable=true? > > > > > > > > > > On Dec 9, 2016 13:40, "Tim Visher" <tim.vis...@gmail.com> wrote: > > > > > > > > > > > Hi Everyone, > > > > > > > > > > > > I'm really confused at the moment. We created a topic with > brokers > > > set > > > > to > > > > > > delete.topic.enable=false. > > > > > > > > > > > > We now need to delete that topic. To do that we shut down all the > > > > > brokers, > > > > > > deleted everything under log.dirs and logs.dir on all the kafka > > > > brokers, > > > > > > `rmr`ed the entire chroot that kafka was storing things under in > > > > > zookeeper, > > > > > > and then brought kafka back up. > > > > > > > > > > > > After doing all that, the topic comes back, every time. > > > > > > > > > > > > What can we do to delete that topic? > > > > > > > > > > > > -- > > > > > > > > > > > > In Christ, > > > > > > > > > > > > Timmy V. > > > > > > > > > > > > http://blog.twonegatives.com/ > > > > > > http://five.sentenc.es/ -- Spend less time on mail > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > *Todd Palino* > > Staff Site Reliability Engineer > > Data Infrastructure Streaming > > > > > > > > linkedin.com/in/toddpalino > > > -- *Todd Palino* Staff Site Reliability Engineer Data Infrastructure Streaming linkedin.com/in/toddpalino
