[
https://issues.apache.org/jira/browse/KAFKA-8180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17127196#comment-17127196
]
James Cheng commented on KAFKA-8180:
------------------------------------
Do we know if this has been fixed in recent versions? I recall hearing about
some improvements to topic deletion, but I'm not sure if they fixed this or not.
> Deleting large number of topics can block the controller for the time it
> takes to delete all of them
> ----------------------------------------------------------------------------------------------------
>
> Key: KAFKA-8180
> URL: https://issues.apache.org/jira/browse/KAFKA-8180
> Project: Kafka
> Issue Type: Bug
> Components: controller
> Reporter: Gwen Shapira
> Priority: Major
>
> Scenario:
> - Create large number of topics (In my experiment: 400 topics with 12
> partitions each )
> - Use the admin client to delete all of them in a single batch operation
> - Try to bounce another broker while this is going on
> As you can see from the logs and metrics - topic deletion happens
> synchronously in the controller and it does not do anything else (leader
> elections for instance) while it is busy deleting (which can take many
> minutes for large batches).
> I recommend fixing it by throttling the deletes - no matter how large a batch
> the client sent, the controller should delete a subset and complete a full
> cycle before deleting the next subset.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)