[
https://issues.apache.org/jira/browse/KAFKA-2265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jun Rao updated KAFKA-2265:
---------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
Thanks for the patch. This is great finding. I think the main overhead is to
re-parse the json data in the topic for every partition. When there are lots of
partitions, the json data is large and the parsing overhead is quite expensive.
With the patch, after creating a topic with 3K partitions, the leaders can be
elected within a few seconds. This used to take more than 10 mins.
+1 and committed to trunk.
> creating a topic with large number of partitions takes a long time
> ------------------------------------------------------------------
>
> Key: KAFKA-2265
> URL: https://issues.apache.org/jira/browse/KAFKA-2265
> Project: Kafka
> Issue Type: Improvement
> Components: core
> Affects Versions: 0.8.2.1
> Reporter: Jun Rao
> Assignee: Manikumar Reddy
> Fix For: 0.8.3
>
> Attachments: KAFKA-2265.patch
>
>
> Currently, creating a topic with 3K partitions can take 15 mins. We should be
> able to do that much faster. There is perhaps some redundant accesses to ZK
> during topic creation.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
