[ https://issues.apache.org/jira/browse/KAFKA-5335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dong Lin resolved KAFKA-5335. ----------------------------- Resolution: Won't Do > Controller should batch updatePartitionReassignmentData() operation > ------------------------------------------------------------------- > > Key: KAFKA-5335 > URL: https://issues.apache.org/jira/browse/KAFKA-5335 > Project: Kafka > Issue Type: Bug > Reporter: Dong Lin > Assignee: Dong Lin > Priority: Major > > Currently controller will update partition reassignment data every time a > partition in the reassignment is completed. It means that if user specifies a > huge reassignment znode of size 1 MB to move 10K partitions, controller will > need to write roughly 0.5 MB * 10000 = 5 GB data to zookeeper in order to > complete this reassignment. This is because controller needs to write the > remaining partitions to the znode every time a partition is completely moved. > This is problematic because such a huge reassignment may greatly slow down > Kafka controller. Note that partition reassignment doesn't necessarily cause > data movement between brokers because we may use it only to recorder the > replica list of partitions to evenly distribute preferred leader. -- This message was sent by Atlassian JIRA (v7.6.3#76005)