Ismael Juma created KAFKA-8788: ---------------------------------- Summary: Optimize client metadata handling with a large number of partitions Key: KAFKA-8788 URL: https://issues.apache.org/jira/browse/KAFKA-8788 Project: Kafka Issue Type: Bug Affects Versions: 2.3.0 Reporter: Ismael Juma Assignee: Ismael Juma Fix For: 2.4.0, 2.3.1
Credit to [~lbradstreet] for profiling the producer with a large number of partitions. There was a regression in 2.3.0 that made the client metadata handling significantly less efficient when dealing with a large number of partitions. There was a less significant regression in 2.2.0. Lucas benchmarked the producer, but the code is shared with the consumer. See the PR for more details. -- This message was sent by Atlassian JIRA (v7.6.14#76016)