[
https://issues.apache.org/jira/browse/KAFKA-15029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jeff Kim updated KAFKA-15029:
-----------------------------
Description:
The producer id block size is currently fixed at 1000. Increasing the size
allows the pid manager to process more init pid requests before allocating
more. The current 1000 is quite small and given that clusters can have
thousands of producers, we should make this configurable to adapt in the
future. We shoudl also consider updating to a global block size of 5000
ProducerIdsIntegrationTest.scala has a disabled test (from KAFKA-14694) that we
should also enable once we have configurable block sizes.
was:
The producer id block size is currently fixed at 1000. Increasing the size
allows the pid manager to process more init pid requests before allocating
more. The current 1000 is quite small and given that clusters can have
thousands of producers, we should make this configurable to adapt in the
future. We shoudl also consider updating to a global block size of 5000
ProducerIdsIntegrationTest.scala has a disabled test that we should also enable
once we have configurable block sizes.
> Make ProducerIdBlock size configurable
> --------------------------------------
>
> Key: KAFKA-15029
> URL: https://issues.apache.org/jira/browse/KAFKA-15029
> Project: Kafka
> Issue Type: Task
> Reporter: Jeff Kim
> Priority: Major
>
> The producer id block size is currently fixed at 1000. Increasing the size
> allows the pid manager to process more init pid requests before allocating
> more. The current 1000 is quite small and given that clusters can have
> thousands of producers, we should make this configurable to adapt in the
> future. We shoudl also consider updating to a global block size of 5000
>
> ProducerIdsIntegrationTest.scala has a disabled test (from KAFKA-14694) that
> we should also enable once we have configurable block sizes.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
