[
https://issues.apache.org/jira/browse/KAFKA-20976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Grant updated KAFKA-20976:
---------------------------------
Description:
Hi all,
In ReplicationControlManager there is a max of 10,000 partitions allowed in a
single create topics request. See
[here|https://github.com/apache/kafka/blob/trunk/metadata/src/main/java/org/apache/kafka/controller/ReplicationControlManager.java#L152].
In an app I am seeing this limit being hit. I am trying to reproduce the error
in an integration test, but by creating so many partitions the test is becoming
slow and flaky.
I am hoping to make this value configurable on the controller side. Of course
it will default to 10,000. By making the value configurable users can set the
value to a lower one in tests.
was:
Hi all,
In ReplicationControlManager a max of 10,000 partitions in a single create
topics request. See
[here|https://github.com/apache/kafka/blob/trunk/metadata/src/main/java/org/apache/kafka/controller/ReplicationControlManager.java#L152].
In an app I am seeing this limit being hit. I am trying to reproduce the error
in an integration test, but by creating so many partitions the test is becoming
slow and flaky.
I am hoping to make this value configurable on the controller side. Of course
it will default to 10,000. By making the value configurable users can set the
value to a lower one in tests.
> Make KRaft max partitions per request limit a config
> ----------------------------------------------------
>
> Key: KAFKA-20976
> URL: https://issues.apache.org/jira/browse/KAFKA-20976
> Project: Kafka
> Issue Type: Improvement
> Components: controller, kraft
> Reporter: Andrew Grant
> Assignee: Andrew Grant
> Priority: Trivial
>
> Hi all,
> In ReplicationControlManager there is a max of 10,000 partitions allowed in a
> single create topics request. See
> [here|https://github.com/apache/kafka/blob/trunk/metadata/src/main/java/org/apache/kafka/controller/ReplicationControlManager.java#L152].
> In an app I am seeing this limit being hit. I am trying to reproduce the
> error in an integration test, but by creating so many partitions the test is
> becoming slow and flaky.
> I am hoping to make this value configurable on the controller side. Of course
> it will default to 10,000. By making the value configurable users can set the
> value to a lower one in tests.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
