[
https://issues.apache.org/jira/browse/NIFI-12851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17822083#comment-17822083
]
ASF subversion and git services commented on NIFI-12851:
--------------------------------------------------------
Commit b368c281e8e6c25e040b083db6ebaaf95ec04c9a in nifi's branch
refs/heads/main from Paul Grey
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=b368c281e8 ]
NIFI-12851 - ConsumeKafka, remove limitation on count of subscribed topics
Signed-off-by: Pierre Villard <[email protected]>
This closes #8460.
> ConsumeKafka - remove hard coded limit to number of subscribed topics
> ---------------------------------------------------------------------
>
> Key: NIFI-12851
> URL: https://issues.apache.org/jira/browse/NIFI-12851
> Project: Apache NiFi
> Issue Type: Improvement
> Reporter: Paul Grey
> Assignee: Paul Grey
> Priority: Minor
> Time Spent: 10m
> Remaining Estimate: 0h
>
> This code in ConsumeKafka_2_6, and corresponding code in
> ConsumeKafkaRecord_2_6, cause NiFi to limit the number of topics subscribed
> to by the processor to 100.
> -
> https://github.com/apache/nifi/blob/ecea18f79655c0e34949d94609c8909aeb2d093e/nifi-nar-bundles/nifi-kafka-bundle/nifi-kafka-2-6-processors/src/main/java/org/apache/nifi/processors/kafka/pubsub/ConsumeKafka_2_6.java#L400
> If configuration specifies a number of topics greater than 100, those after
> the first hundred are ignored, with no indication.
> There is no limit to the size of the list which may be supplied to the Kafka
> Consumer API.
> -
> https://javadoc.io/static/org.apache.kafka/kafka-clients/2.8.2/org/apache/kafka/clients/consumer/Consumer.html#subscribe-java.util.Collection-
> Consider removal of this limit.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
