Paul Grey created NIFI-12851:
--------------------------------
Summary: ConsumeKafka - remove hard coded limit to number of
subscribed topics
Key: NIFI-12851
URL: https://issues.apache.org/jira/browse/NIFI-12851
Project: Apache NiFi
Issue Type: Improvement
Reporter: Paul Grey
Assignee: Paul Grey
This code in ConsumeKafka_2_6, and corresponding code in
ConsumeKafkaRecord_2_6, cause NiFi to limit the number of topics subscribed to
by the processor to 100.
-
https://github.com/apache/nifi/blob/ecea18f79655c0e34949d94609c8909aeb2d093e/nifi-nar-bundles/nifi-kafka-bundle/nifi-kafka-2-6-processors/src/main/java/org/apache/nifi/processors/kafka/pubsub/ConsumeKafka_2_6.java#L400
If configuration specifies a number of topics greater than 100, those after the
first hundred are ignored, with no indication.
There is no limit to the size of the list which may be supplied to the Kafka
Consumer API.
-
https://javadoc.io/static/org.apache.kafka/kafka-clients/2.8.2/org/apache/kafka/clients/consumer/Consumer.html#subscribe-java.util.Collection-
Consider removal of this limit.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
