[
https://issues.apache.org/jira/browse/NIFI-5243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16501843#comment-16501843
]
Joe Trite commented on NIFI-5243:
---------------------------------
thx for the feedback. we have a multi-tenant kafka cluster. each tenant is
assigned a prefix for any topics they create...aaa-sensor1, aaa-sensor2,
bbb-location, bbb-speed. I need to detect new tenant prefixs and topics
(ccc-*) and then create a new ConsumeKafka processor with the new tenant prefix
as the topic pattern as well as credencials per topic prefix. My thought is
that i will execute ListKafkaTopics at some interval and compare with the
previous list to idenity new tenant prefixes, then add the new ConsumeKafka
processor via API. We also have an issue in development environments where
excessive "test" topics are created and never cleaned-up, so a simple
ListKafkaTopics -> PutEmail to show an inventory of topics would also be
benificial.
> Add ListKafkaTopics Processor
> -----------------------------
>
> Key: NIFI-5243
> URL: https://issues.apache.org/jira/browse/NIFI-5243
> Project: Apache NiFi
> Issue Type: New Feature
> Components: Extensions
> Reporter: Joe Trite
> Priority: Major
>
> I need to get a list of available Kakfa topics which I can filter and pass as
> input to ConsumeKafka* processors. This will provide me the ability to
> ingest Kafka messages using the same List > Fetch pattern that I currently
> use with files and tables.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
