[
https://issues.apache.org/jira/browse/NIFI-13408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
André Alves updated NIFI-13408:
-------------------------------
Description:
The main goal is to enhance the ConsumeKafka_2_6 processor to dynamically
change the Kafka topic based on incoming flowfile attributes. This allows the
processor to be more flexible and adaptable to varying data flows by updating
the Kafka topic as specified by the attributes in the flowfiles. To implement
this new feature, the following changes were made:
* Updated the processor to be able to receive incoming flowfiles.
* Enabled the "Topic Name(s)" property to support expression language,
allowing it to take values from flowfile attributes.
* Added a new entry named flowNames to the "Topic Name Format" property. When
this entry is chosen, the processor will determine the Kafka topic based on the
flowfile attribute defined in the "Topic Name(s)" property using expression
language.
* Created a JUnit test to cover this new feature.
The ConsumeKafka_2_6 processor maintains its original behavior even with
flowfile support. It can collect Kafka messages regardless of its connection
status and without needing stimulation from a flowfile. The key difference is
its new capability to support flowfile processing, allowing for dynamic topic
changes.
was:
The main goal is to enhance the ConsumeKafka_2_6 processor to dynamically
change the Kafka topic based on incoming flowfile attributes. This allows the
processor to be more flexible and adaptable to varying data flows by updating
the Kafka topic as specified by the attributes in the flowfiles. To implement
this new feature, the following changes were made:
* Updated the processor to be able to receive incoming flowfiles.
* Enabled the "Topic Name(s)" property to support expression language,
allowing it to take values from flowfile attributes.
* Added a new entry named flowNames to the "Topic Name Format" property. When
this entry is chosen, the processor will determine the Kafka topic based on the
flowfile attribute defined in the "Topic Name(s)" property using expression
language.
* Created a JUnit test to cover this new feature.
> Dynamically Update Kafka Topic in ConsumeKafka_2_6 Processor
> ------------------------------------------------------------
>
> Key: NIFI-13408
> URL: https://issues.apache.org/jira/browse/NIFI-13408
> Project: Apache NiFi
> Issue Type: New Feature
> Components: Extensions
> Reporter: André Alves
> Priority: Major
> Time Spent: 20m
> Remaining Estimate: 0h
>
> The main goal is to enhance the ConsumeKafka_2_6 processor to dynamically
> change the Kafka topic based on incoming flowfile attributes. This allows the
> processor to be more flexible and adaptable to varying data flows by updating
> the Kafka topic as specified by the attributes in the flowfiles. To implement
> this new feature, the following changes were made:
> * Updated the processor to be able to receive incoming flowfiles.
> * Enabled the "Topic Name(s)" property to support expression language,
> allowing it to take values from flowfile attributes.
> * Added a new entry named flowNames to the "Topic Name Format" property.
> When this entry is chosen, the processor will determine the Kafka topic based
> on the flowfile attribute defined in the "Topic Name(s)" property using
> expression language.
> * Created a JUnit test to cover this new feature.
> The ConsumeKafka_2_6 processor maintains its original behavior even with
> flowfile support. It can collect Kafka messages regardless of its connection
> status and without needing stimulation from a flowfile. The key difference is
> its new capability to support flowfile processing, allowing for dynamic topic
> changes.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
