Mark Payne created NIFI-7953: -------------------------------- Summary: Allow ConsumeKafka_2_* / ConsumeKafkaRecord_2_* to separate Records based on Message Key Key: NIFI-7953 URL: https://issues.apache.org/jira/browse/NIFI-7953 Project: Apache NiFi Issue Type: Improvement Components: Extensions Reporter: Mark Payne Assignee: Mark Payne
The Kafka consumer processors ignore the Message Key when using a demarcator or when using the Record variant, because adding a FlowFile attribute for the message key doesn't make sense, since the key is likely different per record. However, a fairly common use case is to use the Key only for partitioning and many Kafka Messages may exist for the same key. For example, this is commonly used for CDC type of use cases where the key may just be a table name. For such cases, it would be helpful to allow the consumer processors to avoid adding two messages to the same FlowFile if their keys are different. I.e., all records in a given FlowFile will have the same key. The key can then be added as a FlowFile attribute. -- This message was sent by Atlassian Jira (v8.3.4#803005)