[
https://issues.apache.org/jira/browse/NIFI-14566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17951506#comment-17951506
]
ASF subversion and git services commented on NIFI-14566:
--------------------------------------------------------
Commit 847686684f192eb7506897a2834726e55a4ceb0b in nifi's branch
refs/heads/main from Pierre Villard
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=847686684f ]
NIFI-14566 Added Inject Metadata Output Strategy in ConsumeKafka (#9942)
Signed-off-by: David Handermann <[email protected]>
> Introduce Inject Metadata Output Strategy in ConsumeKafka
> ---------------------------------------------------------
>
> Key: NIFI-14566
> URL: https://issues.apache.org/jira/browse/NIFI-14566
> Project: Apache NiFi
> Issue Type: Improvement
> Components: Extensions
> Reporter: Pierre Villard
> Assignee: Pierre Villard
> Priority: Major
>
> The Output Strategy in Consume Kafka (when using Record) currently supports
> two options
> * USE_VALUE
> * USE_WRAPPER
> With USE_VALUE, the record read from the Kafka message will be the output of
> the record in the flow file.
> With USE_WRAPPER, the record read from the Kafka message will be used as a
> sub-record of a new record with specific fields (value for the record read
> from the kafka message, metadata for some metadata from the kafka message,
> headers and key).
> The goal is to introduce another strategy INJECT_METADATA, where we keep the
> record read from the kafka message and update its schema to add one sub
> record field to include all of the metadata (metadata, headers and key).
> This can be interesting when the user provides a schema to read the data from
> Kafka and wants to retain that schema while still having the option to have
> the metadata if needed. In case the user leverages record oriented
> processors, the user does not need to use prefixed record paths (like
> /value/myField) but can directly use record paths that are matching their
> schema (/myField).
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
