greyp9 commented on code in PR #6131:
URL: https://github.com/apache/nifi/pull/6131#discussion_r931289385
##########
nifi-nar-bundles/nifi-kafka-bundle/nifi-kafka-2-6-processors/src/main/resources/docs/org.apache.nifi.processors.kafka.pubsub.ConsumeKafkaRecord_2_6/additionalDetails.html:
##########
@@ -256,5 +256,133 @@ <h3>SASL_SSL</h3>
ssl.client.auth property.
</p>
+ <h2>Output Modes</h2>
+ <div>
+ <p>This processor (NiFi 1.17+) offers multiple output strategies
(configured via processor property 'Consume
+ Strategy') for converting Kafka records into FlowFiles.</p>
+ <ul>
+ <li>Consume Strategy 'Write Value Only' (the default) emits
flowfile records containing only the Kafka
+ record value.
+ </li>
+ <li>Consume Strategy 'Use Wrapper' (new) emits flowfile
records containing the Kafka record key, value,
+ and headers, as well as additional metadata from the Kafka
record.
+ </li>
+ </ul>
+
+
+ <p>The record schema that is used when 'Use Wrapper' is active is
as follows (in Avro format):</p>
+<code>
+<pre>
+[
+ {
+ "type": "record",
+ "name": "kafka:ConsumeRecord:metadata",
+ "namespace": "org.apache.nifi",
+ "fields": [{
+ "name": "key",
+ "type": ["bytes", "string", "record"]
+ }, {
+ "name": "topic",
+ "type": "string"
+ }, {
+ "name": "partition",
+ "type": "int"
+ }, {
+ "name": "offset",
+ "type": "long"
+ }, {
+ "name": "timestamp",
+ "type": "long",
+ "logicalType": "timestamp-millis"
+ }]
+ },
+ {
+ "type": "record",
+ "name": "kafka:ConsumeRecord:wrapper",
+ "namespace": "org.apache.nifi",
+ "fields": [{
+ "name": "key",
+ "type": ["bytes", "string", "record"]
+ }, {
+ "name": "value",
+ "type": "record"
+ }, {
+ "name": "headers",
+ "type": "map",
+ "values": "string"
+ }, {
+ "name": "metadata",
+ "type": "kafka:ConsumeRecord:metadata"
+ }]
+ }
+]
Review Comment:
I had used this as a guide for expressing multiple schemas:
https://stackoverflow.com/a/40865366
Will replace with your suggestion; thanks!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
