Jasper Knulst created NIFI-5267:
-----------------------------------
Summary: Add Kafka record timestamp to flowfile attributes
Key: NIFI-5267
URL: https://issues.apache.org/jira/browse/NIFI-5267
Project: Apache NiFi
Issue Type: Improvement
Components: Core Framework
Affects Versions: 1.6.0, 1.5.0
Reporter: Jasper Knulst
Fix For: 2.0.0
The ConsumeKafkaRecord and ConsumeKafka processors (0_10, 0_11 and 1_0) can
yield 1 flowfile holding many Kafka records. For ConsumeKafka this is optional
(using demarcator).
Currently the resulting flowfile already gets an attribute 'kafka.offset' which
indicates the starting offset (lowest) of any Kafka record within that bundle.
It would be valuable to also have a 'kafka.timestamp' attribute there (also
only related to the first record of that bundle) to be able to relate all the
records in the flowfile to the kafka timestamp and be able to replay some kafka
records based on this timestamp (feature in Kafka > 0.9 where replay by offset
and by timestamp is now a possibility)
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
