Dariusz Seweryn created NIFI-15644:
--------------------------------------
Summary: Record Kafka consumer lag as gauge metric in ConsumeKafka
processor
Key: NIFI-15644
URL: https://issues.apache.org/jira/browse/NIFI-15644
Project: Apache NiFi
Issue Type: Improvement
Components: Extensions
Affects Versions: 2.8.0
Reporter: Dariusz Seweryn
Assignee: Dariusz Seweryn
As of [NIFI-15545|https://issues.apache.org/jira/browse/NIFI-15545], the
KafkaConsumerService exposes a currentLag(TopicPartitionSummary) method that
returns the current consumer lag (in records) for a given topic-partition.
However, this information is not currently utilized by the ConsumeKafka
processor.
This ticket adds gauge metric recording to ConsumeKafka so that per-partition
consumer lag is reported through the NiFi metrics framework via
ProcessSession.recordGauge(). This enables operators to monitor consumer lag
through any configured ComponentMetricReporter (e.g., OpenTelemetry).
--
This message was sent by Atlassian Jira
(v8.20.10#820010)