Matt Burgess created NIFI-7273:
----------------------------------

             Summary: Add flow metrics REST endpoint with for Prometheus 
scraping
                 Key: NIFI-7273
                 URL: https://issues.apache.org/jira/browse/NIFI-7273
             Project: Apache NiFi
          Issue Type: New Feature
          Components: Extensions
            Reporter: Matt Burgess


NiFi has the ability to expose endpoints for Prometheus to scrape via the 
PrometheusReportingTask (NIFI-4362) and via components that use the 
PrometheusRecordSink controller service. However that involves adding 
components to the overall flow, which requires their own configuration and ends 
up generating their own metrics that contribute to rollup metrics and queries.

This Jira proposes to add an endpoint to the NiFi REST API that exposes the 
following metrics/information in Prometheus format for scraping:

- Root Process Group status (recursive to include all components)
- Connection Status Analytics (backpressure predictions, e.g.)
- JVM Metrics
- Bulletins (for use by AlertManager, not necessarily a metric per se)

Standard security/authorization principles apply, and it is proposed to offer 
node-specific metrics rather than cluster-wide aggregates, as Prometheus can 
then choose how to do the aggregates as necessary.

It may be prudent to refactor PrometheusMetricsUtil out into its own module, 
for use by the various components in various modules (to now include the 
framework).



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to