Hi Peter,

I think this depends on where this data is stored. If this data is avaiable
as metrics record by Nifi, then a reporting task would be the best way
forward. However if this is data that is recorded in your FlowFiles as part
of your flow then I think you're looking at either collecting in a KeyValue
store of sorts and exposing it via a Web Server pattern or forwarding the
metrics contained in the FlowFIle via a message bus, database or flow file
reciever of some description.

As for displaying your metrics there are a lot of options out there that
can recieve and processes data in various forms and it really depends on
what is the best fit for your orginisation.

Personaly I would work out how and what you use display the data and from
there use that to influence how you export it out from Nifi.

Edward

On Mon, 12 Aug 2019, 22:54 Peter Piehler, <peter.pieh...@arcor.de> wrote:

> Hello,
>
> does anyone have a tip for me on how I can provide metrics about data
> processed in nifi in a web UI?
>
> I process XML files with nifi. for each file I calculate how many new,
> modified, unmodified, and deleted records are contained. for each record
> checks are still made. For example, whether values are in the value range.
> I would like to create an evaluation which shows me how the data
> properties are. For example yesterday I had 5 files, one of them with
> 1000 deletions, but the average is only 10 deleted records per file, on
> average we process 500 files per day.
>
> I'm currently looking for ideas on how to do this. I think it would be
> useful to export this data and then evaluate it in an external
> application. I am grateful for every hint.
>
> Thx,
> Peter
>
>

Reply via email to