|
Hi
@Edward, @Pierre
thx for your replies. I will read the
articles and hope I find an inspiration.
Best,
Peter
On 13.08.19 09:11, Pierre Villard
wrote:
Hi Peter,
In addition to Edward's answer, you may be interested by
the below posts:
Hope this helps,
Pierre
Hi Peter,
I think this depends on where this data is
stored. If this data is avaiable as metrics record by
Nifi, then a reporting task would be the best way forward.
However if this is data that is recorded in your FlowFiles
as part of your flow then I think you're looking at either
collecting in a KeyValue store of sorts and exposing it
via a Web Server pattern or forwarding the metrics
contained in the FlowFIle via a message bus, database or
flow file reciever of some description.
As for displaying your metrics there are a
lot of options out there that can recieve and processes
data in various forms and it really depends on what is the
best fit for your orginisation.
Personaly I would work out how and what you
use display the data and from there use that to influence
how you export it out from Nifi.
Edward
Hello,
does anyone have a tip for me on how I can provide
metrics about data
processed in nifi in a web UI?
I process XML files with nifi. for each file I
calculate how many new,
modified, unmodified, and deleted records are
contained. for each record
checks are still made. For example, whether values are
in the value range.
I would like to create an evaluation which shows me
how the data
properties are. For example yesterday I had 5 files,
one of them with
1000 deletions, but the average is only 10 deleted
records per file, on
average we process 500 files per day.
I'm currently looking for ideas on how to do this. I
think it would be
useful to export this data and then evaluate it in an
external
application. I am grateful for every hint.
Thx,
Peter
|
