Hi Peter, In addition to Edward's answer, you may be interested by the below posts: https://pierrevillard.com/2017/05/11/monitoring-nifi-introduction/ https://pierrevillard.com/2018/02/07/fod-paris-jan-18-nifi-registry-and-workflow-monitoring-with-a-use-case/ https://pierrevillard.com/2018/08/29/monitoring-driven-development-with-nifi-1-7/
Hope this helps, Pierre Le mar. 13 août 2019 à 00:36, Edward Armes <[email protected]> a écrit : > Hi Peter, > > I think this depends on where this data is stored. If this data is > avaiable as metrics record by Nifi, then a reporting task would be the best > way forward. However if this is data that is recorded in your FlowFiles as > part of your flow then I think you're looking at either collecting in a > KeyValue store of sorts and exposing it via a Web Server pattern or > forwarding the metrics contained in the FlowFIle via a message bus, > database or flow file reciever of some description. > > As for displaying your metrics there are a lot of options out there that > can recieve and processes data in various forms and it really depends on > what is the best fit for your orginisation. > > Personaly I would work out how and what you use display the data and from > there use that to influence how you export it out from Nifi. > > Edward > > On Mon, 12 Aug 2019, 22:54 Peter Piehler, <[email protected]> wrote: > >> Hello, >> >> does anyone have a tip for me on how I can provide metrics about data >> processed in nifi in a web UI? >> >> I process XML files with nifi. for each file I calculate how many new, >> modified, unmodified, and deleted records are contained. for each record >> checks are still made. For example, whether values are in the value range. >> I would like to create an evaluation which shows me how the data >> properties are. For example yesterday I had 5 files, one of them with >> 1000 deletions, but the average is only 10 deleted records per file, on >> average we process 500 files per day. >> >> I'm currently looking for ideas on how to do this. I think it would be >> useful to export this data and then evaluate it in an external >> application. I am grateful for every hint. >> >> Thx, >> Peter >> >>
