Re: Re:[EXT] [DISCUSS] Predictive Analytics for NiFi Metrics

2019-08-20 Thread Andy Christianson
t; > > > > > > The images from the preview email do not appear to be displaying. They > > > > can > > > > be viewed at: > > > > https://github.com/jmark99/nifi-images > > > > From: Owens, Mark jmow...@evoforge.org > > > &g

Re: Re:[EXT] [DISCUSS] Predictive Analytics for NiFi Metrics

2019-08-20 Thread Robert Fellows
to be displaying. They > > can > > > be viewed at: > > > https://github.com/jmark99/nifi-images > > > > > > From: Owens, Mark > > > Sent: Monday, August 19, 2019 2:25 PM > > > To: dev@nifi.apache.org > > > Subject: RE: Re:[EXT] [D

Re: Re:[EXT] [DISCUSS] Predictive Analytics for NiFi Metrics

2019-08-19 Thread Yolanda Davis
d at > > https://github.com/jmark99/nifi/tree/time-to-overflow > > > > > > > > I welcome your (or any others) feedback on this effort. > > > > > > > > Thanks, > > Mark > > > > > > > > P.S. If the images are not displ

Re: Re:[EXT] [DISCUSS] Predictive Analytics for NiFi Metrics

2019-08-19 Thread Robert Fellows
> > From: Owens, Mark > Sent: Monday, August 19, 2019 2:25 PM > To: dev@nifi.apache.org > Subject: RE: Re:[EXT] [DISCUSS] Predictive Analytics for NiFi Metrics > > > Hi Yolanda, > > > > I've been working on a feature that appears to possibly overlap with the &

RE: Re:[EXT] [DISCUSS] Predictive Analytics for NiFi Metrics

2019-08-19 Thread Owens, Mark
The images from the preview email do not appear to be displaying. They can be viewed at: https://github.com/jmark99/nifi-images From: Owens, Mark Sent: Monday, August 19, 2019 2:25 PM To: dev@nifi.apache.org Subject: RE: Re:[EXT] [DISCUSS] Predictive Analytics for NiFi Metrics Hi Yolanda

RE: Re:[EXT] [DISCUSS] Predictive Analytics for NiFi Metrics

2019-08-19 Thread Owens, Mark
19, 2019 11:29 AM To: dev@nifi.apache.org Subject: Re:[EXT] [DISCUSS] Predictive Analytics for NiFi Metrics Hello All, I just wanted to follow up on the discussion we started a couple of weeks ago concerning an analytics framework for NiFi metrics. Working with Andy Christianson and Matt

Re:[EXT] [DISCUSS] Predictive Analytics for NiFi Metrics

2019-08-19 Thread Yolanda Davis
Hello All, I just wanted to follow up on the discussion we started a couple of weeks ago concerning an analytics framework for NiFi metrics. Working with Andy Christianson and Matt Burgess we shaped our ideas and drafted a proposal for this feature on the Apache NiFi Wiki [1] . We've also begun

Re: [DISCUSS] Predictive Analytics for NiFi Metrics

2019-07-31 Thread Yolanda Davis
Hi Craig, Thanks for your feedback and insight on your use cases. What version of MiNiFi are you running? Concerning performing edge ML this may be possible for you with MiNiFi C++ version 0.6.0. That release supports the creation of python processors which can be added to your flow to execute

Re: [DISCUSS] Predictive Analytics for NiFi Metrics

2019-07-31 Thread Andy Christianson
As someone who operated a 24/7 mission-critical NiFi flow, this feature would have been a life saver. If I'm heading home on a Friday, it would be great to have some blinking red lights to let me know that the system predicts that it is going to experience backpressure sometime over the

Re: [DISCUSS] Predictive Analytics for NiFi Metrics

2019-07-31 Thread Arpad Boda
If you could share a bit more details about your OPC and Modbus usage, that would be highly appreciated! On Wed, Jul 31, 2019 at 12:01 PM Craig Knell wrote: > Sounds. Great > > Let me know if you need some help > > Best regards > > Craig > > > > > On 31 Jul 2019, at 17:31, Arpad Boda wrote: >

Re: [DISCUSS] Predictive Analytics for NiFi Metrics

2019-07-31 Thread Craig Knell
Sounds. Great Let me know if you need some help Best regards Craig > On 31 Jul 2019, at 17:31, Arpad Boda wrote: > > Craig, > > OPC ( https://issues.apache.org/jira/browse/MINIFICPP-819 ) and Modbus ( > https://issues.apache.org/jira/browse/MINIFICPP-897 ) are on the way for > MiNiFi

Re: [DISCUSS] Predictive Analytics for NiFi Metrics

2019-07-31 Thread Arpad Boda
Craig, OPC ( https://issues.apache.org/jira/browse/MINIFICPP-819 ) and Modbus ( https://issues.apache.org/jira/browse/MINIFICPP-897 ) are on the way for MiNiFi c++, hopefully both will be part of next release (0.7.0). It's gonna be legen... wait for it! :) Regards, Arpad On Wed, Jul 31, 2019 at

Re: [DISCUSS] Predictive Analytics for NiFi Metrics

2019-07-30 Thread Craig Knell
Hi Folks That's our use case now. All our Models are run in python. Currently we send events to the ML via http, although this is not optimal Our use case is edge ML where we want a light weight wrapper for Python code base. Jython however does not work with the code base I'm think of changing

Re: [DISCUSS] Predictive Analytics for NiFi Metrics

2019-07-30 Thread Joe Witt
Definitely something that I think would really help the community. It might make sense to frame/structure these APIs such that an internal option could be available to reduce dependencies and get up and running but that also just as easily a remote implementation where the engine lives and is

Re: [DISCUSS] Predictive Analytics for NiFi Metrics

2019-07-30 Thread Andy LoPresto
Yolanda, I think this sounds like a great idea and will be very useful to admins/users, as well as enabling some interesting next-level functionality and insight generation. Thanks for putting this out there. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com PGP Fingerprint: 70EC

[DISCUSS] Predictive Analytics for NiFi Metrics

2019-07-30 Thread Yolanda Davis
Hello Everyone, I wanted to reach out to the community to discuss potentially enhancing NiFi to include predictive analytics that can help users assess and predict NiFi behavior and performance. Currently NiFi has lots of metrics available for areas including jvm and flow component usage (via