Re: new Nifi Processors

2017-02-28 Thread Andre
All, It may also be worth to note that JFrazee maintains a list of NiFi related links here: https://github.com/jfrazee/awesome-nifi On Wed, Mar 1, 2017 at 1:56 PM, Matt Burgess wrote: > Uwe G has made his processors available (thank you!) via his own repo > vs the

Re: new Nifi Processors

2017-02-28 Thread Matt Burgess
Uwe G has made his processors available (thank you!) via his own repo vs the official Apache NiFi repo; this may be directly related to your point about licensing. Having said that, he is of course at liberty to license those separate processors as he sees fit (assuming it is also in accordance

Re: new Nifi Processors

2017-02-28 Thread Angry Duck Studio
Hi, Uwe, These look useful. However, typically custom processors are either Apache 2.0 or MIT licensed. These don't seem to specify a license, but your business rule engine (jare) seems to be GPL 3.0 licensed. I'm not sure that fits with most uses of NiFi. Can you please clarify? Thanks -Matt

Re: send http request to nifi input port

2017-02-28 Thread mohammed shambakey
Thanks Andy. I think I should go for Jetty servlet as suggested in Koji's JIRA request " https://issues.apache.org/jira/browse/NIFI-3469; Regards On Tue, Feb 28, 2017 at 12:09 PM, Andy LoPresto wrote: > Mohammed, > > NiFi Input Ports are definitely not the answer you are

Re: send http request to nifi input port

2017-02-28 Thread Andy LoPresto
Mohammed, NiFi Input Ports are definitely not the answer you are looking for here. As stated, they are specifically for NiFi to NiFi communication using Site to Site protocol, either over raw sockets or HTTPS. They do not accept arbitrary HTTP requests from other entities. Andy LoPresto

Re: send http request to nifi input port

2017-02-28 Thread mohammed shambakey
Thanks Koji On Tue, Feb 28, 2017 at 8:44 AM, Koji Kawamura wrote: > Mohammed, > > NiFi REST API is for managing NiFi itself and data flow running on it, > as Andy described earlier, it's not for data transfer. It does have > endpoints to receive POST requests but those

Re: How to gracefully handle a circular graph?

2017-02-28 Thread Scott Wagner
Bryan, This is a one-time batch job where I will be downloading a few million records, each of which has a range, and then pushing those through this process. I hadn't thought of putting the ControlRate in front of the top-right corner. I'm sure that would have worked, but it's just

Re: How to gracefully handle a circular graph?

2017-02-28 Thread Scott Wagner
Matt, Thanks for the suggestion. I did end up creating a ExecuteScript processor that expanded out the range of the numbers into the content, and it is working for this scenario. Thanks again! - Scott Matt Foley Monday, February 27, 2017 5:21 PM If I

Re: How to gracefully handle a circular graph?

2017-02-28 Thread Bryan Bende
Scott, Do you have a constant flow of data from your database, or is this more like a large batch comes in and processes in NiFi for a while and then you some time later you pull another batch? If it is more like the batch scenario, you might be able to stick a ControlRate processor before your

Re: How do I atomically increment a variable in NiFi ?

2017-02-28 Thread Bryan Bende
Marcio, There is a new controller service that is in the master branch, but hasn't been released yet, AtomicDistributedMapCacheClient [1]. You could probably use this to implement a new processor that provides the ability to generate a global sequence with concurrent access. It is basically an

Re: send http request to nifi input port

2017-02-28 Thread Koji Kawamura
Mohammed, NiFi REST API is for managing NiFi itself and data flow running on it, as Andy described earlier, it's not for data transfer. It does have endpoints to receive POST requests but those are for adding Processors or Templates ... etc. Please refer NiFi REST API docs for details.

Re: send http request to nifi input port

2017-02-28 Thread mohammed shambakey
Thank you all for your help I think Koji's thread at JIRA will be the best solution when it is implemented Just a quick question, Andy mentioned REST APIs for NIFI. I didn't find much examples about using NIFI REST APIs. Is it possible to POST the WEB UI (including all inputs from multipart form