Re: Opinion wanted: Cyber orchestration "distro"

2018-03-06 Thread Mike Thomsen
I'm also free to review the bundle if you need help. I also don't mind helping with the grunt work of reshaping it into a bundle that can be used with NiFi proper instead of as a special distro. On Tue, Mar 6, 2018 at 12:17 PM, Joe Witt wrote: > Andre, > > You're definitely

Need opinion, NIFI for real time stream processing??

2018-03-06 Thread Bobby
Good day, I would like to know the possibilities of NIFI in real time processing; I'm thinking of a simple application of messaging, 1. A processor will accept messages and do a simple mapping of its attributes to database, i.e. if message_body.startsWith("123") then get data from table with

Re: Need opinion, NIFI for real time stream processing??

2018-03-06 Thread Joe Witt
Bobby What you describe is a well supported and strong use case for Apache NiFi. 1) You'll want to look into and experiment with the record oriented processors. Specifically there is a LookupRecord processor that would probably work well for you. With it you can plugin a lookup service and if

Re: Opinion wanted: Cyber orchestration "distro"

2018-03-06 Thread Andy LoPresto
Andre, I’m happy to contribute and review code for this distro. I think it’s a great idea, and hopefully will be bolstered by the Registry effort where we can make pre-selected NAR groups for different focuses (cybersecurity, IIoT, ML, etc.). Andy LoPresto alopre...@apache.org

Re: Opinion wanted: Cyber orchestration "distro"

2018-03-06 Thread Joe Witt
Andre, You're definitely free to do such a thing - it basically sounds like a 'cyber security focused nifi powered distro' which means largely an assembly that pulls in cybersecurity specific/relevant extensions and the base framework. You just cannot call that thing 'Apache NiFi/NiFi', need to

Re: Hive backward compatibily

2018-03-06 Thread Milan Das
Daniel, This helps. I am to compile with CDH libraries. Thanks a lot. ~ Milan On 3/6/18, 4:08 AM, "Daniel Chaffelson" wrote: Hi Milan, Apologies for a link as an answer, but I'm currently traveling and responding from mobile. I worked through a

Opinion wanted: Cyber orchestration "distro"

2018-03-06 Thread Andre
Folks, I have been privately working on a number of "processors" focused on orchestration of cyber security related activities (eg update firewall rules with data provided via an HTTP endpoint) etc. While some of these tasks can be easily solved with generic NiFi components or with little (or

Re: Kubernetes

2018-03-06 Thread mcgilly17
Hi @Robert - How did you get on with the Kubernetes deployment? -- Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/

Re: Kubernetes

2018-03-06 Thread Robert R. Bruno
Things went really well. I have a good first stab at a helm chart. I have high hopes of open sourcing my work sooner than later. I'll be sure to say something on here when I do. Robert On Tue, Mar 6, 2018, 07:05 mcgilly17 wrote: > Hi @Robert - How did you get on with the

Re: Hive backward compatibily

2018-03-06 Thread Daniel Chaffelson
Hi Milan, Apologies for a link as an answer, but I'm currently traveling and responding from mobile. I worked through a similar problem in NiFi-1.1 and shared details of my method which hopefully should help you.