Re: NiPyApi v0.8.0 released

2018-03-07 Thread Boris Tyukin
Hi Dan, great news. I've played with nipyapi and found it really useful and I am glad you use Python - makes things much easier. Now that you support secured NiFi cluster, I will take another look :) please keep up the great work. Boris On Tue, Mar 6, 2018 at 7:05 PM, Daniel Chaffelson wrote:

A combination of ExecuteProcess and ExecuteStream processors?

2018-03-07 Thread Oleksandr Lobunets
Hello everyone, I have a case of running the 3rd party CLI (linux) with the following behaviour: - Should be executed upon a FlowFile with attributes/content containing parameters to CLI - Accepts params via flags or environment variables - Writes output to stdout as a stream of JSON object

Re: A combination of ExecuteProcess and ExecuteStream processors?

2018-03-07 Thread Boris Tyukin
Hi Alexander, I had a similar task, but it my case flowfiles were tiny. It might still work well, because you can stream stdout / sdterr in real-time. Check my blog post. I also wanted to use Jython, but Groovy is a really fun language, that you can grasp basics in hours. It also does not have pe

Re: A combination of ExecuteProcess and ExecuteStream processors?

2018-03-07 Thread Matt Burgess
Alexander, It sounds like you'd like to see the Batch Duration capability from ExecuteProcess added to ExecuteStreamCommand, please feel free to write a Jira case [1] for this improvement. In the meantime, I second Boris's thought on using Groovy to launch your script, it's much more integrated w

Re: A combination of ExecuteProcess and ExecuteStream processors?

2018-03-07 Thread Oleksandr Lobunets
Hi Boris, Matt, Thank you for the prompt answers and suggestions. @Matt, right, this capability would be great to have. I will proceed with submission of the improvement request. @Boris, the blog article is helpful - I’ve run into similar frustration cycles with hanging processor and manual ki

Re: NiFi 1.5 with Knox 1.0.0

2018-03-07 Thread Ryan H
Hi, Yes, some additional documentation would be great for Knox integration. Another question I have based on the two options above: If users will access NiFi via Knox (rather than accessing NiFi directly and then auth to Knox), once a user authenticates to Knox (and subsequently to whatever provi

Re: NiFi 1.5 with Knox 1.0.0

2018-03-07 Thread larry mccay
The effective user will be the enduser authenticated by Knox not the knox user. I actually believe that you have the whole chain of users when proxying - so you won't lose either. On Wed, Mar 7, 2018 at 4:14 PM, Ryan H wrote: > Hi, > > Yes, some additional documentation would be great for Knox i

Reporting Specific Queue Sizes?

2018-03-07 Thread Jon Logan
Hi All, I am trying to get more specific queue sizes in a reporting task for metric reporting, but I can't seem to find out a way to do it -- the only methods exposed seem to be showing the total of all queue sizes. Is there a way that I am missing? I am trying to find a specific queue in front of

Re: Reporting Specific Queue Sizes?

2018-03-07 Thread Pierre Villard
Hi Jon, You could use the S2S Status reporting task and filter the data on Connection and, if need, on a specific connection name. It'll send you JSON data containing the information about the queue (stats, size, backpressure, etc). Pierre 2018-03-08 6:12 GMT+01:00 Jon Logan : > Hi All, > > I a