Re: Nifi config issues

2018-10-03 Thread Andy LoPresto
Ryan, As Joe mentioned, we’ll need to see the full stacktrace, but the problem is likely at the bottom of that error output. The Flow Controller is a critical piece of NiFi’s architecture, and errors with loading it are usually because of a missing or misconfigured value. I’m guessing that

XKCD use case for NiFi

2018-10-03 Thread Joe Gresock
https://xkcd.com/2054/ He needs NiFi!

Re: RPG question

2018-10-03 Thread Bryan Bende
Have you tried with smaller batch settings? I think 2000 flow files and 1000MB would be a bit high. Might try something like 100 flow files and 10MB. Also, if you concurrent tasks set to 7 on the RPG side, then you will likely want to increase the concurrent tasks on Input Port on cluster 2

Re: XKCD use case for NiFi

2018-10-03 Thread Joe Witt
nice find. In many ways this other one is a great inspiration for NiFi as well https://xkcd.com/927/ On Wed, Oct 3, 2018 at 2:08 PM Joe Gresock wrote: > > https://xkcd.com/2054/ > > He needs NiFi!

Re: Nifi config issues

2018-10-03 Thread Joe Witt
ryan we'll likely need to see the full stack trace and a good bit more context on the configuration. nifi on rel7 is an extremely common deployment scenario so that part is good/easy and now it is likely a matter of config. Thanks On Wed, Oct 3, 2018 at 12:18 PM McGary, Ryan - US wrote: > >

[DISCUSS] Closing in on a release of NiFi 1.8.0?

2018-10-03 Thread Jeff
It looks like we're getting close to a point where we could release NiFi 1.8.0The release tracking page for version 1.8.0 [1] shows 3 "in progress" and 9 "to do" issues. In addition to what has been tagged with a fix version of 1.8.0, it looks like NIFI-5516 and NIFI-5585 are close to completion.

Re: [DISCUSS] Closing in on a release of NiFi 1.8.0?

2018-10-03 Thread Joe Witt
Jeff - thanks again for volunteering. I just went through the open items tagged to 1.8.0 to try and shake some loose, close down ones that appear to be done but forgotten, and initiate resolution on one that is in a dangling state. Another very nice release shaping up here. All the work around

Nifi config issues

2018-10-03 Thread McGary, Ryan - US
Hello, My company is in the process of standing up a Test environment, and we're installing Nifi on one of our Rhel7 servers. We are running into some issues, however. When Nifi is configured for http, it runs just fine, but as soon as we change the config to https it starts

Is it possible to count records in a MongoDb collection using the GetMongo processor?

2018-10-03 Thread Byers, Steven K (Steve) CTR USARMY MEDCOM JMLFDC (US)
Hi everyone, Is there a way to use the GetMongo processor to count the number of records in a collection that has a certain value for a field in the collection? For example, how would I count the number of documents in the Names collection where firstName = Steve? Thank you, Steven K. Byers

RE: [EXT] XKCD use case for NiFi

2018-10-03 Thread Peter Wicks (pwicks)
I don't think NiFi will run on his phone, MiNiFi maybe? -Original Message- From: Joe Gresock [mailto:jgres...@gmail.com] Sent: Wednesday, October 3, 2018 12:08 PM To: dev@nifi.apache.org Subject: [EXT] XKCD use case for NiFi https://xkcd.com/2054/ He needs NiFi!

RE: Zookeeper - help!

2018-10-03 Thread Phil H
Okay, I have got this working now, albeit with only a single ZK instance (at this stage). The missing piece of the puzzle that wasn’t in the guides from Pierre was that cluster servers’ certificates need to be installed in each server’s keystore, and all the cluster server DNs need to be

Re: RPG question

2018-10-03 Thread roozbeh karimi
We will try your recommendations. thanks RK On Wed, Oct 3, 2018 at 10:47 AM Bryan Bende wrote: > Have you tried with smaller batch settings? > > I think 2000 flow files and 1000MB would be a bit high. Might try > something like 100 flow files and 10MB. > > Also, if you concurrent tasks set to

Re: [DISCUSS] Closing in on a release of NiFi 1.8.0?

2018-10-03 Thread Joe Witt
Mike, Processors in particularly are among the toughest at this point. We have very very little headroom on dependency size for the full build size that we upload to ASF infra and mirrors. That and the license review work involved in each... We should really create a way to publish processors

Re: [DISCUSS] Closing in on a release of NiFi 1.8.0?

2018-10-03 Thread Andy LoPresto
I am currently working on a TLS Toolkit refactor (NIFI-5462 & NIFI-5485) and HashAttribute updates (NIFI-5582). I believe there are a couple upgrade PRs open, and I would really like to see NIFI-5402 (no .tar.gz in the build) tackled for this release as well. Andy LoPresto