Re: NiFi - Flow Backup Strategy

Tom, I suspect some others might add some additional info here but to achieve the back-up of the configuration such that you could quickly restore you'd generally just need to save the conf directory content. The flow configuration should port well to another node including the sensitive property

NiFi - Flow Backup Strategy

I am curious as to what others are using to automate backups of the NiFi flow? Specifically,I am looking for steps on what file(s) to copy out of the NiFi cluster such that I can rebuild/restore if necessary. In NiFi 0.61 (cluster), I set this:nifi.properties:nifi.flow.configuration.archive.dir=

Re: How to control NiFi logging

No wonder it looked like log4j! That's some pretty slick stuff, right there! On Jun 6 2016, at 8:06 am, Andrew Psaltis wrote: > Hi Pat, > > It is all standard logback, described here:

Re: Processor Question

Hi Joe and others, I see a high-level problem with searchable documentation for Processors in two areas. 1. The current new-processor-dialog shown during Add Processor has a search (filter) capability, but it only searches through the Tags and Type, not Property Names, PropertyDescriptor, or eve

Re: How to use GetMongo Projection

Hello Stephane, Sorry no one has responded to this yet. To get a project you can construct the BSON similar to how is done on this MongoDB page[1]. For example to retrieve only field_1 and field_2 you would use this as the value of the "projection" property "{ "field_1" : "1", "field_2" : "1"}

Re: Best way to process the process the requests in batch

Kumiko, In terms of increasing throughput from the standpoint of the NiFi framework, it is possible to increase the number of concurrent tasks on the processor under the Scheduling tab when configuring. This will allow more processes to execute simultaneously providing greater throughput. Along

Re: Processor Question

For number one, you can also use RouteText[1] with the matching strategy "Satisfies Expression". Then as a dynamic property use this expression "${lineNo:le(10)}". This will route first 10 lines to the "matched" relationship (assuming "Route to each matching Property Name" is not selected). Thi

Re: Site to Site UnknownHostException

Hi Joe, Are you able to reach the specified instance, gbrdcr00015n01, from the machine where you are accessing this log via ping or similar? On Tue, May 31, 2016 at 9:06 AM, wrote: > Hi > > > > I’m new to Nifi. I have been experimenting with it and trying implement > Site to Site connections be

Re: Install directory

Hello While i am not aware of any strong reason to keep it the way it is there are no plans to change it at this time. Some project do this and some don't. Thanks Joe On Jun 6, 2016 10:13 AM, "ski n" wrote: > Yes, I already have a soft link, but this was more a remark that the > directory stru

Re: Install directory

Yes, I already have a soft link, but this was more a remark that the directory structure is not in line with the Apache convention. 2016-06-06 13:12 GMT+02:00 Pat Trainor : > Why not use softlinks? > > ln -s > > ...as in: > > pat@wopr:~$ l /opt > total 76 > [...] > lrwxrwxrwx 1 pat pat 10

Re: How to control NiFi logging

Hi Pat, It is all standard logback, described here: http://logback.qos.ch/ On Mon, Jun 6, 2016 at 12:18 PM, Pat Trainor wrote: > Andrew, > Is any of this not standard log4j, and nifi-specific? > On Jun 6, 2016 2:34 AM, "Andrew Psaltis" wrote: > >> You are correct, sorry about that Stephane! >>

Re: Nifi & Parsey McParseface! RegEx in a Processor...

Hi, I’m not a NiFi expert by any stretch of the imagination and there others on this list far better informed than me that can speak with authority on many of the questions you raise, but I’ll have a go… It is probably not necessary to create a custom processor to do the parsing (using PMPF) –

Re: Install directory

Why not use softlinks? ln -s ...as in: pat@wopr:~$ l /opt total 76 [...] **lrwxrwxrwx 1 pat pat 10 May 30 18:08 nifi -> nifi-0.6.1 **drwxrwxr-x 20 pat pat 4096 Jun 5 21:22 nifi-0.6.1 [...] Thanks! [pat](http://about.me/Pat

Re: Nifi & Parsey McParseface! RegEx in a Processor...

Conrad, Thanks for writing! You do get the gist of it. Last night I realized how easy it is to make a custom processor. I was a little confused at first why I needed to pass on a new Flowfile in my simple onTrigger function, but the error in the Nifi GUI about versions/timestamp made it obvious. I

Re: How to control NiFi logging

Andrew, Is any of this not standard log4j, and nifi-specific? On Jun 6, 2016 2:34 AM, "Andrew Psaltis" wrote: > You are correct, sorry about that Stephane! > > On Mon, Jun 6, 2016 at 8:23 AM, Stéphane Maarek > wrote: > >> Actually, it seems I only needed to change one line (versus two) >> >>

Re: Release Dates

Hi, regarding JIRA, there are currently issues with apache servers. This should be fixed very soon. 2016-06-06 9:52 GMT+02:00 ski n : > Today I was checking the release notes at: > > https://cwiki.apache.org/confluence/display/NIFI/Release+Notes > > Could the release date be added at the top of

Install directory

NiFi is unpacked/installed by default in the directory: nifi-0.6.1 My other Apache installations all are grouped together by the Apache "apache-" prefix. For example: apache-tomcat-7.0.69 Will this change in future releases (now NiFi is still before the 1.0 release)

Release Dates

Today I was checking the release notes at: https://cwiki.apache.org/confluence/display/NIFI/Release+Notes Could the release date be added at the top of every new release version? Its easier for users to track how often the project is releasing and how long ago the latest version was released. Wh

Re: Nifi & Parsey McParseface! RegEx in a Processor...

Hi, This may be a long shot as I don’t know how many combinations of the column lengths with | and + there are, but you could try using ReplaceTextWithMapping processor where you have all combinations of +--| etc. in a text file with what they represent in term of counts e.g +-- [0] |