Flow file failover using a cluster.

Dev, I know you are working on a solution to this but in the mean time I wanted to ask about how best to implement HA for flow files across a cluster. One option I saw was to use an NFS mount and if a node should fail start up another node and point it to the failed nodes repo. I also saw

Re: How to count the number of occurrences of a certain string in file

Hi Mark, I am confused about the whole process. I have the following questions: 1. From what I read, I can use TailFile to read the log file. However, it would only read the file once (as the input file does not change). Is there a way that I can read the file every time it gets started? 2. As

Re: Custom properties file for environmental promotion

Excellent info, as always Bryan. Very much appreciated! -- Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/

Re: Custom properties file for environmental promotion

Currently, there is the variable properties file which would require a service restart and also would need to be on all nodes in a cluster. The last release (1.4.0) added a more user-friendly variable registry in the UI which you can access from the context palette for a given process group, near

Re: Custom properties file for environmental promotion

Great info Bryan- thanks! Regarding my first question, I talked to our admins and we only have one NIC anyway. So there is no need for me to limit it, and thus I don't have a need to use EL to discover the NIC. So that's good. Regarding the registry stuff, I found this [1] document which looks

Re: Use putdatabaserecord to update or insert data from oracle source database to vertica target db

Ashwin, I recommend PutDatabaseRecord for batch updates/inserts inside NiFi (i.e. if you don't have a bulk loader program available). If you use something like QueryDatabaseTable, GenerateTableFetch, and/or ExecuteSQL to get your data from the source table, it will be in Avro format (with

Re: Custom properties file for environmental promotion

Hello, Regarding Remote Process Groups, this is definitely something that needs to be improved. There is a JIRA to make the URL editable [1]. A significant amount of work has been done on the flow registry [2], and this will become the primary way to deploy flows across environments. The

Use putdatabaserecord to update or insert data from oracle source database to vertica target db

Hi , Can someone let me know which processor to use to do update or insert data from oracle source table to vertica target table in batch mode? Thanks Ashwin -- Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/