Re: Regarding Nifi packaging and deployment

2015-12-11 Thread Matthew Clarke
The NiFi Expression language (EL) can also use system user environment variables as well as NiFI JVM properties as input. So you could create templates that have EL statements that reference these environment variables which would allow each system running the same dataflow to pull in different

Re: Facing Issue while connecting with HDFS

2015-12-11 Thread Bryan Bende
Digvijay, Are you talking about Kerberos authentication to the HDFS cluster? If so, in nifi.properties you specify your krb5.conf file: nifi.kerberos.krb5.file=/etc/krb5.conf (or wherever your conf file is) This is the file that would have your realms defined. Then on the HDFS processors

Re: Questions about the ordering of the FlowFile.

2015-12-11 Thread Brandon DeVries
Paresh, You might want to look at the PriorityAttributePrioritizer[1]: *PriorityAttributePrioritizer*: Given two FlowFiles that both have a "priority" attribute, the one that has the highest priority value will be prprocessed first. Note that an UpdateAttribute processor should be used to

Re: [VOTE] Release Apache NiFi 0.4.0 (rc2)

2015-12-11 Thread Matt Gilman
+1 (binding) On Wed, Dec 9, 2015 at 7:45 PM, Chris Lim wrote: > +1 (non binding) > > On Thursday, 10 December 2015, Ryan Blue wrote: > > > +1 (non-binding) > > > > Checked source artifact, spot-checked some license docs on new modules > > > > rb

Re: [VOTE] Release Apache NiFi 0.4.0 (rc2)

2015-12-11 Thread Sean Busbey
On Fri, Dec 11, 2015 at 8:06 AM, Sean Busbey wrote: > +1 (binding) > > * verified signatures / checksums > * source and binary artifacts passed check from RAT. > * verified source artifact against tag > * verified bin artifacts match each other and one generated from source

Re: [VOTE] Release Apache NiFi 0.4.0 (rc2)

2015-12-11 Thread Sean Busbey
+1 (binding) * verified signatures / checksums * source and binary artifacts passed check from RAT. * verified source artifact against tag * verified bin artifacts match each other and one generated from source artifact * spot checked licenses * build passes * bin artifact runs simple flow Ran

[RESULT][VOTE] Release Apache NiFi 0.4.0

2015-12-11 Thread Joe Witt
Hello Apache NiFi Community, The release of Apache NiFi 0.4.0 passes with 6 +1 (binding) votes 6 +1 (non-binding) votes 0 -1 votes. This release is the result of a tremendous level of contribution from many people. Thanks to all who made this release possible. Here is the PMC vote thread:

XML Questions

2015-12-11 Thread DAVID SMITH
Hi I have two questions which I think may require bespoke processors. 1)  I have extracted a set of  values from xml tags and made them into flowfile attributes, how a can I add these flowfile attributes to one or more flowfiles? 2)  I have multiple xml files which I need to merge into one xml

Re: [VOTE] Release Apache NiFi 0.4.0 (rc2)

2015-12-11 Thread Joe Witt
+1 (binding) Will send the vote result momentarily. Thanks Joe On Fri, Dec 11, 2015 at 12:02 PM, Joe Skora wrote: > +1 (non-binding) > > Signatures and checksums good. > Builds and tests without problems. > Contrib check passes. > > On Tue, Dec 8, 2015 at 3:29 PM, Joe Witt

Moving BinFiles

2015-12-11 Thread Joe Gresock
In NIFI-305, we refactored a parent class for MergeContent so the binning functionality could be reused. In practice, this isn't quite useful yet, because BinFiles is still in the nifi-standard-processors, which contains an org.apache.nifi.processor.Processor file. Therefore, any processor that

Re: Force Processor to stop

2015-12-11 Thread Joe Witt
Ian, There is no forced stop/interrupt mechanism. This is being addressed in NIFI-1183 and NIFI-78. Ultimately there are some cases where we simply cannot force java to give us back our thread. However, we should certainly be able to quarantine the thread itself and move on to doing other