Re: [DISCUSS] Scale-out/Object Storage - taming the diversity of processors

2017-02-21 Thread Andrew Grande
I am observing one assumption in this thread. For some reason we are implying all these will be hadoop compatible file systems. They don't always have an HDFS plugin, nor should they as a mandatory requirement. Untie completely from the Hadoop nar. This allows for effective minifi interaction

Re: nar deployment

2017-02-21 Thread Joe Witt
I'd be interested to see the full nifi-app.log of startup. There should be at least something in there about this processor. Thanks Joe On Tue, Feb 21, 2017 at 7:19 PM, Andy LoPresto wrote: > Arthur, > > Sorry to hear this isn’t working for you. You are following the best

Re: nar deployment

2017-02-21 Thread Andy LoPresto
Arthur, Sorry to hear this isn’t working for you. You are following the best practices for custom NAR deployment; it should be as easy as copying the nar file into the lib/ directory and restarting NiFi. Can you post the code (I understand if you can’t share the Java code, but at least the

Re: [ANNOUNCE] New Apache NiFi Committer Jeff Storck

2017-02-21 Thread Jeremy Dyer
Congratulations Jeff! Good to have you aboard! On Tue, Feb 21, 2017 at 2:41 PM, Aldrin Piri wrote: > On behalf of the Apache NiFI PMC, I am very pleased to announce that Jeff > Storck has accepted the PMC's invitation to become a committer on the > Apache NiFi project. We

[ANNOUNCE] New Apache NiFi Committer Jeff Storck

2017-02-21 Thread Aldrin Piri
On behalf of the Apache NiFI PMC, I am very pleased to announce that Jeff Storck has accepted the PMC's invitation to become a committer on the Apache NiFi project. We greatly appreciate all of Jeff's hard work and generous contributions and look forward to continued involvement in the project.

Re: [ANNOUNCE] New Apache NiFi Committer Jeff Storck

2017-02-21 Thread Rob Moran
Thanks and congrats, Jeff! Rob On Tue, Feb 21, 2017 at 3:01 PM, Pierre Villard wrote: > Congrats ! > > 2017-02-21 20:58 GMT+01:00 Joe Witt : > > > Congrats Jeff! > > > > On Tue, Feb 21, 2017 at 2:43 PM, Jeremy Dyer wrote: > >

Re: [ANNOUNCE] New Apache NiFi Committer Jeff Storck

2017-02-21 Thread Matt Burgess
Congrats Jeff, well deserved. Welcome aboard! On Tue, Feb 21, 2017 at 3:05 PM, Rob Moran wrote: > Thanks and congrats, Jeff! > > Rob > > On Tue, Feb 21, 2017 at 3:01 PM, Pierre Villard > wrote: > >> Congrats ! >> >> 2017-02-21 20:58 GMT+01:00 Joe

Re: [ANNOUNCE] New Apache NiFi Committer Jeff Storck

2017-02-21 Thread James Wing
Congratulations, Jeff! On Tue, Feb 21, 2017 at 11:41 AM, Aldrin Piri wrote: > On behalf of the Apache NiFI PMC, I am very pleased to announce that Jeff > Storck has accepted the PMC's invitation to become a committer on the > Apache NiFi project. We greatly appreciate all of

Re: [ANNOUNCE] New Apache NiFi Committer Jeff Storck

2017-02-21 Thread Bryan Bende
Congrats Jeff! On Tue, Feb 21, 2017 at 3:18 PM, James Wing wrote: > Congratulations, Jeff! > > On Tue, Feb 21, 2017 at 11:41 AM, Aldrin Piri wrote: > >> On behalf of the Apache NiFI PMC, I am very pleased to announce that Jeff >> Storck has accepted the

Re: [ANNOUNCE] New Apache NiFi Committer Jeff Storck

2017-02-21 Thread Yolanda Davis
Congratulations Jeff! On Tue, Feb 21, 2017 at 2:41 PM, Aldrin Piri wrote: > On behalf of the Apache NiFI PMC, I am very pleased to announce that Jeff > Storck has accepted the PMC's invitation to become a committer on the > Apache NiFi project. We greatly appreciate all of

Re: [DISCUSS] Scale-out/Object Storage - taming the diversity of processors

2017-02-21 Thread Andrew Grande
Andre, I came across multiple NiFi use cases where going through the HDFS layer and the fs plugin may not be possible. I.e. when no HDFS layer present at all, so no NN to connect to. Another important aspect is operations. Current PutHDFS model with additional jar location, well, it kinda works,

nar deployment

2017-02-21 Thread Bleeker, Arthur H
Hi, About six months ago I created custom processors for NiFi. Recently I needed to dust off the code and make some changes. I pushed the updated nar to my local development nifi instance and... nothing. The changes didn't get picked up. So I deleted the nar, restarted nifi, copied the new nar

Re: [DISCUSS] Scale-out/Object Storage - taming the diversity of processors

2017-02-21 Thread Andre
Andrew, Thank you for contributing. On 22 Feb 2017 10:21 AM, "Andrew Grande" wrote: Andre, I came across multiple NiFi use cases where going through the HDFS layer and the fs plugin may not be possible. I.e. when no HDFS layer present at all, so no NN to connect to. Not

Re: [ANNOUNCE] New Apache NiFi Committer Jeff Storck

2017-02-21 Thread Scott Aslan
Congrats Jeff! Well deserved! On Tue, Feb 21, 2017 at 6:36 PM, Koji Kawamura wrote: > Congratulations Jeff! > > On Wed, Feb 22, 2017 at 7:52 AM, Andre wrote: > > Welcome aboard Jeff! Well deserved > > > > On Wed, Feb 22, 2017 at 6:41 AM, Aldrin

Email processor test failure

2017-02-21 Thread Chris Herrera
Hi All, Apologies for apparently going braindead…I’m sure I’m doing something silly…. I am in the process of starting to work on some custom processors and controller services, and I am running into an issue with a few tests in the email processor. Specifically 

Re: Email processor test failure

2017-02-21 Thread Joe Witt
Chris, Can you look for additional information in the test logsi've not seen this behavior before on these processors. That they're all failing at around 15/16 seconds is interesting too as this is not a typical timeout value. That said each does is setting a 10 second timeout. Anyway,

Re: Email processor test failure

2017-02-21 Thread Aldrin Piri
Could you additionally specify your environment? mvn -version should be sufficient. I feel like we have seen this intermittently on Windows with certain JDK updates. On Tue, Feb 21, 2017 at 2:06 PM, Joe Witt wrote: > Chris, > > Can you look for additional information in

Re: Email processor test failure

2017-02-21 Thread Oleg Zhurakousky
Chris ListenSMTP is essentially an email server. This processor essentially allows you to send emails to it. So by running it you are starting a simple email server. That said something is obviously not going well on your end. Any firewalls or other specific networking setup that you have

Re: [ANNOUNCE] New Apache NiFi Committer Jeff Storck

2017-02-21 Thread Michael Moser
Congrats Jeff! On Tue, Feb 21, 2017 at 4:25 PM, Joe Skora wrote: > Congrats and welcome aboard Jeff! > > On Tue, Feb 21, 2017 at 4:01 PM, Tony Kurc wrote: > > > Nice work Jeff! > > > > On Tue, Feb 21, 2017 at 2:41 PM, Aldrin Piri wrote:

Re: [ANNOUNCE] New Apache NiFi Committer Jeff Storck

2017-02-21 Thread Joe Skora
Congrats and welcome aboard Jeff! On Tue, Feb 21, 2017 at 4:01 PM, Tony Kurc wrote: > Nice work Jeff! > > On Tue, Feb 21, 2017 at 2:41 PM, Aldrin Piri wrote: > > > On behalf of the Apache NiFI PMC, I am very pleased to announce that Jeff > > Storck has

Re: [ANNOUNCE] New Apache NiFi Committer Jeff Storck

2017-02-21 Thread Bryan Rosander
Congrats! On Tue, Feb 21, 2017 at 3:47 PM, Joe Percivall wrote: > Congrats Jeff! > > On Tue, Feb 21, 2017 at 3:33 PM, Yolanda Davis > wrote: > > > Congratulations Jeff! > > > > On Tue, Feb 21, 2017 at 2:41 PM, Aldrin Piri

Re: [ANNOUNCE] New Apache NiFi Committer Jeff Storck

2017-02-21 Thread Joe Percivall
Congrats Jeff! On Tue, Feb 21, 2017 at 3:33 PM, Yolanda Davis wrote: > Congratulations Jeff! > > On Tue, Feb 21, 2017 at 2:41 PM, Aldrin Piri wrote: > > > On behalf of the Apache NiFI PMC, I am very pleased to announce that Jeff > > Storck has

Re: [ANNOUNCE] New Apache NiFi Committer Jeff Storck

2017-02-21 Thread Tony Kurc
Nice work Jeff! On Tue, Feb 21, 2017 at 2:41 PM, Aldrin Piri wrote: > On behalf of the Apache NiFI PMC, I am very pleased to announce that Jeff > Storck has accepted the PMC's invitation to become a committer on the > Apache NiFi project. We greatly appreciate all of Jeff's

Re: [ANNOUNCE] New Apache NiFi Committer Jeff Storck

2017-02-21 Thread Andy LoPresto
Congratulations Jeff. Well deserved. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Feb 21, 2017, at 11:58 AM, Joe Witt wrote: > > Congrats Jeff! > > On Tue, Feb 21, 2017 at 2:43 PM,

Re: [ANNOUNCE] New Apache NiFi Committer Jeff Storck

2017-02-21 Thread Joe Witt
Congrats Jeff! On Tue, Feb 21, 2017 at 2:43 PM, Jeremy Dyer wrote: > Congratulations Jeff! Good to have you aboard! > > On Tue, Feb 21, 2017 at 2:41 PM, Aldrin Piri wrote: > >> On behalf of the Apache NiFI PMC, I am very pleased to announce that Jeff >>

Re: [ANNOUNCE] New Apache NiFi Committer Jeff Storck

2017-02-21 Thread Pierre Villard
Congrats ! 2017-02-21 20:58 GMT+01:00 Joe Witt : > Congrats Jeff! > > On Tue, Feb 21, 2017 at 2:43 PM, Jeremy Dyer wrote: > > Congratulations Jeff! Good to have you aboard! > > > > On Tue, Feb 21, 2017 at 2:41 PM, Aldrin Piri wrote: > >

Re: Email processor test failure

2017-02-21 Thread Chris Herrera
Thanks All! Here is some additional information: Interestingly enough it seems in the surefire report that the SMTP server is starting on a different port than the test is trying to connect to, unless I’m reading it wrong. Nothing else strange on the networking side, verified my hosts file is

Scale-out/Object Storage - taming the deviersity of processors

2017-02-21 Thread Andre
dev, I was having a chat with Pierre around PR#379 and we thought it would be worth sharing this with the wider group: I recently noticed that we merged a number of PRs and merges around scale-out/cloud based object store into the master. Would it make sense to start considering adopting a

[DISCUSS] Scale-out/Object Storage - taming the diversity of processors

2017-02-21 Thread Andre
dev, I was having a chat with Pierre around PR#379 and we thought it would be worth sharing this with the wider group: I recently noticed that we merged a number of PRs and merges around scale-out/cloud based object store into the master. Would it make sense to start considering adopting a

Re: [ANNOUNCE] New Apache NiFi Committer Jeff Storck

2017-02-21 Thread Koji Kawamura
Congratulations Jeff! On Wed, Feb 22, 2017 at 7:52 AM, Andre wrote: > Welcome aboard Jeff! Well deserved > > On Wed, Feb 22, 2017 at 6:41 AM, Aldrin Piri wrote: > >> On behalf of the Apache NiFI PMC, I am very pleased to announce that Jeff >> Storck has

Re: [DISCUSS] Scale-out/Object Storage - taming the diversity of processors

2017-02-21 Thread Matt Burgess
I agree with Andrew in the operations sense, and would like to add that the user experience around dynamic properties (and even "conditional" properties that are not dynamic but can be exposed when other properties are "Applied") can be less-than-ideal and IMHO should be used sparingly. Full