Re: Update on 0.7.0 RC2

2016-07-07 Thread Oleg Zhurakousky
Just as an FYI, the PRs for NIFI-2160 are merged and the issue is resolved. Hopefully https://issues.apache.org/jira/browse/NIFI-2192 won’t be a pain. Oleg On Jul 7, 2016, at 3:03 PM, Oleg Zhurakousky > wrote: As it appears, the

Re: GetFile Regex issue

2016-07-07 Thread gregw134
Hi Joe, Nevermind, I realized my mistake. The regex is fine. Greg From: "Joe Witt [via Apache NiFi Developer List]" Date: Thursday, July 7, 2016 at 3:51 PM To: default Subject: Re: GetFile Regex issue Greg, [hidden email] is probably better but this is just fine. My regex foo gets weaker by

Re: GetFile Regex issue

2016-07-07 Thread gregw134
Hi Joe, The mailing list you mentioned got filtered out. Can you repeat it without the @? I couldn’t get it to work until I changed the regex to [^\.]*.* I think the issue is [^\.] means any character, except ., exactly once. You can see this on regex101 (dot com). If this is an issue, it

GetFile Regex issue

2016-07-07 Thread gregw134
Hi, The default file filter for GetFile is [^\.].* which only matches filenames one character long. It should probably be changed to something like [^\.]*.* Let me know if this is the wrong forum to post this. Thanks, Greg Womack Solutions Engineer Hortonworks -- View this message in

Re: [ANNOUNCE] New Apache NiFi PMC Member - Andy LoPresto

2016-07-07 Thread Tony Kurc
Glad to have you aboard, Andy! On Thu, Jul 7, 2016 at 12:44 PM, Joe Witt wrote: > On behalf of the Apache NiFI PMC, I am very pleased to announce that > Andy LoPresto has accepted the PMC's invitation to join the Apache > NiFi PMC. We greatly appreciate all of Andy's hard

Issues mailing list now live

2016-07-07 Thread Joe Witt
Team, As you may know there is now an iss...@nifi.apache.org mailing list. It will be used for automated emails from JIRA and Github for new issues, comments, PRs, etc.. so that they are captured and archived. Previously this was sent to the dev mailing list but it became too noisy for those

Re: Github mails

2016-07-07 Thread Joe Witt
no problem at all. the changes should be in effect now. http://mail-archives.apache.org/mod_mbox/nifi-issues/201607.mbox/browser On Tue, Jul 5, 2016 at 2:29 AM, Lars Francke wrote: > Joe, thank you for following up on all of this and the others for chiming > in! > >

Re: [ANNOUNCE] New Apache NiFi PMC Member - Andy LoPresto

2016-07-07 Thread Chris Herrera
Congrats Andy! > On Jul 7, 2016, at 4:22 PM, Joe Skora wrote: > > Congrats! > > On Thu, Jul 7, 2016 at 5:15 PM, Oleg Zhurakousky < > ozhurakou...@hortonworks.com> wrote: > >> Way to go Andy! Well deserved! >> >> Cheers >> Oleg >>> On Jul 7, 2016, at 5:09 PM, Matt Burgess

Re: [ANNOUNCE] New Apache NiFi PMC Member - Andy LoPresto

2016-07-07 Thread Joe Skora
Congrats! On Thu, Jul 7, 2016 at 5:15 PM, Oleg Zhurakousky < ozhurakou...@hortonworks.com> wrote: > Way to go Andy! Well deserved! > > Cheers > Oleg > > On Jul 7, 2016, at 5:09 PM, Matt Burgess wrote: > > > > Congratulations Andy! Well deserved! > > > > > >> On Jul 7, 2016,

Re: [ANNOUNCE] New Apache NiFi PMC Member - Andy LoPresto

2016-07-07 Thread Oleg Zhurakousky
Way to go Andy! Well deserved! Cheers Oleg > On Jul 7, 2016, at 5:09 PM, Matt Burgess wrote: > > Congratulations Andy! Well deserved! > > >> On Jul 7, 2016, at 12:44 PM, Joe Witt wrote: >> >> On behalf of the Apache NiFI PMC, I am very pleased to

Re: QueryDatabaseTable

2016-07-07 Thread Matt Burgess
That sounds like a bug, mind filing a Jira case? Thanks, Matt P.S. Not sure the where filter will work even after the fix but I will take a look. > On Jul 7, 2016, at 3:20 PM, Nabegh wrote: > > I'm trying to load a table from Netezza database using QueryDatabaseTable >

Re: [ANNOUNCE] New Apache NiFi PMC Member - Andy LoPresto

2016-07-07 Thread Matt Burgess
Congratulations Andy! Well deserved! > On Jul 7, 2016, at 12:44 PM, Joe Witt wrote: > > On behalf of the Apache NiFI PMC, I am very pleased to announce that > Andy LoPresto has accepted the PMC's invitation to join the Apache > NiFi PMC. We greatly appreciate all of Andy's

Re: [ANNOUNCE] New Apache NiFi PMC Member - Andy LoPresto

2016-07-07 Thread Pierre Villard
Great Andy ! Well-deserved ! Congrats ! Pierre 2016-07-07 18:47 GMT+02:00 Joe Percivall : > Congratulations Andy! Excited to have you join the PMC. > > > - - - - - - > Joseph Percivall > linkedin.com/in/Percivall > e: joeperciv...@yahoo.com > > > > On Thursday,

Re: QueryDatabaseTable

2016-07-07 Thread Nabegh
This doesn't fail btw (select * from table_name where 1 = 1) t -- View this message in context: http://apache-nifi-developer-list.39713.n7.nabble.com/QueryDatabaseTable-tp12698p12699.html Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.

QueryDatabaseTable

2016-07-07 Thread Nabegh
I'm trying to load a table from Netezza database using QueryDatabaseTable processor. I'm trying to add a where filter so I put the following in the Table Name: (select * from table_name where condition = value) t This is failing with the following error 5136faa70] Failed to process session due

Re: Update on 0.7.0 RC2

2016-07-07 Thread Oleg Zhurakousky
As it appears, the spotlight is on me ;) I’ll merge 2160 once I get to the stopping point with what I am doing now (NIFI-826 . . .really close) and that is when I’ll take care of Kafka as well (had a nice chat with Mark so there is a plan). Cheers Oleg > On Jul 7, 2016, at 2:33 PM, Joe

Re: Update on 0.7.0 RC2

2016-07-07 Thread Joe Percivall
Hello Team, As the theme with 0.7.0 has been, it's one step forward and one step back. There has been some great work and most of the issues previously seen were addressed but another blocker has been found. - "Enabled ControllerServices disabled on restart" NIFI-2160[1] [status] PR have been

Re: [VOTE] Release Apache NiFi MiNiFi 0.0.1 (RC1)

2016-07-07 Thread Joe Percivall
Vote forth-coming but regarding Andy's notes/questions: I agree with using HTTPS links when possible in both files and the couple README.md changes. I don't think there are any plans currently for separate mailing lists/IRC nodes. I am in favor of keeping NiFi and MiNiFi together for now to

Re: [ANNOUNCE] New Apache NiFi PMC Member - Andy LoPresto

2016-07-07 Thread Joe Percivall
Congratulations Andy! Excited to have you join the PMC. - - - - - - Joseph Percivall linkedin.com/in/Percivall e: joeperciv...@yahoo.com On Thursday, July 7, 2016 12:46 PM, Andy LoPresto wrote: Thanks Joe. It is a pleasure to work on the project and an honor to

Re: [ANNOUNCE] New Apache NiFi PMC Member - Andy LoPresto

2016-07-07 Thread Andy LoPresto
Thanks Joe. It is a pleasure to work on the project and an honor to accept the invitation. I look forward to continuing to work alongside all the wonderful contributors to NiFi (and now MiNiFi). Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F

[ANNOUNCE] New Apache NiFi PMC Member - Andy LoPresto

2016-07-07 Thread Joe Witt
On behalf of the Apache NiFI PMC, I am very pleased to announce that Andy LoPresto has accepted the PMC's invitation to join the Apache NiFi PMC. We greatly appreciate all of Andy's hard work and generous contributions to the project with a specific focus on security related elements. We look

Re: thread 69 exception in spark application

2016-07-07 Thread Bryan Bende
Hi Pradeep, That error and stacktrace doesn't appear to reference anything from NiFi so I would suspect it is not related to the NiFi Receiver, but please let us know if you find anything that indicates otherwise. -Bryan On Thu, Jul 7, 2016 at 9:43 AM, pradeepbill

thread 69 exception in spark application

2016-07-07 Thread pradeepbill
hi there, I see a spark exception , in my spark job after running into Thread-69, after ever 12 hrs or so ?, and NIFI receiver stops receiving any more data into spark application.Is this a bug in NIFI receiver jar file? or something I am doing wrong, I can send you my spark code if you are

Re: connection fileQueue size

2016-07-07 Thread pradeepbill
thanks Mark, that would help as well.I can send out emails from REST service as well. -- View this message in context: http://apache-nifi-developer-list.39713.n7.nabble.com/connection-fileQueue-size-tp12686p12689.html Sent from the Apache NiFi Developer List mailing list archive at

Re: conditional Listen Syslog

2016-07-07 Thread David Wynne
Pradeep, While NiFi is able to hold millions of files, remember, your actual limit is determined by how much disk space you have available on the partition where the content_repository is located. Dave. On Wed, Jul 6, 2016 at 4:41 PM, pradeepbill wrote: > thanks

Re: connection fileQueue size

2016-07-07 Thread Mark Payne
Hi Pradeep, NiFi does not have any mechanism natively to provide notifications in such cases. What is available is a set of reporting tasks that can be used to publish metrics such as queue size to ganglia or ambari. The queue sizes are also available via the REST API, so third-party tools may

connection fileQueue size

2016-07-07 Thread pradeepbill
hello everybody, is there a way to get notified if a particular connection reaches particular size ?, I see {file size}, but not {connection.fileQueue.size} or something similar .Please advice. Thanks Pradeep -- View this message in context:

NIFI-1170 (ie TailDir )

2016-07-07 Thread Andre
Hi there, I was having a look on minifi and while the agent is truly an amazing to the NiFi family, playing with it brought back some terrible memories from the past... :-) In particular the way TailFile is only able to handle fully qualified file paths, instead of adopting a wildcard approach.