Re: ExecuteProcess

2016-02-22 Thread Aldrin Piri
Uwe, Welcome to the community! If you are looking for one process to be kicked off by another, there is a related processor to ExecuteProcess called ExecuteStreamCommand and I believe should what you are looking for. ExecuteStreamCommand will accept FlowFiles from incoming connections and use th

Re: Nifi 0.50 and GetKafka Issues

2016-02-22 Thread Joe Witt
All just as a point of reference we now have a live system running that is on NiFi 0.5.0 and feeding three versions of Kafka at once: - 0.8.1 - 0.8.2.0 - 0.9.0.1 So perhaps there are some particular configurations that cause issues. Can you share more details about your configuration of Kafka/NiFi

Re: Nifi 0.50 and GetKafka Issues

2016-02-22 Thread Joe Witt
Sorry to clarify it working against all three of these at once: - Kafka 0.8.1.1 - Kafka 0.8.2.1 - Kafka 0.9.0.1 Thanks Joe On Mon, Feb 22, 2016 at 4:12 PM, Joe Witt wrote: > All just as a point of reference we now have a live system running > that is on NiFi 0.5.0 and feeding three versions of K

ExecuteProcess

2016-02-22 Thread Uwe Geercken
Hello,   I am new to Nifi and have a general question for the ExecuteProcess processor.   Is it possible with Nifi to run a process and have a second process wait until the first one finished? How would I do that? It looks like though that this processor does not allow for an incomming connecti

Re: Connecting Spark to Nifi 0.4.0

2016-02-22 Thread Mark Payne
Kyle, Another thought here, that I don't see mentioned yet is how NiFi's site-to-site works. Because the Spark Receiver does not know whether the NiFi you're talking to is a standalone instance or a cluster, it first will ask for a list of all NiFi nodes. Assuming that you've got a standalone i

Dependent processing of files compressed files.

2016-02-22 Thread Rich Kroll
Hello all, We are prototyping an NiFi based bulk load use case and have run into a challenge that I hope one of you can help with. We have the following file layout: file.tar.gz /user1/user.xml /user1/attachments/ /user1/attachments/file1.jpg /user1/attachments/file2.jpg /user2/user2.xml W

Re: Connecting Spark to Nifi 0.4.0

2016-02-22 Thread Bryan Bende
Hi Kyle, It seems like the stack trace is suggesting that Spark is trying to download dependencies from the like that references Executor.updateDependencies: https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/executor/Executor.scala#L391 Any chance you are behind som

Re: Connecting Spark to Nifi 0.4.0

2016-02-22 Thread Kyle Burke
Joe, I’m not sure what to do with Bryan’s comment. The spark code I’m running has no problem reading from a Kafka receiver. I only get the error when trying to read from a Nifi receiver. When I create a Nifi flow that reads from the same kafka stream and sends the data to our outport port I g

Re: Nifi 0.50 and GetKafka Issues

2016-02-22 Thread Kyle Burke
I replaced my 0.5.0 kafka nar with the 0.4.1 kakfa nar and it fixed my kafka issue. I renamed the 0.4.1 nar to be 0.5.0.nar and restart nifi and my kafka processor started reading my 0.8.2.1 stream. Not elegant but glad it worked. Respectfully, Kyle Burke | Data Science Engineer IgnitionOne -

Re: Connecting Spark to Nifi 0.4.0

2016-02-22 Thread Joe Witt
Kyle, Did you get a chance to look into what Bryan mentioned? He made a great point in that the stacktrace doesn't seem to have any relationship to NiFi or NiFi's site-to-site code. Thanks Joe On Mon, Feb 22, 2016 at 12:58 PM, Kyle Burke wrote: > Telnet leads me to believe the port is open. (I

Re: Connecting Spark to Nifi 0.4.0

2016-02-22 Thread Kyle Burke
Telnet leads me to believe the port is open. (I upgrade to 0.5.0 today in hopes that it will help but no luck) From Telnet: 12:50:11 [~/Dev/nifi/nifi-0.5.0] $ telnet localhost 8080 Trying ::1... Connected to localhost. Escape character is '^]’. Respectfully, Kyle Burke | Data Science Engin

Re: Using Apache Nifi and Tika to extract content from pdf

2016-02-22 Thread Russell Whitaker
On Sun, Feb 21, 2016 at 3:30 PM, Matt Burgess wrote: [SNIP] > > To that end, I am would love to hear any comments, questions, or suggestions > to make the scripting processors better. Russell's suggestion for adding > Clojure is a great example, I am hoping we can take this thing as far as it > ca

Re: Authentication error - access denied exporting template

2016-02-22 Thread Conrad Crampton
Excellent news, thanks for such a great tool and the continuing hard work. Conrad On 22/02/2016, 15:56, "Joe Witt" wrote: >We are working to have an RC for it any day. We're very close so >today is feasible. > >Thanks >Joe > >On Mon, Feb 22, 2016 at 10:18 AM, Conrad Crampton > wrote: >> Matt,

Re: Authentication error - access denied exporting template

2016-02-22 Thread Joe Witt
We are working to have an RC for it any day. We're very close so today is feasible. Thanks Joe On Mon, Feb 22, 2016 at 10:18 AM, Conrad Crampton wrote: > Matt, > Thanks for the update. I trawled the user list archive for anything similar, > didn’t think to check the issue log. > Is there a date

Re: Authentication error - access denied exporting template

2016-02-22 Thread Tony Kurc
If all goes well, we're likely to put together a release candidate tonight, the voting period is 72 hours. Best case is 3.5 days. On Mon, Feb 22, 2016 at 10:18 AM, Conrad Crampton < conrad.cramp...@secdata.com> wrote: > Matt, > Thanks for the update. I trawled the user list archive for anything >

Re: Authentication error - access denied exporting template

2016-02-22 Thread Matt Gilman
Conrad, We are working towards having an RC candidate soon. This would then be followed by the standard Apache release process which includes a voting window. If you subscribe to our dev mailing list, you would get an email regarding the RC once it's available if you want to check it out early. T

Re: GetMail processor

2016-02-22 Thread Bryan Bende
Phil, A GetEmail processor is planned. There is a JIRA for it, most likely for the 0.6.0 release: https://issues.apache.org/jira/browse/NIFI-1148 -Bryan On Fri, Feb 19, 2016 at 4:48 AM, wrote: > Hi, > > I would like to know if a GetEmail processor is available somewhere or > planned J . I ha

Re: Authentication error - access denied exporting template

2016-02-22 Thread Conrad Crampton
Matt, Thanks for the update. I trawled the user list archive for anything similar, didn’t think to check the issue log. Is there a date for the 0.5.1 release? Cheer Conrad From: Matt Gilman mailto:matt.c.gil...@gmail.com>> Reply-To: "users@nifi.apache.org" mailto:us

Re: Authentication error - access denied exporting template

2016-02-22 Thread Matt Gilman
Thanks for reporting this. The issue is specifically tied to downloading resources (content or templates) and accessing UI extensions (like the content viewer or custom UI) when logged in via LDAP. Using client certificates should be working as expected. This token issue is addressed in NIFI-1497

Authentication error - access denied exporting template

2016-02-22 Thread Conrad Crampton
Hi, I have a working NiFi installation on both my local machine and on a cluster. Both set up with certificates and https access and LDAP integration. All good. However, I have come across an issue where I can’t now export templates as I get an ‘access denied’ error in the UI, and in the nifi-use