Re: GetSQS causes high CPU usage

2015-11-03 Thread Joe Witt
Adam, Just wanted to follow up on this. Have you had any better results and should we put a JIRA in behind what you're seeing? Thanks Joe On Tue, Oct 20, 2015 at 7:58 PM, Adam Lamar wrote: > Adam, > > Thanks for the reply! > > Amazon supports (and recommends) long

Re: template repo for learning

2015-11-03 Thread Bryan Bende
If you can share a little more info about what the API that you're trying to interact with looks like, we can likely provide more concrete guidance. As a very basic test, to familiarize yourself with the Expression Language, you could create a "dummy flow" such as: - GenerateFlowFile to create a

Re: Nifi connection queue monitoring.

2015-11-03 Thread Chakrader Dewaragatla
Matt – How do I get the start time of a processor ? we have a getSftp processor with time driven schedule (6h interval). I would like to monitor the start and finish time for that interval, where do I see the captured stats ? Thanks, -Chakri From: Chakrader Dewaragatla

Re: Client Site to Site

2015-11-03 Thread Mark Payne
Naveen, With the config provided below, you are setting the "nifi.remote.input.secure" flag to true. This means that you will need to also set the keystore and truststore properties. Thanks -Mark > On Nov 3, 2015, at 12:36 PM, Madhire, Naveen > wrote: > >

Re: Client Site to Site

2015-11-03 Thread Mark Payne
Naveen, Currently, if you are using secure site-to-site, then it requires 2-way SSL. So you will want to use needClientAuth = true, and you will need the keystore and truststore configured for both NiFi and your client. This is something that is being addressed for the 1.0.0 build, but as of

Re: GetSQS causes high CPU usage

2015-11-03 Thread Adam Lamar
Hey Joe, I think there are two possible JIRAs. 1) Add long polling support using setWaitTimeSeconds() - should be really easy. I can take a crack at a pull request. Here's a JIRA: https://issues.apache.org/jira/browse/NIFI-1103 2) Investigate the high CPU usage. I saw this initially for

Client Site to Site

2015-11-03 Thread Madhire, Naveen
Hi, I am unable to connect to Nifi Instance using site-to-site configuration. I’ve setup to run Nifi locally and also configured site-to- site-communication using the below properties, # Site to Site properties nifi.remote.input.socket.host= nifi.remote.input.socket.port=9870

Re: Client Site to Site

2015-11-03 Thread Madhire, Naveen
I did set the keystore properties and didn’t set the truststore properties because I set “nifi.security.needClientAuth” to “false” Do I still need truststore property? nifi.security.truststore= nifi.security.truststoreType= nifi.security.truststorePasswd= nifi.security.needClientAuth=false

Suggestion on how to parse field out of filename

2015-11-03 Thread Mark Petronic
Looking for some help on best way to extract a field from a filename. I need to parse out the date from the core filename attribute set by the UnpackContent processor. I am unzipping files that contain many CSV files and these CSV file names vary in format but each has a timestamp included in the

Re: Need help in nifi- flume processor

2015-11-03 Thread Parul Agrawal
Hi Bryan, I am trying to insert the following data in to Database using Nifi processor* ConvertJsonToSql and PutSQL.* *Json Object used:* {"index":"1", "num":"1", "len":"58", "caplen":"54", "timestamp":"*Nov 4, 2015 00:42:15.0 CST*"} Kindly find the *table description:* maddb=# \d

template repo for learning

2015-11-03 Thread Christopher Hamm
Is there a repo of nifi templates with advanced features that use lots of expression language expecially when used to make requests? I can't find enough docs or youtube videos that really dig into it.

Re: template repo for learning

2015-11-03 Thread Christopher Hamm
Thanks Bryan. I will take a look. I might have a few questions to resolve errors from the UI once I try again. On Tue, Nov 3, 2015 at 10:14 AM, Bryan Bende wrote: > If you can share a little more info about what the API that you're trying > to interact with looks like, we can