AW: Execute multiple HQL statements in PutHiveQL or SelectHiveQL

2018-04-23 Thread Krstic, Dejan
Hello Koji, Yes, I also got the same result in the meantime – records were inserted. And I completely agree with you. If parser says it “failed to parse” it sounds like one big “full-stop” so during my testing I did not even try to check if data is actually inserted because message sounds like

OpenID Connect and TLS termination proxy

2018-04-23 Thread Damian Czaja
Hello, I'm trying to enable authentication in NiFi using OpenID Connect (with Keycloak). I have Keycloak and NiFi behind a TLS termination proxy and a reverse proxy, which dispatches the requests to Keycloak and NiFi. AFAIK, authentication is only possible, if using HTTPS directly on NiFi.

RE: [NIFI-CPP] Issues with TIMER_DRIVEN and CRON_DRIVEN

2018-04-23 Thread Mendez Veiga, Iyan
Ok, thanks Marc! And do they work for you both TIMER_DRIVEN and EVENT_DRIVEN in the raspberry? Can you send me a config.yml you have using the GetUSBCamera? Best regards, Iyán De: Marc [mailto:phroc...@apache.org] Enviado el: lunes, 23 de abril de 2018 0:22 Para: users@nifi.apache.org Asunto:

Re: [NIFI-CPP] Issues with TIMER_DRIVEN and CRON_DRIVEN

2018-04-23 Thread Marc P.
Iyán, Yes, both strategies seem to work. Here is my config file https://gist.github.com/phrocker/a209b5163044a5bb3c2e6ac4662ce143 Below is the output form my pi. Due to the time it takes to create a PNG and the scheduling strategy it usually ends up being about a second between

Generate a surrogate key/sequence for each avro record

2018-04-23 Thread Mohit
Hi, I'm trying to added some extra info like a surrogate key/sequence number to the data fetch from rdbms. Is there a way to generate surrogate key for each avro record in nifi? Regards, Mohit

RE: [NIFI-CPP] Issues with TIMER_DRIVEN and CRON_DRIVEN

2018-04-23 Thread Andy Christianson
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Iyán, The scheduling for GetUSBCamera is a bit different. The docs (PROCESSORS.md) say it "outputs one frame per flow file" --it should probably say "one flow file per frame." The reason this processor is a bit different is that the underlying

RE: [NIFI-CPP] Issues with TIMER_DRIVEN and CRON_DRIVEN

2018-04-23 Thread Mendez Veiga, Iyan
Ok, thanks Marc. I have tried your file (just making it simpler and adding a RPG) and timer does not work for me... I will send the log later when I arrive home. So, just a silly question. Imagine I want a picture every 10 seconds. I would just have to change scheduling period to 10 sec or

Best way to drop data based on its content

2018-04-23 Thread Laurens Vets
Hello list, I'm using NiFi to ship JSON formatted data around. However, I want NiFi to drop certain data when some field matches. Let's say we have a field called 'username' and we don't want to further process any data which contains "username":"laurens". What I currently do is get the

Re: Best way to drop data based on its content

2018-04-23 Thread James Wing
Your solution sounds very normal and appropriate to me. Is it performing slowly or causing you problems? Thanks, James On Mon, Apr 23, 2018 at 2:37 PM, Laurens Vets wrote: > Hello list, > > I'm using NiFi to ship JSON formatted data around. However, I want NiFi to > drop

RE: Generate a surrogate key/sequence for each avro record

2018-04-23 Thread Mohit
I'm able to achieve it using QueryRecord processor. Thanks, Mohit From: Mohit Sent: 23 April 2018 15:59 To: users@nifi.apache.org Subject: Generate a surrogate key/sequence for each avro record Hi, I'm trying to added some extra info like a