Re: Deadlock bug in PersistentProvenanceRepository

I will get you all of the stuff you asked for tomorrow morning. Thank you for making the code easy to follow and understand. Plus, taking your time on this bug that is affecting me. You have a good one. Brian On Tue, Jul 26, 2016 at 9:50 PM, Joe Witt wrote: > Thanks

Deadlock bug in PersistentProvenanceRepository

I have been running nifi for about a week on a machine that has 32 cpus. During this week I have seen the nifi instance lockup about 5 times (it could of been more if it was not a weekend). Lockup being no flowfiles moving. All the threads are in the PersistentProvenanceRepository. I have

JsonSplit Question/Help

I’m trying to store each of the hash tags from a twitter post. They can be 0 or more and I’ve found the array via JSON but I’m not sure how to reference them other than via $twitter.hashtags[0].text that’s not very dynamic… as I never know how many there will be. Here’s a screenshot showing

Re: JsonSplit Question/Help

Sven, You can use the SplitJson processor with a JSONPath value of $.twitter.hashtags, it will create a new flowfile for each hashtag. Then you can use EvaluateJsonPath to get the text value from each of the flow files. Regards, Matt On Tue, Jul 26, 2016 at 5:09 PM, Sven Davison

Re: authentication problem

Ralph, I'm guessing that every user is not disabled since you said that you are manually adding them back in through the UI. Is there anything in common with the user's that are being revoked? To follow up on Clarke's comment... As your updating the users through the UI, the authorized-users.xml

Re: authentication problem

Thanks for the responses. Matt Clarke: The permissions look fine. Nifi runs as user “nifi” and all files are owned by “nifi” (with write permissions of course) Matt Gilman: As far as additional logging here is what I found – No errors of any sort: 016-07-25 16:10:59,420 INFO [main]

Re: authentication problem

Verify the user running your nifi has the correct permissions to read and edit all the database files in the NiFi database repository directory. Also make sure the user running NiFi had permissions to edit the authorized-users.xml file. This file is only read on start-up. After nifi is running it

Re: authentication problem

Ralph, Based on the details in your email, it sounds like it should be working. At start up, it will go through the users database to re-verify each user with the configured provider. The authorizations for a user are cache in this database for a configurable time. The re-verification is done to

authentication problem

Hi – whenever we restart Nifi half the accounts are disabled with this message: INFO [main] o.a.n.a.s.action.SeedUserAccountsAction User not authorized with configured provider: . Disabling account... The users are in the authorized-users.xml file. Is this a configuration issue on our part or

Re: Json routing

never mind.. i got that working .. i just wanted to understand the flow in the invokescripted processor first i am reading the input stream to JSON slurper identify whether the element name is ORDER or REFUND based on the element name transfer the flow file to appropriate relationship.. i am

Re: Mantain Connection Pool Live

Hi Carlos, Yes, we can add only one property – validationQuery. And when validationQuery is provided this means connections should be validated. This in turn should give us dropping invalid connections and create new ones. Thanks Toivo 2016-07-25 16:37 GMT+03:00 Carlos Manuel Fernandes (DSI) <

Re: 0.6.1 Master running out of heap space

This is probably because of your stats. All the stats across your cluster are kept within the NCMs heap space. Within Apache nifi it stores 1440 stats per processor, per minute. If you look in the conf file you will see the settings toward the bottom of the file. Sorry, I don't have a running

Re: Syslog to avro format

HI Conrad Thanks for your response. I am not opposed to convert into JSON. Just checking to see if there is a way to get direct Avro conversion from attributes. -Madhu On Tue, Jul 26, 2016 at 4:55 AM, Conrad Crampton < conrad.cramp...@secdata.com> wrote: > Why not converting to JSON? > > I do

Re: Syslog to avro format

Why not converting to JSON? I do exactly this, parse the syslog (into attributes), convert attributes to JSON, JSON->Avro. I had to have an intermediate Avro schema that was only strings due to a problem converting JSON integers into equivalent Avro, then convert Avro schema to final one (that

Syslog to avro format

Friends, What is the best way to get Syslog data into avro format without converting to JSON? Any suggestions?