Rebel flowfile and python scripts.

Hello all, there is a strange behavior on our NIFI installation. I wrote a script in python and for some reason and sometimes the flowfile does not always moves into it, like in this case: [cid:bc2b4b7b-c4dc-4a6a-bffb-e78f432a897b] I see that Queued Duration for the above flowfile is

Sentry & NIFI

Hello all, is there a simple way to connect nifi to sentry using the log appender facility?

Re: Cluster instability due to java.net.SocketTimeoutException: Read timed out

] at com.sun.jersey.client.urlconnection.URLConnectionClientHandler.handle(URLConnectionClientHandler.java:153) ~[jersey-client-1.19.jar:1.19] ... 12 common frames omitted perhaps it is useful to understand the problem. From: Alessio Palma <alessio.pa...@docomodigital.com> Sent: Monday, February 13, 2017 9:31:15 AM To

Cluster instability due to java.net.SocketTimeoutException: Read timed out

Hello all, sometime the cluster is unstable due to "read time out". Is here any parameter which I can fine tuning in order to reduce this problem ? Most timeouts (66%) are coming from com.sun.jersey.api.client.ClientHandlerException few (33%) from o.apache.nifi.controller.FlowController

Re: ListHDFS ( some suggestions depending on our usage )

58 GMT+01:00 Alessio Palma <alessio.pa...@docomodigital.com<mailto:alessio.pa...@docomodigital.com>>: Hello all, I'm using ListHDFS but... 1) it can start only on a schedule strategy 2) directory path to list is "hard coded" into the processor it self. I wonder if a new v

ListHDFS ( some suggestions depending on our usage )

Hello all, I'm using ListHDFS but... 1) it can start only on a schedule strategy 2) directory path to list is "hard coded" into the processor it self. I wonder if a new version, which can be started using a flowfile, accept the attributes of the incoming flow file as parameters, it is more

How to print flow

Hello all, does anybody found a way to print workflow? I.E: tool to convert the flow into another format which is readable by other software with printing support.

Re: keytab file does not exists but actually it does

he.org Subject: Re: keytab file does not exists but actually it does Hello Alessio, Is you krb5.conf correct and correctly referenced in your nifi.properties file? Pierre 2017-01-19 12:20 GMT+01:00 Alessio Palma <alessio.pa...@docomodigital.com<mailto:alessio.pa...@docomodigital.com>>

Re: keytab file does not exists but actually it does

I dropped and create again the same processor and for some unknown reason it worked. Very strange. From: Alessio Palma <alessio.pa...@docomodigital.com> Sent: Thursday, January 19, 2017 12:33:54 PM To: users@nifi.apache.org Subject: Re: keytab fil

Host disconnected due to different workflow configuration

Hello all, I experienced "host out of the cluster which was no longer able to join", log reports configuration workflow has been changed and it's different from the one running into the cluster. Due to this issue there is not way to join again the cluster. To resolve this I stopped the whole

Re: How do you recover a workflow ?

st run the touch command to create a file that the GetFile processor would detect and emit a flowfile for it. Depending on your use case, there might be a better source processor for flowfiles that you can use in your flow. On Thu, Nov 10, 2016 at 6:55 AM Alessio Palma <alessio.pa..

How do you recover a workflow ?

Hello all, what is the best pratice to recover a workflow gone bad ? Currently I use a generateFlowFile processor attached to some entry point, which allows me to restart something. Start then stop and a flowfile is created, but this is not the best option. I really miss the option to put a

Re: Host disconnected due to different workflow configuration

errors happened in the log of that node before seeing "host out of cluster..."? because the real problem is there was some other issue on that node that caused it to fail. -Bryan On Wed, Nov 9, 2016 at 5:45 AM, Alessio Palma <alessio.pa...@docomodigital.com<mailto:alessio.p

cannot add working users to nifi

Hello I did setup a 3 hosts nifi cluster, I followed the docs ( administration guide ) and now each user I add has no access. Can login but cannot do anything but see the users on the system. Is there an alternative setup procedure I can follow? User I added has been granted with same groups and

how to loop workflows

Hello all, is there any way to loop workflow by list or counters? Oozie allows to break the rules of acyclic graphs with some tricks, is the same in NIFI ?

Flow file from a (long) string

Hello, is there a processor which allows to build a flowfile from a string? Basically I have some huge queries and want to add them into the workflow without load them from file or database. AP

Re: start it ONCE

ill be in an upcoming release. > > Thanks > Joe > > On Mon, Oct 24, 2016 at 6:13 AM, Alessio Palma > <alessio.pa...@buongiorno.com> wrote: >> Hello All, here is a question which is driving me crazy... >> I'm using the PutHiveQL processor to create some tables and

start it ONCE

Hello All, here is a question which is driving me crazy... I'm using the PutHiveQL processor to create some tables and view into HIVE. This processor need the SQL to execute into a flowfile. I'm using a GenerateFlowFile to build an empty flowfile which is later filled using the ReplaceText

Resource directory paths are malformed: docs

Hello all, I rebuild nifi from scratch and after the deploy Jetty won't restartslogs returns this error: at java.lang.reflect.Constructor.newInstance(Constructor.java:423) ~[na:1.8.0_92] at org.apache.nifi.NiFi.(NiFi.java:146) ~[nifi-runtime-1.0.0-SNAPSHOT.jar:1.0.0-SNAPSHOT] at

Re: Resource directory paths are malformed: docs

ed: docs Hi Alessio, Could you copy/paste the full stack trace? Thanks! Pierre 2016-11-17 17:03 GMT+01:00 Alessio Palma <alessio.pa...@docomodigital.com<mailto:alessio.pa...@docomodigital.com>>: Hello all, I rebuild nifi from scratch and after the deploy

How I put the cluster down.

Hello all, yesterday, for a mistake, basically I executed " ls -R / " using the ListHDFS processor and the whole cluster gone down ( not just a node ). Something like this also happened when I was playing with some DO WHILE / WHILE DO patterns. I have only the nifi logs and they show the

Re: How I put the cluster down.

start. If memory > related you'll probably see something in the nifi-app.log. Try going > with a larger heap as can be controlled in conf/bootstrap.conf. > > Thanks > Joe > > On Fri, Oct 28, 2016 at 5:55 AM, Alessio Palma > <alessio.pa...@buongiorno.com> wrote: >>

Re: nifi 1.1.1 : Unable to empty queues

elease (1.2.0). Matt On Tue, Jan 10, 2017 at 9:36 AM, Alessio Palma <alessio.pa...@docomodigital.com<mailto:alessio.pa...@docomodigital.com>> wrote: Hello all, I'm checking nifi 1.1.1 before moving it to production and something weird is happening when I try to empty a queue. System r

Re: nifi 1.1.1 : Unable to empty queues

check. FYI, there was a recent improvement committed the master branch that provides some level of details regarding the insufficient privileges. This should make it into the next release (1.2.0). Matt On Tue, Jan 10, 2017 at 9:36 AM, Alessio Palma <alessio.pa...@docomodigital.com<mailt

Re: Cluster is still voting on which Flow is the correct flow for the cluster

:40 AM, Alessio Palma <alessio.pa...@docomodigital.com<mailto:alessio.pa...@docomodigital.com>> wrote: 2 host secured custer. 2 zookeeper. From: Andre <andre-li...@fucs.org<mailto:andre-li...@fucs.org>> Sent: Thursday, January 12, 2017 2:39:2

Re: Cluster is still voting on which Flow is the correct flow for the cluster

essage. Do you mind filing a JIRA for that? Thanks -Mark On Jan 12, 2017, at 9:34 AM, Alessio Palma <alessio.pa...@docomodigital.com<mailto:alessio.pa...@docomodigital.com>> wrote: Thanks Mark, U right, authorizations.xml was out of sync. Now the trick is clear, and when you

Re: Cluster is still voting on which Flow is the correct flow for the cluster

w many zookeeper form your ensemble? Kind regards On Fri, Jan 13, 2017 at 12:28 AM, Alessio Palma <alessio.pa...@docomodigital.com<mailto:alessio.pa...@docomodigital.com>> wrote: Hello all, there are 5 minutes of negotiation on the cluster which ends in nothing. These

5 minutes

Hello all, something into NIFI is timed to 5 minutes: processor statistic error messages How can I change processor statistics to hours and error messages to last days ?

Write-lock processors

Hello all, I wonder if there is a fast way to set processor to write only. It's easy to deleted/move/change them on the workbench and I see no undo option.