Re: How do you recover a workflow ?

2016-11-10 Thread Alessio Palma
The point is that I have a workflow but sometimes things go wrong and I need to manually restart it; this action requires: 1) Change some parameters ( UpdateAttribute processor ) 2) Fire a new flowfile which will start again the workflow. Perhaps this is the most obscure point. We are using

Re: UI is not opening after forming nifi 1.0.0 secure cluster in windows

2016-11-10 Thread Andy LoPresto
What is the error you receive in your browser when you try to navigate to the UI? Are you connecting to the correct port? Can you run an OpenSSL s_client command to try to connect via the command line? You will need the CA cert, the client certificate, and the client private key to attempt the

Re: How do you recover a workflow ?

2016-11-10 Thread Jeff
Hello Alessio, Could you provide some more details about your NiFi flow? One of the triggers I used to manually be able to start processing in my flow was to have a GetFile processor (configured with "Keep Source File" set to false) watching for files in a directory, and when I wanted to test

Enable Compression on Remote Port?

2016-11-10 Thread Peter Wicks (pwicks)
When I have a Remote Process Group and I view its Remote Ports I can see that all my ports show "Compressed" as No. How can I change this so that the ports use compression?

Re: NPE MergeContent processor

2016-11-10 Thread Oleg Zhurakousky
Conrad Any chance you an provide a bit more info about your flow? I was able to find a condition when something like this can happen, but it would have to be with some legacy NiFi distribution, so it’s a bit puzzling, but i really want o see if we can close the loop on this. In any event I

how to update nifi to the latest jolt version?

2016-11-10 Thread Sebastian Lagemann
Hello, I’m trying to use the latest jolt specification, especially the operation "modify-overwrite-beta“, introduced with jolt version 0.0.22. It seems that currently only version 0.0.21 is used by nifi (see nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/pom.xml). I tried to

Re: Getting the number of logs

2016-11-10 Thread Peddy, Sai
Hi Joe, Thanks for the response. Yes, that’s essentially what I needed. However, we are on an older version of NIFI and currently updating isn’t yet possible. We’ve decided it might be better to create a custom processor to use internally – which will essentially update the specific counter

RE: Nifi vs Sqoop

2016-11-10 Thread Provenzano Nicolas
Thanks Bryan. De : Bryan Bende [mailto:bbe...@gmail.com] Envoyé : jeudi 10 novembre 2016 15:26 À : users@nifi.apache.org Objet : Re: Nifi vs Sqoop Hello, I can't speak to a direct comparison between NiFi and sqoop, but I can say that sqoop is a specific tool that was built just for database

RE: Nifi vs Sqoop

2016-11-10 Thread Provenzano Nicolas
Hi Matt, It fully answers to my question. Thanks and regards, Nicolas -Message d'origine- De : Matt Burgess [mailto:mattyb...@apache.org] Envoyé : jeudi 10 novembre 2016 15:32 À : users@nifi.apache.org Objet : Re: Nifi vs Sqoop Nicolas, The Max Value Columns property of

Re: NPE MergeContent processor

2016-11-10 Thread Conrad Crampton
Hi, The processor continues to write (to HDFS – the next processor in flow) and doesn’t block any others coming into this processor (MergeContent), so not quite the same observed behaviour as NIFI-2015. If there is anything else you would like me to do to help with this more than happy to help.

Re: NPE MergeContent processor

2016-11-10 Thread Bryan Bende
Conrad, Thanks for reporting this. I wonder if this is also related to: https://issues.apache.org/jira/browse/NIFI-2015 Seems like there is some case where the UUID is ending up as null. -Bryan On Wed, Nov 9, 2016 at 11:57 AM, Conrad Crampton < conrad.cramp...@secdata.com> wrote: > Hi, > >

Re: Host disconnected due to different workflow configuration

2016-11-10 Thread Alessio Palma
OK, understood it. It's still a bit fragile. Is there a way to force the adoption of a configuration from a node using the mouse without to stop and start the server ? From: Bryan Bende Sent: Thursday, November 10, 2016 3:19:16 PM To:

Re: Nifi vs Sqoop

2016-11-10 Thread Matt Burgess
Nicolas, The Max Value Columns property of QueryDatabaseTable is the specification by which the processor fetches only the new lines. In your case you would put "lastmodificationdate" as the Max Value Column. The first time the processor is triggered, it will execute a "SELECT * from myTable" and

Re: Nifi vs Sqoop

2016-11-10 Thread Bryan Bende
Hello, I can't speak to a direct comparison between NiFi and sqoop, but I can say that sqoop is a specific tool that was built just for database extraction, so it can probably do some things NiFi can't, since NiFi is a general purpose data flow tool. That being said, NiFi does have the ability

Re: Host disconnected due to different workflow configuration

2016-11-10 Thread Bryan Bende
Hello, In general NiFi does its best to prevent changes being made to the flow when one of the cluster nodes is down. For example, if you have a 3 node cluster and only 2 nodes are up, you can't change the flow. When a request comes in to change the flow, lets say you drag a new processor on the

How do you recover a workflow ?

2016-11-10 Thread Alessio Palma
Hello all, what is the best pratice to recover a workflow gone bad ? Currently I use a generateFlowFile processor attached to some entry point, which allows me to restart something. Start then stop and a flowfile is created, but this is not the best option. I really miss the option to put a