connector "bends"

2015-12-01 Thread Charlie Frasure
What's the "right way" to add bends in a connector? When I connect two processors, the lines always default to a straight line, and I haven't found a way to adjust them. When I connect a processor to itself first, I get two yellow dots (bends) that allow you to adjust the layout. Then I move

Re: connector "bends"

2015-12-01 Thread Joe Witt
Charlie, You can double click on the line and it will create a bend point for you. You can also double click on that bend point to remove it. Not the first time someone has asked and i don't see it in the docs. Anybody know if this is in the docs somewhere? Thanks Joe On Tue, Dec 1, 2015 at

Re: Rest API for templates.

2015-12-01 Thread Matt Gilman
Chakrader, I was able to upload using curl with the follow command. curl -X POST -v -F template=@"/path/to/template.xml" http:// {host}:{port}/nifi-api/controller/templates The endpoint that accepts the template upload accepts multipart/form-data which I believe is the default when using curl

Re: Rest API for templates.

2015-12-01 Thread Chakrader Dewaragatla
Matt – Thanks for reply and sorry for delay in trying out. I have problem importing and errors as “template is not in a valid format” Here is the curl command and output of the import template command. % curl -X POST -H"ContentType:text/xml" -H"Accept:application/xml"

Re: NoSuchElementException

2015-12-01 Thread Oleg Zhurakousky
Douglass Just looked at the code and would like to ask you if you could try it with our latest snapshot. This was a bug that was fixed. Thanks Oleg On Dec 1, 2015, at 11:23 AM, Douglas Doughty > wrote: Hi All, I’ve enjoyed working with nifi,

Re: Is it possible to create instances of a processor dynamically based on HTTP response?

2015-12-01 Thread Joe Percivall
Ah that makes the use-case a lot simpler. Given the list of commenters you can pass it into SplitJSON which you can use to split the data objects into multiple flowfiles. Then use EvaluateJSONPath to add the ids to an attribute of the flowfile. Finally use InvokeHTTP and the expression

Re: NoSuchElementException

2015-12-01 Thread Joe Witt
adding to Oleg's comment we should have this in a formal nifi release very soon. In fact the great NIFI-655 push we've been holding on just went down so think we're going to kick out an RC very soon. Thanks Joe On Tue, Dec 1, 2015 at 11:45 AM, Oleg Zhurakousky

Re: DistCp from Amazon S3 to HDFS

2015-12-01 Thread Joe Skora
@JoeW, It looks like we need to add a ListS3 processor in addition to the Multipart Upload management that I'm looking into now. Extending ListFileTransfer for S3 shouldn't be too bad. JoeS On Wed, Dec 2, 2015 at 12:04 AM, Joe Witt wrote: > Hello > > So we have FetchS3

Re: DistCp from Amazon S3 to HDFS

2015-12-01 Thread Joe Witt
Hello So we have FetchS3 and PutHDFS and a series of interesting in between processes to help. So that would get you most of the way there. How to get the listing/know what to pull from S3? That part I'm not sure about. This would make for a great example/template for us to post (as would the

Re: NoSuchElementException

2015-12-01 Thread Douglas Doughty
Thanks for the advice, Oleg. I migrated to the latest snapshot, and it’s working now. Good to hear, Joe. On 12/1/15, 10:48 AM, "Joe Witt" wrote: >adding to Oleg's comment we should have this in a formal nifi release >very soon. In fact the great NIFI-655 push we've been

Is it possible to create instances of a processor dynamically based on HTTP response?

2015-12-01 Thread BOUKRAA, Kacem
Hello everyone, So my case is as the following, i'm trying to retrieve JSON files from a social network (Facebook), and based on some values in the file of the HTTP response i want to invoke a new HTTP requests dynamically (in function of the total number of values count). Ex: Retrieve a JSON file

Is it possible to create instances of a processor dynamically based on HTTP response?

2015-12-01 Thread Joe Witt
[posting on behalf of Kacem as there seems to be some issue we've not sorted with his mailing attempts] Hello everyone, So my case is as the following, i'm trying to retrieve JSON files from a social network (Facebook), and based on some values in the file of the HTTP response i want to invoke a

Re: Is it possible to create instances of a processor dynamically based on HTTP response?

2015-12-01 Thread Joe Percivall
Hello Kacem, For your first question you can set up a relatively simple flow to achieve this. Assuming the first retrieval is a GET method call you can do: GetHTTP -> ExtractText -> InvokeHTTP. What this does is, it first gets the JSON files from the social network using GetHTTP. Then with

NoSuchElementException

2015-12-01 Thread Douglas Doughty
Hi All, I’ve enjoyed working with nifi, and I am about to deploy it into production, but I keep running into one problem: I get an error on a ConvertAvroToJSON processor that is in a success path after a ExecuteSQL processor. The messages stayed queued between the two processors. When