Re: GetHTTP Usage with Dynamic Filenames

2015-09-23 Thread indus well
Worked like a charm! Thank you for your quick response, Daryl and Mark. The content of the downloaded file is stored in the file generated FlowFile with a random filename, how would I rename the output file to actual downloaded filename? By the way, the ticket is a good enhancement. Thanks,

Re: GetHTTP Usage with Dynamic Filenames

2015-09-23 Thread Joe Witt
Indus, We should probably have another JIRA to have the InvokeHTTP processor capture response headers and store them as flow file attributes or at least as a single attribute with the headers on it - something. However, the core need you have is totally doable. I'd recommend the following flow:

Re: GetHTTP Usage with Dynamic Filenames

2015-09-23 Thread indus well
Thanks, Joe. That did it, exactly what I was looking for. You guys and NiFi rock! On Wed, Sep 23, 2015 at 10:43 PM, Joe Witt wrote: > Indus, > > We should probably have another JIRA to have the InvokeHTTP processor > capture response headers and store them as flow file

Re: GetHTTP Usage with Dynamic Filenames

2015-09-23 Thread Mark Payne
Indus, As Daryl mentioned, InvokeHTTP will allow you to use the Expression Language to do an HTTP GET. It works a bit differently, though, because GetHTTP is a "Source Processor" whereas InvokeHTTP needs to be fed a FlowFile to do anything. So you can use GenerateFlowFile as a source and have

Re: GetHTTP Usage with Dynamic Filenames

2015-09-23 Thread Daryl Teo
Indus - use InvokeHTTP Daryl On Thu, Sep 24, 2015 at 11:07 AM, indus well wrote: > Hello NiFi Experts: > > The GetHTTP processor works fine with static filename when getting files > from a website. However, I have a use case where I need to download a file > daily and the