Hi James,
Thanks for your reply.
The source has multiple files generated per day and I'm interested in one of
those, so filtering is required I guess.
I don't know how to filter based on the filename, was trying to pipe things
like this: ListSFTP -> UpdateAttribute -> FetchSFTP
but I'm sure there's a better way to filter. Can you help by giving me a
pointer or two please?
I also tried to pipe directly from ListSFTP -> FetchSFTP and used
${now():toNumber():minus(86400000):format('yyyymmdd')}-*.csv but then this
doesn't match the remote file guessing because FetchSFTP doesn't do globing.
Thanks,
________________________________________
From: Joe Witt <joe.w...@gmail.com>
Sent: April 15, 2016 1:35 PM
To: users@nifi.apache.org
Subject: Re: datetime argument to the GetSFTP processor
Ahh - great idea James!
On Fri, Apr 15, 2016 at 1:34 PM, James Wing <jvw...@gmail.com> wrote:
> Have you looked at a combination of ListSFTP -> FetchSFTP? I believe
> ListSFTP has built-in support for tracking recent files, and it might
> satisfy your use case. If not, you can certainly filter the listed files by
> the "filename" attribute before calling FetchSFTP.
>
> On Fri, Apr 15, 2016 at 7:40 AM, Ashraf Hasson <ahas...@windmobile.ca>
> wrote:
>>
>> Hi there,
>>
>>
>> I've been trying to use the GetSFTP processor to fetch files that have a
>> 'yyyymmdd' part but the only option I have is to use Java Regular
>> Expression, not sure how to specify today or yesterday's date dynamically.
>>
>>
>> I thought an alternative is to use a locally generated file that contains
>> the datetime string, use a GetFile + UpdateAttribute to pass in a custom
>> attribute to the GetSFTP processor that way, but sounded a bit cumbersome
>> tbh.
>>
>>
>> Any thoughts/hints please?
>>
>>
>> Thanks,
>>
>> Ashraf
>
>
