Hi there,
Okay, so I should use RouteOnAttribute I think.
Here's the source filename: test.file.20160420-015931.csv
I've configured the RouteOnAttribute to route the `filename` to success when
the following is matched:
property: filename == value:
${filename:substringAfter('test.file.'):startsWith(
${now():toNumber():minus(86400000):format('yyyymmdd')} )}
Maybe this is not the right way but I'd highly appreciate some help.
Thanks,
________________________________________
From: Ashraf Hasson
Sent: April 21, 2016 12:50 PM
To: users@nifi.apache.org
Subject: Re: datetime argument to the GetSFTP processor
Hi James,
Thanks for your reply.
The source has multiple files generated per day and I'm interested in one of
those, so filtering is required I guess.
I don't know how to filter based on the filename, was trying to pipe things
like this: ListSFTP -> UpdateAttribute -> FetchSFTP
but I'm sure there's a better way to filter. Can you help by giving me a
pointer or two please?
I also tried to pipe directly from ListSFTP -> FetchSFTP and used
${now():toNumber():minus(86400000):format('yyyymmdd')}-*.csv but then this
doesn't match the remote file guessing because FetchSFTP doesn't do globing.
Thanks,
________________________________________
From: Joe Witt <joe.w...@gmail.com>
Sent: April 15, 2016 1:35 PM
To: users@nifi.apache.org
Subject: Re: datetime argument to the GetSFTP processor
Ahh - great idea James!
On Fri, Apr 15, 2016 at 1:34 PM, James Wing <jvw...@gmail.com> wrote:
> Have you looked at a combination of ListSFTP -> FetchSFTP? I believe
> ListSFTP has built-in support for tracking recent files, and it might
> satisfy your use case. If not, you can certainly filter the listed files by
> the "filename" attribute before calling FetchSFTP.
>
> On Fri, Apr 15, 2016 at 7:40 AM, Ashraf Hasson <ahas...@windmobile.ca>
> wrote:
>>
>> Hi there,
>>
>>
>> I've been trying to use the GetSFTP processor to fetch files that have a
>> 'yyyymmdd' part but the only option I have is to use Java Regular
>> Expression, not sure how to specify today or yesterday's date dynamically.
>>
>>
>> I thought an alternative is to use a locally generated file that contains
>> the datetime string, use a GetFile + UpdateAttribute to pass in a custom
>> attribute to the GetSFTP processor that way, but sounded a bit cumbersome
>> tbh.
>>
>>
>> Any thoughts/hints please?
>>
>>
>> Thanks,
>>
>> Ashraf
>
>
