Perfect! You got it.
On Thu, Apr 21, 2016 at 1:11 PM, Ashraf Hasson <ahas...@windmobile.ca> wrote:
> Hi there,
>
> Okay, so I should use RouteOnAttribute I think.
>
> Here's the source filename: test.file.20160420-015931.csv
>
> I've configured the RouteOnAttribute to route the `filename` to success when
> the following is matched:
>
> property: filename == value:
> ${filename:substringAfter('test.file.'):startsWith(
> ${now():toNumber():minus(86400000):format('yyyymmdd')} )}
>
> Maybe this is not the right way but I'd highly appreciate some help.
>
> Thanks,
>
> ________________________________________
> From: Ashraf Hasson
> Sent: April 21, 2016 12:50 PM
> To: users@nifi.apache.org
> Subject: Re: datetime argument to the GetSFTP processor
>
> Hi James,
>
> Thanks for your reply.
> The source has multiple files generated per day and I'm interested in one of
> those, so filtering is required I guess.
> I don't know how to filter based on the filename, was trying to pipe things
> like this: ListSFTP -> UpdateAttribute -> FetchSFTP
> but I'm sure there's a better way to filter. Can you help by giving me a
> pointer or two please?
>
> I also tried to pipe directly from ListSFTP -> FetchSFTP and used
> ${now():toNumber():minus(86400000):format('yyyymmdd')}-*.csv but then this
> doesn't match the remote file guessing because FetchSFTP doesn't do globing.
>
> Thanks,
> ________________________________________
> From: Joe Witt <joe.w...@gmail.com>
> Sent: April 15, 2016 1:35 PM
> To: users@nifi.apache.org
> Subject: Re: datetime argument to the GetSFTP processor
>
> Ahh - great idea James!
>
> On Fri, Apr 15, 2016 at 1:34 PM, James Wing <jvw...@gmail.com> wrote:
>> Have you looked at a combination of ListSFTP -> FetchSFTP? I believe
>> ListSFTP has built-in support for tracking recent files, and it might
>> satisfy your use case. If not, you can certainly filter the listed files by
>> the "filename" attribute before calling FetchSFTP.
>>
>> On Fri, Apr 15, 2016 at 7:40 AM, Ashraf Hasson <ahas...@windmobile.ca>
>> wrote:
>>>
>>> Hi there,
>>>
>>>
>>> I've been trying to use the GetSFTP processor to fetch files that have a
>>> 'yyyymmdd' part but the only option I have is to use Java Regular
>>> Expression, not sure how to specify today or yesterday's date dynamically.
>>>
>>>
>>> I thought an alternative is to use a locally generated file that contains
>>> the datetime string, use a GetFile + UpdateAttribute to pass in a custom
>>> attribute to the GetSFTP processor that way, but sounded a bit cumbersome
>>> tbh.
>>>
>>>
>>> Any thoughts/hints please?
>>>
>>>
>>> Thanks,
>>>
>>> Ashraf
>>
>>
