Re: Minimum file age

2019-01-28 Thread Tomislav Novosel
Thank you for replies and suggestions. Yeah, it is a little disturbing lack of feature, but it's ok. For now, as I have control over remote server, I use dotted file and remove dot (".") after file is finished. Ignore dotted file property set to true. Cheers, Tom On Mon, 28 Jan 2019 at 11:09,

Re: Minimum file age

2019-01-28 Thread Josef.Zahner1
Hi Tom I suggest to use a Wait Processor (to delay the fetch) together with DetectDuplicate Processor. In that way you will fetch the file only once and after it has been written completely (as long as you know how long it takes in max. to finish writing). I know it’s not nice but that’s how

Re: Minimum file age

2019-01-28 Thread Arpad Boda
Hi, It’s on the way: https://issues.apache.org/jira/browse/NIFI-5977 :) Regards, Arpad From: Tomislav Novosel Reply-To: "users@nifi.apache.org" Date: Monday, 28 January 2019 at 09:19 To: "users@nifi.apache.org" Subject: Minimum file age Hi all, I'm having issue with SFTPList processor in

Minimum file age

2019-01-28 Thread Tomislav Novosel
Hi all, I'm having issue with SFTPList processor in Nifi. When reading files from folder where another process writes files, it lists the same file multiple time and ingests file multiple times because modification date of file changes rapidly as another process writes to it. It appears that