Re: [E] LIST_SFTP FETCH_SFTP

2016-09-22 Thread HadyZiade
not an option but thanks :) -- View this message in context: http://apache-nifi-developer-list.39713.n7.nabble.com/LIST-SFTP-FETCH-SFTP-tp13428p13443.html Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.

Re: [E] LIST_SFTP FETCH_SFTP

2016-09-22 Thread HadyZiade
this should keep running on production , cant babysit the process by emptying the state each time we need NIFI to process old files , is there a workaround to store the processed file in memory and have a process do a lookup with that file to pull unprocessed files only ... -- View this messag

Re: [E] LIST_SFTP FETCH_SFTP

2016-09-21 Thread Tarou, Kirk
Alternatively, you could 'touch' all of the files you want pulled and it should list them next time ListSFTP is run. I haven't tested it but it should work. -Kirk On Sep 21, 2016, at 11:37 AM, Tarou, Kirk mailto:kirk.ta...@verizonwireless.com.INVALID>> wrote: You'll need to stop the ListSFTP

Re: [E] LIST_SFTP FETCH_SFTP

2016-09-21 Thread Tarou, Kirk
You'll need to stop the ListSFTP processor then clear the state. When you restart the processor, it will return everything. -Kirk On Sep 21, 2016, at 6:19 AM, HadyZiade mailto:hadyzi...@gmail.com>> wrote: Using ListSFTP will list all files and use fetch sftp to get the fetch the listed data .

LIST_SFTP FETCH_SFTP

2016-09-21 Thread HadyZiade
Using ListSFTP will list all files and use fetch sftp to get the fetch the listed data . Listsftp wont list the files that were processed before . in a case when old files were sent to the directory that listSFTP is listening to , these files wont be processed . what is the workaround that shou