Re: Only get file when a set exists.

2018-05-27 Thread Martijn Dekkers
Hi Koji, that looks excellent, many thanks! I did consider wait/notify, but wasn't quite sure - not used wait/notify before. Many thanks for putting the example together, I will give this a try. Martijn On 28 May 2018 at 05:11, Koji Kawamura wrote: > Hi Martin, > >

Re: Only get file when a set exists.

2018-05-27 Thread Koji Kawamura
Hi Martin, Alternative approach is using Wait/Notify processors. I have developed similar flow using those before, and it will work with your case I believe. A NiFi flow template is available here. https://gist.github.com/ijokarumawak/06b3b071eeb4d10d8a27507981422edd Hope this helps, Koji On

Re: Only get file when a set exists.

2018-05-27 Thread Andrew Grande
Martijn, Here's an idea you could explore. Have the ListFile processor work as usual and create a custom component (start with a scripting one to prototype) grouping the filenames as needed. I don't know of the number of files in a set is different every time, so trying to be more robust. Once

Only get file when a set exists.

2018-05-27 Thread Martijn Dekkers
Hello all, I am trying to work out an issue with little success. I need to ingest files generated by some application. I can only ingest these files when a specific set exists. For example: file_123_456_ab.ex1 file_123_456_cd.ex1 file_123_456_ef.ex1 file_123_456_gh.ex1 file_123_456.ex2 Only