Re: How to process files sequentially?

2017-05-21 Thread Koji Kawamura
Hi Prabhu, Here is another example that counts number of files within a dir using ExecuteScript with Groovy. Although I don't have tested with Windows env, it should work. https://gist.github.com/ijokarumawak/7e6158460cfcb0b5911acefbb455edf0#file-process-in-order-and-defrag-with-groovy-xml Thanks

Re: How to process files sequentially?

2017-05-19 Thread prabhu Mahendran
Sorry Koji, I have used NiFi in Windows So i can't able to use ExecuteStreamCommand for it. It shows error in "System cannot find path Specified" Is any other way for doing it in windows? On Fri, May 19, 2017 at 12:50 PM, Koji Kawamura wrote: > Hi Prabhu, > > I just used MergeContent to confi

Re: How to process files sequentially?

2017-05-19 Thread Koji Kawamura
Hi Prabhu, I just used MergeContent to confirm test result. In your case, I thought the goal is sending queries to SQL Server in order so I think you don't have to use MergeContent. Having said that, I came up with an idea. This is kind of a hack but using ExecuteStreamingCommand to analyze numbe

Re: How to process files sequentially?

2017-05-19 Thread prabhu Mahendran
Hi Koji, Thanks for your mail. In your template i have one query regarding if number of files taken by get file is unknown then MergeContent Processor could not work right? because you have specify maximum number of bins to be 5. But in my case i am having dynamic number of file counts.In that c

Re: How to process files sequentially?

2017-05-19 Thread Koji Kawamura
Hi Prabhu, I think you can use EnforceOrder processor which is available since 1.2.0, without Wait/Notify processor. Here is a sample flow I tested how it can be used for use-cases like yours: https://gist.github.com/ijokarumawak/7e6158460cfcb0b5911acefbb455edf0 Thanks, Koji On Fri, May 19, 201