Hi Prabhu,

I just used MergeContent to confirm test result. In your case, I
thought the goal is sending queries to SQL Server in order so I think
you don't have to use MergeContent.

Having said that, I came up with an idea. This is kind of a hack but
using ExecuteStreamingCommand to analyze number of files in a dir and
use MergeContent 'Defragment' mode, I was able to merge content
without using static minimum number of files.

Here is another template for that example:
https://gist.githubusercontent.com/ijokarumawak/7e6158460cfcb0b5911acefbb455edf0/raw/967a051177878a98f5ddb57653478c6091a7b23c/process-files-in-order-and-defrag.xml

Thanks,
Koji

On Fri, May 19, 2017 at 6:11 PM, prabhu Mahendran
<prabhuu161...@gmail.com> wrote:
> Hi Koji,
>
> Thanks for your mail.
>
> In your template i have one query regarding if number of files taken by get
> file is unknown then MergeContent Processor could not work right? because
> you have specify maximum number of bins to be 5.
>
> But in my case i am having dynamic number of file counts.In that case merge
> content will failed to merge.
>
> Please stop me if i'm understand anything wrong.
>
> How to give dynamic number of entries/bin for MergeContent due to currently
> there is no expression language supported?
>
> On Fri, May 19, 2017 at 10:34 AM, Koji Kawamura <ijokaruma...@gmail.com>
> wrote:
>>
>> Hi Prabhu,
>>
>> I think you can use EnforceOrder processor which is available since
>> 1.2.0, without Wait/Notify processor.
>>
>> Here is a sample flow I tested how it can be used for use-cases like
>> yours:
>> https://gist.github.com/ijokarumawak/7e6158460cfcb0b5911acefbb455edf0
>>
>> Thanks,
>> Koji
>>
>> On Fri, May 19, 2017 at 1:52 PM, prabhu Mahendran
>> <prabhuu161...@gmail.com> wrote:
>> > I have approximately 1000 files in local drive.I need to move that files
>> > into SQL Server accordingly one after another.
>> >
>> > Since local drive having files like file1.csv,file2.csv,..upto
>> > file1000.csv.I am sure that number of files in local drive may change
>> > dynamically.
>> >
>> > I can able to created template for move that files into SQL Server.But i
>> > have to process the file2 when file 1 has been completely moved into SQL
>> > Server.
>> >
>> > Is this possible in NiFi without using Wait\Notify processor?
>> >
>> > can anyone please guide me to solve this?
>
>

Reply via email to