Can someone please provide a workaround for this scenario.

Thanks,
Manish


From: Manish Gupta 8 [mailto:[email protected]]
Sent: Thursday, December 03, 2015 2:18 PM
To: [email protected]
Subject: Trigger a processor if all files in a folder are processed

Hi,

I have a scenario where I want to trigger / execute one processor once GetFile 
has pulled all the files from a folder and the last processor has finished its 
execution. How can I implement this in Nifi?

Basically what I am trying to do is:
({Execute Process to call some phantomJS script to download few files in a 
directory}) : runs every 1 hour
({Get File (xml)} --> {Validate with XSD} --> {Put HDFS}): checks for files 
continuously

Now after this flow is complete i.e. all files are available in HDFS, I want to 
submit my XML to Avro conversion MR job using Oozie REST. How can I make sure 
that my Invoke HTTP processor executes only once and that too after all files 
have successfully landed in HDFS?

Thanks,
Manish

Reply via email to