Wait only if flagged?

I have a database flow, which is a sequence of 4 processors. For database performance reasons I need to make sure only one file is in this section of the flow at a time. Not just one file per queue/processor, but for the whole section. I feel like I should be able to use Wait/Notify to do

RE: [EXT] Re: Calling NIFI job from any Enterprise Scheduler

A lot of enterprise schedulers have an option to post to an HTTP endpoint. In the past I’ve used NiFi’s ListenHTTP processor to allow for remote triggering of a flow. But really any of the Listen/Consume processors could potentially be used for remote triggering: * ListenHTTP or

Re: Splunk Processor - Re-play

Hello, Even I provide Earliest Time and Latest Time with “Provided” strategy, it is causing data duplicate in the system. The same number of records are repeated as many times, when the workflow runs. My question is, even if specify the "Managed" time strategy, how to go back to certain time

Re: Wait only if flagged?

Peter, I haven't tried this, but my knee-jerk reaction is to switch the roles of the "wait" and "success" relationships. Maybe you can send the "wait" relationship downstream and route the "success" one back to Wait. Then when the flag is "cleared", the flow files will start going to the

RE: [EXT] Re: Wait only if flagged?

Matt, I played around with your idea. I haven't been able to get it to work. First flow file comes in, goes out the wait relationship. Now how do we stop the next FlowFile from going out the wait relationship and entering the flow? Well we'd have to use Notify along with some scheduling on

Re: [EXT] Re: Wait only if flagged?

Hi Peter, I think I have done similar thing before. This flow template may be useful in your case, too. https://gist.github.com/ijokarumawak/9e1a4855934f2bb9661f88ca625bd244 Thanks, Koji On Tue, Nov 14, 2017 at 12:58 PM, Peter Wicks (pwicks) wrote: > Matt, > > I played

Splunk Processor - Re-play

Hi Folks, I am newbie to nifi tool. I am using GetSplunk 1.4.0 processor to pull data from Splunk. Somewhat I have managed pulled the data for T-3, but I want to re-play and again want to pull data with some more additional transformation added in the splunk query. I have below two problems

GetSFTP error

Hi, I'm trying to get a GetSFTP processor to work. I've provided the private key path. The error in nifi-app.log says: Null.PointerException: null at com.jcraft.jsch.KeyPairPKCS8.getPublicKeyBlob(keyPairPKCS8.java:199) at com.jcraft.jsch.IdentityFile.getPublicKeyBlob(IdentityFile.java:199)

Re: Splunk Processor - Re-play

Hello, If you want to specify Earliest Time and Latest Time, then you need to change Time Range Strategy to 'Provided". The "Managed" time ranger strategies are meant to let the processor calculate the time ranges for you on each execution and you can not specify time ranges when using those

Calling NIFI job from any Enterprise Scheduler

Hi Team, I have requirement to call NIFI job from any Enterprise Scheduler (for ex: tidal Enterprise Scheduler). What is the way to call nifi job from a command line so that it can triggered from external program? -Siva

Re: Calling NIFI job from any Enterprise Scheduler

Siva - I find the best way to trigger a NiFi workload from any sort of enterprise scheduler is to start the workflow you wish to trigger with a *ConsumeJMS processor and then have that enterprise scheduler fire the event to start the job to that configured endpoint. In this manner you can use your