Thank you for your help Andy. I think you are correct, the flowfiles are very small and the previous Processor is very fast – this might explain what is happening. I’ve enclosed screenshots of the connection properties and the workflow. In the screenshot I see 400 flowfiles were allowed through before back pressure was applied. The back pressure object threshold is set to 1. Do you have any recommendations?
Kevin [cid:[email protected]] [cid:[email protected]] From: Andy LoPresto [mailto:[email protected]] Sent: Thursday, April 27, 2017 4:16 PM To: [email protected] Subject: Re: Back Pressure Object threshold not honored Hi Kevin, Sorry to hear you are having this issue. Can you please provide a screenshot of the connection properties in the configuration dialog? How quickly do those flowfiles get enqueued? I think there’s a chance if they are very small & the previous processor is very fast (i.e. RouteOnAttribute, SplitText) that it could enqueue a higher number before the back pressure check is executed. Andy LoPresto [email protected]<mailto:[email protected]> [email protected]<mailto:[email protected]> PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 On Apr 27, 2017, at 4:07 PM, Kevin Verhoeven <[email protected]<mailto:[email protected]>> wrote: I have an odd problem. I set the Back Pressure Object threshold on a link between two Processors to 1, but 200 flowfiles are passed to the queue before back pressure is honored. I need the back pressure to be set to a small number of flowfiles to keep the source from flooding the destination. Has anyone come across this problem before? I am running 12 instances of NiFi on version 1.1.1 on Ubuntu 14.04. Regards, Kevin
