Ryan, I presume you’re using the Round Robin strategy? Looks like that strategy will yield the processor if any destination is full. And it sounds like that will be very common in your case. Would recommend configuring the Processor and in the Settings tab, set the Yield Duration to “0 secs”. I suspect that will give you dramatically better performance.
Thanks -Mark > On Sep 15, 2020, at 4:41 PM, Ryan Hendrickson > <[email protected]> wrote: > > Hello, > I've got 1 million plus FlowFiles (nothing I can do about the count), that > goto a DistributeLoad. The DistributeLoad with 2 threads, a run duration of > 1 sec can only sustain ~200,000 FlowFiles / five minutes. > > Is there a better design pattern or a processor that takes a Batch Size to > split a Relationship into two or more? > > Thanks, > Ryan
