Hello Mike, Thanks a lot for looking at it. But I have already configured threads for remote port in RPG. But congestion is in the transfer between process group to external port. And there are no configuration option to increase number of threads in externalOutputPort. Number of running threads for output port is always showing as 3 in ui. So I am not sure how to increase the throughput now. I quickly went through implementation of LocalPort.java. Looks like flowflies are transferred at batches of 100. Can you give me any other suggestion to increase throughput ?
-Ashwin On 2018/09/25 15:29:32, ashwin konale <ashwin.kon...@gmail.com> wrote: > Hi I have the following flow which I am trying to increase the throughput. > I am runnign 3 node nifi cluster(v1.6) > > CDC -> processGroupOutputPort -> externalOutputPort > RPG -> downstream > > Flowfiles are always queued up between processGroupOutputPort to > externalOutputPort. I dont see any configuration to increase the number of > threads for this operation as well. I have set backpressure to be 10,000 > flowfiles. Since the CDC produces at much faster rate than this, I want to > increase the throughput of the flow. Also I see in the UI > externalOutputPort has number of threads running as 3 all the time no > matter how much I increase number of threads to consume in RPG. > > Any pointers here will be much helpful. > > Ashwin >
