Midhun, A little more information would help. What size files are you sending? Have you looked at resource usage to see what the bottleneck is? Did you adjust your nifi system thread count from the hamburger menu? How many threads are running total for nifi? It's the number in the top left of the screen.
Thanks, Chad On Tue, Mar 17, 2020 at 3:25 PM Midhun Mohan <[email protected]> wrote: > Do anyone have better idea on this > > On Tue, 17 Mar 2020, 6:32 pm Midhun Mohan, <[email protected]> wrote: > > > Hi all, > > > > I have a queue which will be filling up with realtime records of around > > 20k records. Which is posting to an endpoint using Invokehttp processor. > > > > currently the average throughput is for 10k records it takes around 20 > > minutes to complete the invokehttp processor posting. > > I Increased the concurrent thread to larger number which is increasing > > the throughput, but it is causing other processor to terminate. I think > > that can be solved by running on larger instances. > > > > What all things I need to take care to make sure I get a real time > > posting on endpoint. > > > > I need 20k records to be processed as they receive it > > > > > > thanks in advance > > > > -- > > > > > > Regards, > > Midhun Mohan > > >
