Thank you for sharing your experience! I’d appreciate it if anyone else would like to share their experience as well.
It’s really insightful for me to hear about nodes with over 30+ thousand processors. пт, 7 лист. 2025 р., 18:22 користувач Joe Witt <[email protected]> пише: > Hello Maksym, > > I've seen enterprise level nifi nodes or clusters with flows having as few > as two processors. And I've seen 30+ thousand. > > Do idle processors matter? In theory they could at extreme-ish levels on > constrained machines in terms of CPU. But in practice no. > > What really gets tricky after a while is having lots of flows on the same > cluster at once who are all resource intensive and have strong SLAs. Here > disk, cpu, and even network become a bottleneck and it does get admittedly > hard to reason over the behavior then. For this reason many of us have > moved into making it as easy as possible for people to build lots of nifi > clusters and manage them easily. This has been extremely powerful because > it addresses the resource isolation problem nicely. > \ > Thanks > > On Fri, Nov 7, 2025 at 9:17 AM Максим Римар <[email protected]> wrote: > >> Hi everyone! >> >> I have a question regarding the number of processors on the NiFi canvas. >> >> Could you please share how many processors are considered acceptable >> within a single NiFi instance? Can an excessive number of active (but idle) >> or disabled processors negatively affect the processing time of flows that >> are actively processing data? >> >> I suppose that after a certain number of processors, it may also become >> difficult to manage them effectively — regardless of whether they are idle >> or not. Maybe there’s a practical limit, after which it’s better to split >> different flows across separate NiFi clusters? >> >> Best regards, >> Maksym Rymar >> >
