Hi everyone, I have a question about the way a NiFi cluster is scaled when we have more new data Flows.
We are having a NiFi cluster with 3 nodes running on production for about 2 years. Currently, there are 3000 processors running. The UI interaction will slow down when more processors are added and more JVM memory required. If we add more nodes to the cluster, the UI interaction will be slow as the replication of Flow configuration and the required JVM memory will not decrease as the number of processors remains the same. Should we set up a separate cluster for new data Flows? Could you please give me a suggestion? Thank you so much! *Our server specs:* Intel(R) Xeon(R) CPU E5-2620 v3 @ 2.40GHz CPU(s): 24 Mem: 62 gb (total), 24 gb (used), 7 gb(free), ... cached *NiFi instance specs:* # Secure setup # JVM memory settings java.arg.2=-Xms24g java.arg.3=-Xmx24g # Repos 50 % of 1.7 Tb HDD disk # Network: 10Gb/s bandwidth Thanks & Regards Thắng, Nguyễn Đình
