Hi, I'm looking for ways to automate the deployment of a NiFi 1.10 cluster to an on-prem virutalized production environment which I have no sudo access to.
Our System Engineers prefer to deploy RPM pachages on our behalf, and that, I believe, would be the easiest way for them. I know NiFi's build has is an rpm profile, but I'm not sure how to automate the cluster and secure configuration. (Also, I'd prefer to avoid having to build NiFi myself.) The alternatives I can see (some of them could be used together, I guess): - Post-installation Bash scripts - Ansible - Terraform - Kubernetes (?) Does anybody in the group have any recommendations or, even better, concrete examples you could share? (Pierre Villard's NiFi with OIDC using Terraform on the Google Cloud Platform is a great source, but it deploys to GCP and uses OpenID Connect (OIDC). Our cluster is on-prem and we use LDAP for authentication.) We are planing to set a cluster with 3 small nodes at first to gain some experience about the load and required resources when running our data flows. We don't have many transfomations, NiFi is being used just to move data from our local systems of record to the cloud. It's for data warehouse project, and High Availability is not a major requirement at this moment. In that scenario, what would be better? To have 3 NiFi instances, each with an embedded Zookeeper? If so, is OK to run the NiFi Registry instance on one of the nodes? Or should we have a separated node for an external (standalone?) Zookeeper and NiFi Registry instances? Thank you, Marcio
