First, I'm sorry if this question has already been asked & answered. My search-foo may have failed me.
We're in the process of moving to k8s and I'm not confident about how many clusters I should setup. I know there are many possible options, but I'd really appreciate feedback from people running k8s throughout their company. Nearly everything we run is containerized, and that includes our company-wide internal services like FreeIPA, Gitlab, Jenkins, etc. We also have multiple, completely separate, applications with varying security/auditing needs. Today, we schedule all of our containers via salt which only allows for containers to be mapped to systems in a fixed way (not great). We have a group of systems for each application environment and one group for internal services. Each group of systems may be subject to different network restrictions, depending on what they're running. The seemingly-obvious answer to replace our setup with k8s clusters is the following configuration: - Create one cluster for internal services - Create one cluster per application, with environments managed by namespaces whenever possible Great, that puts us with several clusters, but a smaller number of clusters than our previous "system groups". And, our network rules will mostly remain as-is. However, there is another option. It seems that a mix of calico ingress/egress rules, namespaces, RBAC, and carefully crafted pod resource definitions would allow us to have a single large cluster. Maybe it's just my inexperience, but that path seems daunting. So, all that background leads me to the simple question: In general, do you create one cluster per application? If not, do you have some other general rule that's not just "when latency or redudancy require it, make a new cluster"? Thanks in advance! Terence -- You received this message because you are subscribed to the Google Groups "Kubernetes user discussion and Q&A" group. To unsubscribe from this group and stop receiving emails from it, send an email to kubernetes-users+unsubscr...@googlegroups.com. To post to this group, send email to kubernetes-users@googlegroups.com. Visit this group at https://groups.google.com/group/kubernetes-users. For more options, visit https://groups.google.com/d/optout.
