Very helpful John, thank you.
I think #1 is what I'm looking to do; just wasn't sure where to start. I think
I can connect the clusters on a private network using google vpc, so that
should address the security issues. I'll start messing around/learning the
kube-dns service and stubdomains.
If you have multiple clusters, you should give each a unique cluster domain
anyway, rather than just ’cluster.local’. From your description below your pod
IPs are routable between the clusters. In that case, you have a couple ways to
do this:
1) You could expose the kube-dns service externally
Closest thing you can get is
https://github.com/kubernetes-incubator/external-dns but I don't think it
has support for StatefulSet ordinal numbers, mostly because it's not a
common scenario to expose individual pods to the Internet publicly.
However, you may still make use of external-dns to
Kubernetes StatefulSets create internal DNS entries with stable network IDs.
The docs describe this here:
--
Each Pod in a StatefulSet derives its hostname from the name of the StatefulSet
and the ordinal of the Pod.