On Tue, May 16, 2017 at 7:06 AM, Joe Auty <joea...@gmail.com> wrote:
> Hi Tim,
>
> I have a couple of different use cases actually, but at this point I'm just
> trying to understand the architecture to know where my LB fits. Options:
>
> - haproxy/nginx outside of the cluster pointing to NodePort/LoadBalancer
> ports

-  haproxy/nginx outside of the cluster pointing to pod IPs (the point
being that the LB doesn't have to be literally inside the cluster,
just able to reach the master and teh pods)

> - haproxy/nginx inside the cluster
> - Using just the Google LB and Kubernetes without haproxy/nginx
>
> One use case involves a need for IP whitelisting and the other session
> affinity, so I'm mostly just trying to straighten out my understanding so
> that I can put all of these pieces together.

Google's L7 LB has L7 affinity, but only as far as a VM.  If you have
more than one backend pod on a single VM, that breaks down.  Google's
L7 LB doesn't have IP firewalling built in, though.

If you want L7 affinity and IP whitelisting, you probably need to DiY for now.

Something like:
* Run a deployment of nginx/haproxy
  - use a hostPort to force it to be max 1 per node (for best balancing)
* Expose via a Service LB (L4) with ClientIP affinity and source
ranges configured
  - use the OnlyLocal annotation to retain client IP
* Configure nginx to target pod IPs directly (I know this logic exists
as part of the Ingress controller, not sure if it is standalone).

You are not alone asking for this sort of setup - I'd be surprised if
there are not better docs out there.  I don't have them at hand,
though.


> 'Tim Hockin' via Kubernetes user discussion and Q&A
> May 15, 2017 at 11:59 PM
> You could maybe start with what you want to achieve, and what your
> requirements are?
>
> Joe Auty
> May 14, 2017 at 1:28 PM
> Sorry for such a vague subject, but I think I need some help breaking things
> down here.
>
> I think I understand how the Google layer 7 LBs work (this diagram helped
> me:
> https://storage.googleapis.com/static.ianlewis.org/prod/img/750/gcp-lb-objects2.png)
> , I understand NGinx and HAProxy LBs independently, and I believe I also
> understand the concepts of NodePort, Ingress controllers, services, etc.
>
> What I don't understand is why when I research things like socket.io
> architectures in Kubernetes (for example), or features like IP whitelisting,
> session affinity, etc. I see people putting NGinx or HAProxy into their
> clusters. It is hard for me to keep straight all of the different levels of
> load balancing and their controls:
>
> Google backend services (i.e. Google LB)
> Kubernetes service LB
> HAProxy/NGinx
>
>
> The rationale for HAProxy and NGinx seems to involve compensating for
> missing features and/or bugs (kube-proxy, etc.) and it is hard to keep
> straight what is a reality today and what the best path is?
>
> Google's LBs support session affinity, and there are session affinity
> Kubernetes service settings, so for starters, when and why is NGinx or
> HAProxy necessary, and are there outstanding issues with tracking source IPs
> and setting/respecting proper headers?
>
> I'm happy to get into what sort of features I need if this will help steer
> the discussion, but at this point I'm thinking maybe it is best to start at
> a more basic level where you treat me like I'm 6 years old :)
>
> Thanks in advance!
> --
> You received this message because you are subscribed to the Google Groups
> "Kubernetes user discussion and Q&A" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to kubernetes-users+unsubscr...@googlegroups.com.
> To post to this group, send email to kubernetes-users@googlegroups.com.
> Visit this group at https://groups.google.com/group/kubernetes-users.
> For more options, visit https://groups.google.com/d/optout.
>
>
> --
> You received this message because you are subscribed to the Google Groups
> "Kubernetes user discussion and Q&A" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to kubernetes-users+unsubscr...@googlegroups.com.
> To post to this group, send email to kubernetes-users@googlegroups.com.
> Visit this group at https://groups.google.com/group/kubernetes-users.
> For more options, visit https://groups.google.com/d/optout.

-- 
You received this message because you are subscribed to the Google Groups 
"Kubernetes user discussion and Q&A" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to kubernetes-users+unsubscr...@googlegroups.com.
To post to this group, send email to kubernetes-users@googlegroups.com.
Visit this group at https://groups.google.com/group/kubernetes-users.
For more options, visit https://groups.google.com/d/optout.

Reply via email to