Load balancer for Kafka brokers

Hi, Has anyone used load balancers between publishers and Kafka brokers? I want to do active-passive setup of Kafka in two datacenters. My question is can I add GSLB layer between these two Kafka clusters to configure automatic fail over while publishing data? Thanks, LCassa

Re: Load balancer for Kafka brokers

We use loadbalancers for our producer configurations, but what you need to keep in mind is that that connection is only used for metadata requests. The producer queries the loadbalancer IP for metadata for the topic, then disconnects and reconnects directly to the Kafka brokers for producing

Re: Load balancer for Kafka brokers

Thanks for detail answer. Regards, LCassa On Tue, Nov 3, 2015 at 10:54 AM, Todd Palino wrote: > We use loadbalancers for our producer configurations, but what you need to > keep in mind is that that connection is only used for metadata requests. > The producer queries the